summaryrefslogtreecommitdiffstats
path: root/dovetail/utils
AgeCommit message (Collapse)AuthorFilesLines
2018-11-14Add missing unit tests for utils filesStamatis Katsaounis1-27/+26
JIRA: DOVETAIL-724 This patch adds unit tests which were missing from dovetail code base. Furthermore it updates the test_parser existing unit test. Finally, it fixes some minor issues in dovetail_utils itself. Change-Id: I8fd7cd4f6b1ede11664914746d2279f062511639 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-08Remove the offline scriptsxudan3-156/+0
As we discussed in Dovetail weekly meeting, there is no need to maintain all the offline scripts. Change-Id: I360d1a211856626af91310f142c1777a77398a12 Signed-off-by: xudan <xudan16@huawei.com>
2018-09-05Enable the web portal to show all endpointsxudan2-11/+29
The endpoints info for the 2018.08 has been changed. The web portal needs some adaptions for the new data format. It keeps the same as 2018.01 and doesn't need to change dovetail-webportal. JIRA: DOVETAIL-725 Change-Id: I74cde3aa6032c7afac4b6ce1d2146e09a0f99fe5 Signed-off-by: xudan <xudan16@huawei.com>
2018-06-29Update licence headers to comply with guidelinesGeorg Kunz4-4/+16
Updating the licence headers to comply with the community guidelines [1] and anteater checks. [1] https://wiki.opnfv.org/display/DEV/Contribution+Guidelines#ContributionGuidelines-License Change-Id: Idec787e32daf76c0b1bd6108977b78828125da5e Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-14Replace openstack commands with shadexudan3-54/+34
Use openstack shade to get endpoint infomation rather than executing openstack commands directly. The next step can replace openstack commands by shade for some test cases that need to create openstack resources (images, flavors) if we agree to use shade. JIRA: DOVETAIL-659 Change-Id: I72b302fb2d4a61e9249a7e53f81ea9464944dcd3 Signed-off-by: xudan <xudan16@huawei.com>
2018-05-07Decoupling Bottlenecks Docker config items from source codexudan1-19/+4
There are some special Docker setting items when creating Bottlenecks Docker Cntainers. Move the special settings to config files. Disable the function to push results to DB. JIRA: DOVETAIL-645 Change-Id: Icc033222edf74c0fe4853dede2794f4226fd4252 Signed-off-by: xudan <xudan16@huawei.com>
2018-05-04Remove local DBxudan10-401/+0
Remove local DB and can just report without launch local DB. Need to do a little modification with the web portal code. JIRA: DOVETAIL-593 Change-Id: I595db39cce4156596ee0522d4b7e642a23d78ab9 Signed-off-by: xudan <xudan16@huawei.com>
2018-04-10Decoupling Yardstick Docker config items from source codexudan1-4/+8
There are some special Docker setting items when creating Yardstick Docker Containers. 1. Remove the extra settings which are required by Yardstick Danube. 2. Remove the settings for pushing results to DB because Dovetail plan to disable this function. 3. Move the other special Functest settings to config files. JIRA: DOVETAIL-640 Change-Id: Ic2d90393e227d7886b14d805eaa307b7aef56e4a Signed-off-by: xudan <xudan16@huawei.com>
2018-04-10Support to specify docker image for each test casexudan1-0/+17
1. Currently each type of test cases will use one docker image. 2. For example, Functest test cases use opnfv/functest-restapi:euphrates Yardstick uses opnfv/yardstick:opnfv-5.1.0 3. It needs to support to specify the docker image for each test case. 4. For example, vping test cases use opnfv/functest-smoke:euphrates sdnvpn uses opnfv/functest-features:euphrates 5. The benefit of this is that these docker images are well verified by Functest CI and from Functest plan, they may not support functest-restapi docker image in its future release. JIRA: DOVETAIL-638 Change-Id: I8a30eea2233aeff809af2e241b6c939194397832 Signed-off-by: xudan <xudan16@huawei.com>
2018-04-04Decoupling Functest Docker config items from source codexudan1-0/+12
There are some special Docker setting item when creating Functest Containers. 1. Remove the extra settings which are required by Functest Danube. 2. Remove the settings for pushing results to DB because Dovetail plans to disable this function. 3. Move the other special Functest settings to config files. JIRA: DOVETAIL-639 Change-Id: Ibc4090b5c0aafdf9ed64e65a9a92e34a12a16df5 Signed-off-by: xudan <xudan16@huawei.com>
2018-03-14Bugfix: Failed to get the hardware infoxudan1-3/+4
The directory of userconfig has changed from /home/opnfv/dovetail/dovetail/userconfig to /etc/dovetail/userconfig. Change-Id: Id3e8b1f3e9299e9263a4adf3456b6733fdb62e11 Signed-off-by: xudan <xudan16@huawei.com>
2018-03-14Add process info to pod.yaml to specify the info of a special processxudan2-3/+38
1. Many HA test cases try to kill special processes with their name. 2. Then they check corresponding openstack services and the status of processes' recovery. 3. For different SUTs, the names of the processes and the hosts' names may be different. 4. So there is a requirement for Dovetail tool to provide one way to allow users to specify all the infos about process name and its host name. 5. All process infos can be added into file DOVETAIL_HOME/user_config/pod.yaml 6. The infos include 'attack_process' and 'attack_host' for each HA test cases. 7. If not given in this file, will use Yardtsick default values. JIRA: DOVETAIL-627 Change-Id: I83cee991f72a8685080ed562597c70d73002623a Signed-off-by: xudan <xudan16@huawei.com>
2018-03-06leverage data_files to eliminate so many hardcoded abs_path_seekingsSerenaFeng1-6/+4
1. mv conf/ userconfig/ compliance/ patch to etc/ 2. after installation etc/ will be put under /etc/dovetail 3. leveraging /etc/dovetail in coding Change-Id: Icf9cb00ff7fc7cf35755f60d3e258b23e2c70839 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2018-03-01Bugfix: Dovetail tool will crash when hosts.yaml file with incorrect formatxudan1-1/+34
If the hosts.yaml file is like, — hosts_info: 192.168.141.101: it will raise an exception, File "/usr/local/lib/python2.7/dist-packages/dovetail/utils/dovetail_utils.py", line 227, in add_hosts_info names=hostnames) File "/usr/local/lib/python2.7/dist-packages/python_hosts/hosts.py", line 54, in _init_ raise Exception('Address and Name(s) must be specified.') Exception: Address and Name(s) must be specified. If the hosts.yaml file is empty, it will crash with, File "/usr/local/lib/python2.7/dist-packages/dovetail/container.py", line 174, in create if hosts_yaml['hosts_info']: TypeError: 'NoneType' object has no attribute '_getitem_' JIRA: DOVETAIL-621 Change-Id: I547928e514b3294c048379459c07df89879fbb03 Signed-off-by: xudan <xudan16@huawei.com>
2018-02-16Add a function to check the cacert filexudan1-3/+16
1. Currently it won't pass the cacert file to other containers if the OS_AUTH_URL is http not https. 2. However, even though the OS_AUTH_URL is http, it still needs cacert file somewhere for Functest and Rally. 3. This problem is found on Fuel Euphrates. 4. Add a function to check whether the cacert file exists. 5. If exists, pass it to testing project containers. JIRA: DOVETAIL-616 Change-Id: Ied7bcc72e8f1c738bbce32c18096ca13641d3cd7 Signed-off-by: xudan <xudan16@huawei.com>
2018-02-08Add ablity to config EXTERNAL_NETWORK in env_config.shEddie Arrage1-23/+28
- EXTERNAL_NETWORK env variable can be explicitly set - If set, the value will be used in Yardstack configuration - Otherwise, previous method of using output from 'openstack network list' will still be employed Change-Id: I9d8b4a69ff3f5093c034823cc95e92e151bfade6 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-01-26Align container tags and test suite configuration yaml for initial releasexudan1-1/+1
Change default container tag to be: 1. Functest ovp.1.0.0 2. testapi ovp.1.0.0 Add test suite ovp.1.0.0 and set it to be the default test suite. Comment out bottlenecks CLI for initial release. JIRA: DOVETAIL-580 Change-Id: I956e49e43fc7ba0176c14079b7228089db5dc108 Signed-off-by: xudan <xudan16@huawei.com>
2017-12-18Add License for the python scripts in folder offlinexudan2-2/+16
Change-Id: I9c585f132c10ef726cd859e4abe3c9a874cbe0bc Signed-off-by: xudan <xudan16@huawei.com>
2017-11-20bugfix: hosts info is wrongly processedSerenaFeng1-4/+8
changes: 1. add usage example in hosts.yaml.sample 2. fix /etc/hosts from wrong format {'hostname': 'ip'} to the right 'ip hostnames' 3. fix --add-hosts from wrong usage --add-host {'hostname': 'ip'} to the right --add-host='hostnames':ip 4. support per ip mapping mutiple hostnames, which is also in line with /etc/hosts schema JIRA: DOVETAIL-556 Change-Id: I92e8cb0fd3476b61f5c73a69e34c4a66aef51d6e Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-11-16Remove redundant log when launch local DBxudan1-3/+9
The script launch_db.sh will print "Already Exists" logs when the DB has been initialized by the data stored in JumpHost. Ignore this kind of logs because it won't affect the launch of the DB but it will confuse users. JIRA: DOVETAIL-557 Change-Id: I23616b10bbadc49888731e943d0a4ee4425045f5 Signed-off-by: xudan <xudan16@huawei.com>
2017-11-06Bugfix: Failed to build local DB on Centosxudan2-17/+17
1. The scripts for building local DB and testapi service just work on Ubuntu. 2. For Centos, they fails to do that. 3. This is mainly because of that Centos can't use the IP of the JumpHost to connect the DB and testapi. It needs to use the internal IPs of the DB container and the testapi container. 4. Change the IPs in the scripts to be the containers' internal IPs. JIRA: DOVETAIL-548 Change-Id: I71aed82cb620b58bcd43ace61497db65c5bd7ecc Signed-off-by: xudan <xudan16@huawei.com>
2017-11-02Get SUT's endpoint infoxudan1-0/+27
Get the admin endpoints of all service. JIRA: DOVETAIL-546 Change-Id: Ie0ac3bc5b4eb0885046e207b73217994a4f0e358 Signed-off-by: xudan <xudan16@huawei.com>
2017-11-02Get hardware info of SUTxudan1-0/+82
Hardware info: Use ansible to get all hardware info from all nodes. JIRA: DOVETAIL-540 Change-Id: I6a2dde1b2ebae2af8f702008c23110ebe63cc06f Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Bugfix: the sdnvpn DB initialization information lacks two test casesxudan1-0/+2
1. The SDNVPN DB initialization information lacks two test cases, functest_testcase_4 and functest_testcase_8. 2. So the results of these 2 test cases cannot be pushed into DB. 3. Add these 2 test cases info to DB. JIRA: DOVETAIL-535 Change-Id: I1c6d049b942806924f15dd106452fd9b4d554454 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-28Bugfix: sdnvpn test cases failed due to wrong module namexudan2-0/+7
SDNVPN test cases failed due to wrong module name. The module name needs to be changed into "sdnvpn.test.functest.testcase_1" Refer to patch https://gerrit.opnfv.org/gerrit/#/c/41385/ Currently Dovetail uses functest:cvp.0.5.0 which uses module name "testcase_1". JIRA: DOVETAIL-510 Change-Id: I3232760d3af34125c7da71a5d2c62ca32693c82b Signed-off-by: xudan <xudan16@huawei.com>
2017-09-26Update the script for building local DB and testapixudan5-667/+31
1. When test dovetail, users can build local DB and testapi to store and report the results. 2. The script for building local DB and testapi needs some updates. JIRA: DOVETAIL-507 Change-Id: I8bc96bfea27f424468cafaa2e05894065ef44ad9 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-08tag dovetail with 0.6.0xudan3-5/+5
docker image used opnfv/yardstick: danube.3.2 opnfv/functest: cvp.0.5.0 opnfv/bottlenecks: cvp.0.4.0 opnfv/testapi: cvp.0.6.0 opnfv/dovetail:web.cvp.0.6.0 opnfv/dovetail:api.cvp.0.6.0 opnfv/dovetail: cvp.0.6.0 main changes Merge all test specification docs about test area tempest and defcore Merge addendum doc and workflow doc Remake aarch64 patch for Dovetail container Remove some tempest test cases that are not too common Add additional Tempest API test cases into test case tempest.tc005 persist db file in host for mongo container add nginx to host static files add a sample tempest_conf.yaml file into userconfig Add a patch to set ha SLA to be 30 seconds Modify logs Bugfix: the config files in useeconfig will cover user's config Bugfix: functest only keeps the last test case's log Bugfix: pre_condition cmds is just executed once For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool JIRA: DOVETAIL-497 Change-Id: I74626bbf65ce0121cc7b53394c85694e15df8484 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-07Modify logsxudan1-6/+7
JIRA: DOVETAIL-498 Change-Id: Ie98fc89cc840b557aa4186c6c2bee2d610432af0 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-31Bugfix: the config files in useeconfig will cover user's configxudan1-0/+6
1. Now there are 2 sample files tempest_conf.yaml and hosts.yaml in userconfig, and thet will cover user's tempest_conf.yaml and hosts.yaml in $DOVETAIL_HOME/pre_config. 2. Rename the files in userconfig to be tempest_conf.yaml.sample and hosts.yaml.sample. 3. Add the hosts info in file /etc/hosts in Dovetail Container. JIRA: DOVETAIL-492 Change-Id: I2b5694a8058b864b510925eec595d6f2bd1062ff Signed-off-by: xudan <xudan16@huawei.com>
2017-08-22persist db file in host for mongo containergrakiss1-1/+1
JIRA: DOVETAIL-488 Keep db file in host to avoid data lost Change-Id: If039789eabfb8847ea344c016cb74e226be43f73 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-17add nginx to host static filesgrakiss5-6/+726
JIRA: DOVETAIL-485 Tornado does not support directory listing, so add nginx to host static files, and support log file browsing Change-Id: Ic1427ab9c64661b3993ac60943f470b125a0fbe7 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan3-7/+7
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Bugfix: wrong command in function 'check_https_enabled'xudan1-3/+4
JIRA: DOVETAIL-482 1. In function check_https_enabled, it will use cmd "openstack catalog show identity |awk '/public/ {print $4}'" to check if it is https. 2. However, this command will not work if it is https. 3. Check https via OS_AUTH_URL rather than "openstack catalog show identity". Change-Id: If40ffa8e9b33c38123ff4b834198a8eaaedc1c9c Signed-off-by: xudan <xudan16@huawei.com>
2017-08-07fix base_url for public urlgrakiss2-3/+67
Change-Id: I171e9b0bce1891594bf7ef577809e73f05556810 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-04Merge "Tag dovetail with cvp.0.4.0"hongbo tian3-5/+9
2017-08-04Tag dovetail with cvp.0.4.0xudan3-5/+9
JIRA: DOVETAIL-476 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.4.0 dovetail: cvp.0.4.0 2. main changes Add docs about vping test cases (test scope and test specification) Add 2 vping test cases into proposed_tests Bugfix: Build docker image failed because of lacking of packages Add resiliency.tc001 into proposed_tests 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-03Add resiliency test caes into proposed_testsxudan1-0/+5
JIRA: DOVETAIL-474 Add Bottlenecks resiliency test case "posca_factor_ping" into proposed_tests. Change-Id: I76aea651014fb4722ddae07559f417d3f840eee2 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-21Tag dovetail with cvp.0.3.0xudan3-6/+6
JIRA: DOVETAIL-468 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 testapi: cvp.0.3.0 dovetail: cvp.0.3.0 2. main changes fix dovetail docker version to be 17.03.0-ce adapt yardstick danube.3.1 For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f Signed-off-by: xudan <xudan16@huawei.com>
2017-07-17Delete the ERROR log when it is not httpsxudan1-4/+5
JIRA: DOVETAIL-462 1. If it is not https, Dovetail will give a error log 2017-07-13 21:58:30,409 - container.Container - ERROR - The command 'openstack catalog show identity |awk '/public/ {print $4}'| grep 'https'' failed. 2. Remove this error log becuase it is not an error. Change-Id: I5791b1925cad8606d70eefd4940dd9bf46956305 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-03tag dovetail with 0.2.0MatthewLi3-7/+7
JIRA: DOVETAIL-447 docker images used yardstick danube.3.0 functest cvp.0.2.0 testapi cvp.0.2.0 dovetail cvp.0.2.0 main changes 1, fix yardstick HA bugs 2, fix functest sdnvpn offlinebugs 3, fix dovetail https bugs, etc. for more info, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I4edb61b84ed80d8d7624f69db372fec60d73aa38 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-28Modify Dovetail logsxudan1-9/+11
JIRA: DOVETAIL-450 Change-Id: I795679c9559d1bead3aecefff28d21b6567aac2f Signed-off-by: xudan <xudan16@huawei.com>
2017-06-28Merge "https enabled checking"hongbo tian1-5/+16
2017-06-27https enabled checkingMatthewLi1-5/+16
JIRA: DOVETAIL-456 before to check OS_CACERT and OS_INSECURE when using https + credential or + no credential, there's a need to check if https enabled. error log https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/37/console Change-Id: Icdf17541fe6cf64b2f000d424c8d4dcc28cfd371 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-23Use official Docker images to build local DBxudan3-10/+10
JIRA: DOVETAIL-422 1. Use official Docker images, mongo:3.2.1 and opnfv/testapi:cvp.0.1.0, to build local database and testapi service. 2. Use the stable Docker tag in offline config file. Change-Id: I446a4248effc95f6f5aa6a6d90c0d31ef2f60b39 Signed-off-by: xudan <xudan16@huawei.com>
2017-06-21Merge "fix judgement for https+no credential case"hongbo tian1-2/+2
2017-06-21Merge "Docker version misalignment and move some irrelevant messages"Leo wang1-21/+14
2017-06-20fix judgement for https+no credential caseMatthewLi1-2/+2
Change-Id: Id3d4e9af04f1882f69b8c9fe588355d76ad001c4 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-09https + no credential supportMatthewLi1-8/+16
JIRA: DOVETAIL-440 Change-Id: I2bb430de040127dea493e8bb5423ad8204f799e2 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-07Docker version misalignment and move some irrelevant messagesxudan1-21/+14
JIRA: DOVETAIL-437 JIRA: DOVETAIL-444 1. Docker client version and server version should be 1.12.3 or later. 2. If any of them is older than 1.12.3, there will be an ERROR message. 3. Delete the “rm -rf results” message. Change-Id: I0c10cf256ef139cac4d43f36108bf5f3f9da8398 Signed-off-by: xudan <xudan16@huawei.com>
2017-05-30sdnvpn offline support in dovetailMatthewLi3-1/+35
JIRA: DOVETAIL-441 Change-Id: I709c62a36c65ef0b4da69c5508f7a8273e68dc2b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>