summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-06-09IPv6 Test CasesBin Hu2-1/+1910
Change-Id: Icdb2786076aa6a263449eca5db4a07d14f1e2adf Signed-off-by: Bin Hu <bh526r@att.com>
2017-06-09Merge "Fix the docker version to be 1.12.3 in Dovetail docker image"hongbo tian1-1/+1
2017-06-09Merge "https+credential support"hongbo tian2-3/+28
2017-06-08https+credential supportMatthewLi2-3/+28
JIRA: DOVETAIL-440 Change-Id: I69fb96673755545e8e0d78d940870195dbf20a0b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-07Merge "Adding SDNVPN test cases to the Optional Test areas of the CVP."Georg Kunz2-238/+702
2017-06-06Fix the docker version to be 1.12.3 in Dovetail docker imagexudan1-1/+1
JIRA: DOVETAIL-442 Change-Id: I476c2dabf5b23ed42a0004d8d3a9e17727051eca Signed-off-by: xudan <xudan16@huawei.com>
2017-06-06Merge "Support Yardstick to push results to database"Leo wang2-14/+10
2017-06-06Merge "change the name of Yardstick results file and some log msg"Leo wang4-15/+15
2017-06-05Adding SDNVPN test cases to the Optional Test areas of the CVP.Georg Kunz2-238/+702
Included the tests for SDNVPN in the docetail scope document Performed spell checking of the committed test area document and included the section around test suite structure. This patch should be reviewed and approved by the SDNVPN team prior to being merged. Change-Id: Ia2f9a1bddb02b9191da1239a73f121dce6687af1 Co-Authored-By: Georg Kunz <georg.kunz@ericsson.com> Co-Authored-By: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-05-30sdnvpn offline support in dovetailMatthewLi6-2/+53
JIRA: DOVETAIL-441 Change-Id: I709c62a36c65ef0b4da69c5508f7a8273e68dc2b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-25change the name of Yardstick results file and some log msgxudan4-15/+15
JIRA: DOVETAIL-428 1. Change the name of Yardstick result file from opnfv_yardstick_tc019.out to dovetail.ha.tc001.out. Because opnfv_yardstick_tc019 is the name defined in Yardstick and dovetail.ha.tc001 is the name defined in Dovetail. 2. Check whether the file exists before reporting the results are stored in file. 3. Delete test cases vping_ssh, vping_userdata and sdnvpn.tc003 from the testsuite proposed_tests. Change-Id: I4cb16947729479616a03abd9e91b76f9a41a949c Signed-off-by: xudan <xudan16@huawei.com>
2017-05-25Change the directories of results and some files to DOVETAIL_HOMExudan7-31/+51
JIRA: DOVETAIL-438 1. Need an env variable DOVETAIL_HOME in env_config.sh 2. env_config.sh, pod.yaml and id_rsa should be put in path DOVETAIL_HOME/pre_config 3. the results will also be put in this path 4. no need to give the path of openstack credential file while running a testsuite 5. if running with the code, source the env_config.sh file before running source $DOVETAIL_HOME/env_config.sh dovetail run --testsuite <testsuite_name> 6. if running with Dovetail docker image docker run -it --privileged=true -e DOVETAIL_HOME=<dovetail_home_path> -v <dovetail_home_path>:<dovetail_home_path> -v /var/run/docker.sock:/var/run/docker.sock opnfv/dovetail:latest /bin/bash Change-Id: Ia23078f27a34e293d0075e49c673930f41069cb6 Signed-off-by: xudan <xudan16@huawei.com>
2017-05-24SDNVPN test cases failed in CIxudan9-33/+39
JIRA: DOVETAIL-439 1. SDNVPN test cases run in CI failed, because the file /home/opnfv/repos/sdnvpn/sdnvpn/test/functest/config.yaml is empty. 2. copy the file userconfig/sdnvpn_config_testcase1/2/4/8.yaml to /home/opnfv/repos/sdnvpn/sdnvpn/test/functest/config.yaml in Functest container Change-Id: Ie904f83c755efc0d9e0abe5dcd44fe4a5056123e Signed-off-by: xudan <xudan16@huawei.com>
2017-05-23Merge "Add test case tempest_custom into the local database"hongbo tian1-0/+10
2017-05-19hosts info config in containerMatthewLi2-2/+21
JIRA: DOVETAIL-435 in some SUT, there's a need to config hosts <domain name>:<ip> info in container /etc/hosts, ortherwise, SUT service will not be used. usage: 1,for dovetail directly running, cd ${DOVETAIL_HOME}/userconfig vim hosts.yaml sth like hosts_info: - domain_nameA:192.168.33.101 - domain_nameB:<some IP> 2,for dovetail container running, first get inside the container, cd /home/opnfv/dovetail/userconfig vim hosts.yaml same as 1. Change-Id: Ic5d87df3d78c0fa1d08c4e972c0fc97e61b906e9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-19update the IRC in INFO file for IRC channel errorhongbotian1-1/+1
JIRA: DOVETAIL-434 revise the error.change opnfv-testperf to opnfv-meeting Change-Id: I70820b202929bbfbdbff2ee104dcbc5601d53357 Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-05-16I would like to nominate Georg Kunz to become a committer in the DovetailWenjing Chu1-0/+6
project. Georg's nomination is motivated by his commitment to the project and his high quality work in helping the Dovetail sdnvpn test suite development, test doc patch review and meeting participations. I would like to nominate Zenghui to become a committer in the Dovetail project. Zenghui's nomination is motivated by his commitment to the project and his contributions in dovetail tool and multi-SUT testing. I would like to nominate Wanglei to become a committer in the Dovetail project. Wanglei's nomination is motivated by his commitment to the project and his consistent long time contribution to the Dovetail test framework development, test suite patch review and meeting participations. I would like to nominate Lincoln to become a committer in the Dovetail project. Lincoln's nomination is motivated by his commitment to the project and his expertise in multi-vendor testing, compliance testing and test doc patch review and meeting participations. I would like to nominate Trevor Cooper to become a committer in the Dovetail project. Trevor's nomination is motivated by his commitment to the project and his experiences in the testing working group, performance testing and consistent contributions in reviews and meeting participations. I would like to nominate Fuqiao to become a committer in the Dovetail project. Fuqiao's nomination is motivated by her commitment to the project and her contributions in developing the high availability test area, her experiences in bringing service provider requirements and perspective, and her contributions in reviews and meeting participations. Change-Id: Ia8a4ed3af7219c5376e0dd281ed11a51059c6fd4 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-05-15Fix AArch64 nested Docker installAlexandru Nemes1-6/+17
Due to recent changes in official Dovetail Dockerfile, which is running on Ubuntu 14.04, we need some changes in our patch file for aarch64 in order to keep it working on 16.04. JIRA: ARMBAND-258 Change-Id: Icff8c5a16d90ec4b67204a5b525a7896c796ca11 Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
2017-05-15Merge "bugfix of wrong testcase name"hongbo tian1-1/+1
2017-05-11Add test case tempest_custom into the local databasexudan1-0/+10
JIRA: DOVETAIL-429 Test case tempst_custom is not in the initial local database. Add this test case into local database. Change-Id: I53d3f6ebdde7ff680e33faf8296551d81f3c0496 Signed-off-by: xudan <xudan16@huawei.com>
2017-05-11bugfix of wrong testcase nameMatthewLi1-1/+1
JIRA: DOVETAIL-430 this is wrong before(ipv6.tc023 same to ipv6.tc019), fixed according to https://gerrit.opnfv.org/gerrit/#/c/34577/ Change-Id: I3d996a7c2adffc305b0f8fa6bcd87e4e6e4c5b7e Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-11Add three HA test cases into test suite proposed_testsxudan12-77/+31
JIRA: DOVETAIL-427 There are another three HA test cases which are stable now for adding into test suite proposed_tests for CI daily run. Change-Id: I86ed38d2e3a2bcfda29af50164aadd0da89e6aaa Signed-off-by: xudan <xudan16@huawei.com>
2017-05-11Merge "store/load offline docker images"hongbo tian3-0/+104
2017-05-09Support Yardstick to push results to databasexudan2-14/+10
JIRA: DOVETAIL-421 1. Yardstick is working on supporting push results to mongoDB. see https://gerrit.opnfv.org/gerrit/#/c/34091/ 2. make Dovetail supporting push results to database too when user choose to report to database. Change-Id: Iee06ad6be59dad62ac4f985f4a982fb5ff93a592 Signed-off-by: xudan <xudan16@huawei.com>
2017-05-09Merge "fix ha testcase PASS/FAIL judgement"hongbo tian1-1/+6
2017-05-09Merge "vpn testcases added in proposed_tests"hongbo tian13-4/+249
2017-05-08store/load offline docker imagesMatthewLi3-0/+104
JIRA: DOVETAIL-423 usage: 1.cd ${DOVETAIL_HOME}/dovetail/utils/offline 2.edit config.yaml as needed 3.on onsite host, <python download.py> --> save docker images to defined path 4.on offline host, <python load.py> ---> load docker images to offline env 5.this can be easily extended to other images beside docker images Change-Id: I97d843e154ecf8d66cafb9ea9594fe73343ee591 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-08fix ha testcase PASS/FAIL judgementMatthewLi1-1/+6
JIRA: DOVETAIL-425 Change-Id: Ifee2473956e0a1a3ad9c98beff92d94327251614 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-07vpn testcases added in proposed_testsMatthewLi13-4/+249
JIRA: DOVETAIL-212 after communicating with Tim/jose, help to add vpn testcase into proposed_tests reference: https://wiki.opnfv.org/display/sdnvpn/SDNVPN+Testing#SDNVPNTesting-TestcompliancetemplateforDovetail Change-Id: Id34a2cadba625abbdbc59ef11affeccba24fa10c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-07Proposing to move "post conditions" as an optional topic for a test case.ChristopherPrice1-12/+2
It is not clear that there are post conditions to be documented for all test cases. In the case a test cse creates an image and deletes it, there is littöe need for a post condition to be documented. If a test case establishes a network to be used for a subsequent test ina sequence this information should be clearly dcumented. Change-Id: Ifb4bb45f240921c180077ab7273988d973417f6f Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-05-05Merge "Get results json data from database"hongbo tian3-5/+11
2017-05-05Merge "Uploading the initial draft of the first VPN test case "hongbo tian2-5/+132
2017-05-04Merge "Drafting the first "refstack" version of the test scope document."hongbo tian1-0/+363
2017-05-04Get results json data from databasexudan3-5/+11
JIRA: DOVETAIL-417 1. If report results with files, all results will be stored in local files. 2. If report to database, will get results from database and stored with file results.json Change-Id: Ic30037bd66cd37042f82b75fac2043a876e21c6f Signed-off-by: xudan <xudan16@huawei.com>
2017-05-03Merge "local db support offline mode"hongbo tian6-38/+93
2017-05-03local db support offline modeLeo Wang6-38/+93
JIRA: DOVETAIL-415 The local db also need to support offline, move all the git clone/apt/yum/pip/wget/curl into the Dockerfile Change-Id: I2392dc9f4a6bd6f6a5a3f4849625a576c51a44f8 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2017-05-03Drafting the first "refstack" version of the test scope document.Georg Kunz1-0/+363
To be aligned with the committers and agreed as the "foundation" list of test scope for moving forward with DoveTail test selection. Requires a majority of committer approvals prior to merging. Change-Id: I5fb091d2190a183d24ba9e766d19aba9e6a7c094 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-05-03Merge "xipv6 testcase adjustment"hongbo tian15-26/+16
2017-05-02xipv6 testcase adjustmentMatthewLi15-26/+16
JIRA: DOVETAIL-418 1) ipv6 tc002-tc005 error fix, delete wrong testcases 2) ipv6 tc018-tc025 os-nosdn-nofeature scenario dependent, make it known to the users Change-Id: I8e63131b795403ee63566ae59bf46782524acd5a Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-02Uploading the initial draft of the first VPN test case ChristopherPrice2-5/+132
This should be considered in the danube CVP phase as an optional test area for OPNFV compliance Change-Id: I99494cf2246e1cf079b87414ef1bb34d9b26e6b3 Co-Authored-By: Tim Irnich <tim.irnich@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-05-01Tips on update docker to right version, > 1.8grkiss3-1/+30
JIRA: DOVETAIL-414 Dovetail requires docker at version > 1.8, so add some validation in code, and also versions of client and server should match with each other, or there will be unpredictable errors. Gives a notice to user to decide whether to update the docker to the latest version(1.17) Change-Id: I1331f5c19943a73e8fe25f76bd21628233e556f3 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-04-27support HA test cases to run with keyxudan5-11/+68
JIRA: DOVETAIL-409 1. HA test cases need a file pod.yaml, in this file it can use the password or the key. 2. If use key, Dovetail need to pass the key file $DOVETAIL_HOME/dovetail/userconfig/id_rsa to yardstick Container. 3. Add a directory $DOVETAIL_HOME/dovetail/userconfig and a sample_pod.yaml 4. ha.tc001 tc003 tc005 tc006 tc009 are ready. Change-Id: I391cc211dba2cf0740dd0dcaee8a5c2d712eaee1 Signed-off-by: xudan <xudan16@huawei.com>
2017-04-27Setting the document directory structure according to the Plugfest outcome.ChristopherPrice23-13/+344
Implemented a directory and file structure that supports the requirements defined in the plugfest etherpad: https://etherpad.opnfv.org/p/cvp_tooling_sketch Change-Id: Icb7d2db4b0132f2039c680883e173ff5d7fc0120 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-04-27Adding a stub document for a CVP reviewer guideGeorg Kunz1-0/+35
This document shall describe guidelines and evaluation criteria for reviewers on how to handle the review process of results. DOVETAIL-408 Change-Id: I78e669544bc172b74f94443176a48082a4c28a2f Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-04-26Merge "skip ha tc002 and tc012"Dave Neary1-3/+1
2017-04-26Committing the test case requirements specification to GIT for committer review.ChristopherPrice1-0/+92
This doucment needs to be +2'd by the majority of committers prior to merging to ensure we are all in agreement with regard to the test case requirements. This is a pre-requisite to test case selection for the CVP. Updated by dneary 2017-04-25: List formatting, and reorganising requirements for installer and stack composition. Change-Id: Iabaf11bc9479a20a58f985233d460013e4690d7c Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-04-26Merge "JIRA: DOVETAIL-352 Updating the test specification document with ↵Christopher Price4-48/+632
iterative inprovements."
2017-04-26skip ha tc002 and tc012MatthewLi1-3/+1
since these two testcases will kill the host and can't restart not ready yet, skip. Change-Id: Icbc7e4f080d32d1ecb59df9fd95cb244d74e4cde Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-26Merge "Bugfix: All HA testcases are SSH timeout in CI jobs"hongbo tian3-12/+20
2017-04-26JIRA: DOVETAIL-352 Updating the test specification document with iterative ↵ChristopherPrice4-48/+632
inprovements. JIRA tasks are being created for specific sections of the document. Refer to the doc for links to relevant JIRA tasks. Change-Id: I1717d56b8817c38802a227db320f30029f68fbd0 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>