summaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-04-11[BGPVPN] Remove odl-vpnservice test casesNikolas Hermanns1-5/+0
The odl-vpnservice test cases are meant to be tested in the mini-net setup. We would need to change our enviroment under test to include mini-net to be able to run this tests. Since this is not wanted we remove the test cases. Change-Id: Ic916e1e89d54fea78371bc566d8428141949e412
2016-04-05Allow vping to use existing glance imageCiprian Barbu3-12/+17
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: I3bc16eab592b9ad629693c402466755b6fa6db8a Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-01bugfix single quoteboucherv1-3/+2
Change-Id: I3391b9a3d0dd84402b7d2b588b9611a8035966d7
2016-04-01Bugfix result criteriaboucherv1-2/+2
Change-Id: I5f5f7b88f1b42d2cecd0444339ee117da61ac2a1 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-03-22Add status when pushing Tempest resultsMorgan Richomme1-34/+49
Change-Id: Ie4ad96d9c580370ae9f451ea440a71cf7a6fb841 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-22ONOS can now support vPing_userdata testcase, remove the exception in the ↵Morgan Richomme1-1/+0
config for CI Change-Id: I80828e431ad879bff0d44d476d6a076520ee8132 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-22Try configdrive in vping userdata test casecarey.xu1-0/+2
JIRA: FUNCTEST-158 Change-Id: Ic4205a4a7d125bc2b160403daf5e577d6d29c34f Signed-off-by: carey.xu <carey.xuhan@huawei.com>
2016-03-21improve status criteriaboucherv1-4/+5
Change-Id: Icfab7ead860d96cef119cc63e9fccfd9d62c009d Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-03-18Fix support for CACERT and set OS_INSECURE=truejose.lausuch1-5/+8
JIRA: FUNCTEST-145 Change-Id: If8fce037117d7c7d16d08a558d0675cbfe5f9836 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-18Add criteria and version when pushing the results into test DBMorgan Richomme9-165/+258
JIRA: FUNCTEST-151 Change-Id: Iac36f28db5f2203d7b2977a2bb973534fe167bac Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-15Add exception handling for output processingJuha Kosonen1-2/+9
Handle the exception if parsed result in report cannot be converted to a numeric value. JIRA: FUNCTEST-149 Change-Id: Ibb259abdaa800761ee8dd2270c6bc2529081242d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-03-12Test numbers creation before starting the signal testboucherv1-8/+43
Change-Id: Ife6a21e0dc3b12d1efd7aeb398b1ca0b85458a42 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-03-11A non default argument cannot be placed before a default one.jose.lausuch1-1/+1
This is blocking the execution of functest from jenkins Change-Id: I880b455016ae716db234fd118c8456829fec9861 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-10Have vIMS and Promise packages pre installed in the docker image.jose.lausuch1-39/+0
Also, change to master in Functest repo. JIRA: FUNCTEST-148 Change-Id: Ie4f3991adde9296fe86d4bedd4a9ca5e8aea33b3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-04Merge "Add support for SSL endpoints in Functest"Morgan Richomme1-0/+6
2016-03-04Add support for SSL endpoints in Functestjose.lausuch1-0/+6
JIRA: FUNCTEST-145 Change-Id: I051f1b71fda251e57d70f147433b9f038d30e7f9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-04Rally and Tempest pre-installed in the Docker image.jose.lausuch3-12/+6
Also, upgrade Rally to version 0.3.1 JIRA: FUNCTEST-147 Change-Id: I6aa15a7c282462058b7786c7dc7174d48c905d3a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-24Add jenkins build tag for result apiboucherv9-21/+42
Ex: jenkins-functest-compass-intel-pod8-daily-master-19 this will bring together all tests passed on the same functest run JIRA: FUNCTEST-140 Change-Id: I3c1cd8137184509ee5fdeeb2df5399d4c71e3f67 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-02-23remove "print" in tempest to avoid having a message "None" in the outputjose.lausuch1-1/+1
Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-22Add git support for Doctor repo in config_functest.yamljose.lausuch1-0/+2
Change-Id: I10ad0dc6cd6697a2a93f5e11edcdd69f70f86c5f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-19Fix message outputs taken from the console log in vPing_sshjose.lausuch1-4/+18
Change-Id: Id169167d90d60b8266913a8451699969abb4ef7c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-18Remove network failed message check form vping_sshjose.lausuch1-2/+1
Change-Id: I72d97af3ddd76f698ce54918cf92f98c8f5a7fd4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-17Release floating ip after vPing_ssh testjose.lausuch2-37/+37
Also, check the console to see if the instance fails when sending the discover to the dhcp agent Change-Id: I314051886b9580a42bb88f2d88a9bdbf2a9e198a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-16Create vPing_userdata instances with dynamic ports created by nova/neutronjose.lausuch3-110/+115
Change-Id: I1808763f6ccf1ac90b8a696c48ecdfba03d782fb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-16Create vPing instances with dynamic ports created by nova/neutronjose.lausuch2-147/+146
Also, - check if the used network is already created to not create it again - check if the image already exists to not create it again - check if the sec group already exists to not create it again Change-Id: I243619a1538444d836fdda84a86b834668aaf456 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-12Rally live migration case selectionJuha Kosonen3-44/+61
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-11bug fiw syntax when calling push to db from vIMSMorgan Richomme1-1/+2
Change-Id: I79ce10993c5a21fcb840681efd364ad2dc366e50 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-11Add project in push_to_db function of functests utils to allow external ↵Morgan Richomme7-53/+50
project onboarded in Functest to push their results Change-Id: I3a065e6ce82b1a87bbd07810f13df7d146655933 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-11Merge "Push results without extra formating"Morgan Richomme1-5/+7
2016-02-11Push results without extra formatingMorgan Richomme1-5/+7
Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-11Enadled --serial option for run_tests.shViktor Tikkanen1-2/+11
It could be useful to execute e.g. Tempest test cases in a single thread in order to troubleshoot possible concurrency problems. Change-Id: I5e5fc190fb4483ff075a8f837a8d4116ece90c80 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch6-0/+36
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Rename the vPing scripts proplery and adapt documentationjose.lausuch4-6/+9
Change-Id: Idb498eb7cefd938006661f42f1bf1772395d9d47 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Push rally summary results into DBMorgan Richomme2-49/+53
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-09Merge "Remove obsolete public network definitions"Morgan Richomme2-11/+10
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-09Remove obsolete public network definitionsJuha Kosonen2-11/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-09doctor: adds loggerRyota MIBU1-7/+23
Change-Id: Idc9c0f17049b9e6d2d7a0b8dc2bf35778d3c29dd Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-02-08Used sed instead of crudini for updating regexViktor Tikkanen2-3/+2
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-08Merge "enable doctor test scenario"Morgan Richomme1-2/+2
2016-02-08Merge "Added configuration of ssh_user_regex parameter"Morgan Richomme2-0/+7
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen2-0/+7
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-08enable doctor test scenarioRyota MIBU1-2/+2
Change-Id: If0e050e979d886fff436daa384a97a651a56aaa5 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen11-95/+98
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-04Import request python module for promise test casejose.lausuch1-0/+1
Change-Id: I437766fe1c595a60a82af3c49a5eb29974e0da33 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-04Merge "Fix success status parsing of rally results"Morgan Richomme1-8/+6
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-03Use python json parser to get the results form the Promise json reportjose.lausuch1-30/+33
JIRA: FUNCTEST-68 Also, add sleep to let the promise instances terminate, otherwise, clean_openstack will detect them while they are still being removed and will fail. Change-Id: I7a5543143758483eb1d7e06dbe4922e9f1e05cfb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-03Revert "bug fix: get installer using functest_utils"Morgan Richomme1-1/+1
This reverts commit a6a3af39986e61f5f7c9094befec41fd753610d5. Change-Id: I33d5d77ce166a324582a8f5ca11d75c5d9628c14