summaryrefslogtreecommitdiffstats
path: root/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-10-11Adding FUEL Supportmbeierl5-17/+40
Changes to Ubuntu 17.04 to overcome issue in 4.4 kernel on ARM for hotplug of cinder volumes. Adds support for FUEL MCP certificate for SSL communication with OpenStack. Hard codes the target device to /dev/vdc for FUEL as /dev/vdb is reserved for the OpenStack config drive. Change-Id: I17dae23f455448f632e0921dbdae45824bbeaa61 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-04Fixing test results.mbeierl1-0/+2
Change-Id: I13ea847491f2758fd2003c0b206ec7a1356f3fb2 JIRA: STORPERF-216 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-28Fix Test Resultsmbeierl1-0/+2
Updates the key/values that are sent to testresults db. Fixes the PASS/FAIL to ignore _warm_up job. Change-Id: I8af292cd764637cd12cbdb5a2a3e114fbeda5665 Signed-off-by: mbeierl <mark.beierl@dell.com> JIRA: STORPERF-216
2017-09-25Fixing Results DB Keysmbeierl1-2/+2
Update keys pushed to testresults DB so they match the expected values. JIRA: STORPERF-216 Change-Id: I837254fbfb2837d6abfc22d6d33878f60227480c Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-18Fixing Typo and Adding Logsmbeierl1-1/+8
Change-Id: Ib4271c4400ded3c27517ffca45343c4ae4613662 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-14Add Multi Arch to Dockermbeierl5-86/+122
Adds multi arch support to the launching of the containers. Change-Id: Iee89cfad3dc455fe8fdd7861d73fadbe314c2c1e JIRA: STORPERF-220 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-12Merge "Fixing daily"Mark Beierl1-2/+3
2017-09-12Fixing dailymbeierl1-2/+3
Changes daily to not exit on diff, and continue cleanup Change-Id: Ifed60a1a44d9aead5cb3cb9f65c24a8acaec502a Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-08Changing Daily to Docker Pullmbeierl2-8/+14
Changes the daily job to pull images from Docker.io instead of using docker-compose build to build the image from local sources. Reduces the default run time to ~30 minutes unless overridden in the job definition. Change-Id: Ib153b66454363f91813dc9c946f6b46156c502bd JIRA: STORPERF-204 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-01Re-instating docker build verifymbeierl2-6/+8
Change-Id: I720ba0c8e413d5c61e8d6f9a13eae0441df53ccb Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-08-28Fixup Dailymbeierl2-1/+15
Allows daily to terminate on error Change-Id: I31efdf3adcf6f2c09e02c21c4d10a5894d0ad6b7 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-08-25Reinstating Mergembeierl2-2/+5
Change-Id: I94cf1d4c67bef421a25aef4f0da05514ebb83b96 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-08-24Expaning the Verify Scopembeierl2-2/+81
Adds a new verify job that does docker-compose build and up, and checks for HTTP responses from each of the endpoints. Change-Id: Idcb74c8b8337a74a2b624f93ea6b34707d7e5516 JIRA: STORPERF-199 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-08-17Support for Docker images on ARM processors.Taseer Ahmed1-0/+7
- Usage: docker build --build-arg ARCH=<arch_type> . Change-Id: I9018c627cef05e69492dbdefbe750d72cf98064d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-07-13Force full build and cleanupmbeierl2-0/+2
Change-Id: I0def9ef07f9530eb468e47992b660ec98757726f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-07-12Creation of Local Docker for Daily Jobmbeierl2-12/+7
Moves the dockerfiles for the different submodules/containers into their respective directories. Adds a docker compose file that can build the containers from the local filesystem, and mounts the local filesystem as a volume, making it easier for developer testing as local changes are automatically reflected in the final container. Change-Id: I2376034258cab2a3dc3a0d1ac3f01bbf5d1f59e7 JIRA: STORPERF-189 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-07-11Change all pathsmbeierl2-54/+27
Changes the paths of all source code so that it exists under the dockerfile location for each container. This way we can use COPY instead of git clone, as well as use the existing JJB. Change-Id: I883b2957d89659c164fff0a1ebc4d677c534796d JIRA: STORPERF-188 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-07-04Multi-threaded HTTP Supportmbeierl1-1/+2
Adds multithreaded HTTP request abilities to ReST Server. Fixes docker-compose to ensure pull prior to up. Fixes metrics typo to make jobs API query work again. Change-Id: Ibac6188379cae0489792c5ea80f37dd3abf37082 JIRA: STORPERF-183 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-30Docker Compose Updatesmbeierl5-34/+52
Adds docker-compose directory with content to start container suite using nginx as front and and SwaggerUI in its own container. Updates the documentation to reflect new method of starting StorPerf. Change-Id: I469676e330dcad6c968b90133df8866b69eb5ea1 JIRA: STORPERF-181 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-26Allow User to Specify Flavormbeierl1-1/+1
Adds flavor as parameter to ReST /configurations API and passes it through to the heat template creation. Change-Id: Id3632fb571da9da51b4d75db58c7a7c0a91e0ccf JIRA: STORPERF-92 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-10Removal of matplotlibmbeierl2-2/+1
Removes the matplotlib modules from the main container. Change-Id: I26a0c171b2172dbf2be66cdf10b897bb72e4bf2b JIRA: STORPERF-161 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-07Allow User-Specified Sample Sizembeierl1-14/+11
Adds the ability to accept steady_state_sample_size as a parameter. Removes deprecated nowarm and nossd. Adds OS_PROJECT_DOMAIN_ID. Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf JIRA: STORPERF-139 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-05Merge "Adding CORS Adds flask-cors module so that SwaggerUI can examine ↵Mark Beierl1-0/+1
content from a different container JIRA: STORPERF-129"
2017-06-05Adding CORSShrenik2-1/+7
Adds flask-cors module so that SwaggerUI can examine content from a different container JIRA: STORPERF-129 Change-Id: I9c47a2ea464da83910c368d771dce13f5364ca23 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-06-01Fixing typombeierl1-1/+1
Change-Id: I40a2367de22afe4db46c7da7d774f0e646cb8a23 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-31Daily Job Parameter Supportmbeierl2-45/+22
Adds environment variables so that the daily jobs can be parameterized from Jenkins. Change-Id: I77518b90595460ca932f1e71f57b2b02ab3dd1f5 JIRA: STORPERF-138 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-29Adding docker tagmbeierl1-1/+6
Adds the tag to use when running docker from the DOCKER_TAG environment variable. Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25 JIRA: STORPERF-128 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-23Specify numpy versionmbeierl1-0/+1
Adds explicit version of numpy so it cannot conflict with any other that may be present in the system path. Change-Id: I23b21bca43f55805b3087646b1c31e1aea686aca JIRA: STORPERF-126 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-02Fix admin.rc generationmbeierl1-1/+1
Explicitly filters out anything that is not an environment variable. Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168 JIRA: STORPERF-124 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-29Use tagged version of graphitembeierl2-4/+3
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-07Changing run length to 30min to see if queue depth 2, block size 8192 ↵mbeierl1-1/+1
stablilizes then instead Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-24Fixing final reportmbeierl1-11/+22
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl1-1/+1
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-01Add URL for results reportmbeierl1-1/+5
Records the URL returned from testresults db. Changes the URL ref from localhost to external and reports in daily job. Change-Id: I0068ea963671fb183779ac20592ba6933647eea0 JIRA: STORPERF-104 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-30Make it easier to see what's happening in Jenkinsmbeierl2-5/+7
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Testresults DB Alignmentmbeierl2-17/+27
Changes the key names sent to the testresults db to align with other projects. Defines a clear PASS/FAIL based on the ability to find steady state for all runs. If one run failed to achieve steady state, run gets labelled as FAIL. Change-Id: I73143779453689eea93829079388ed8035134aa3 JIRA: STORPERF-100 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Dump env so I can see what variables are visible once the job is run under ↵mbeierl1-1/+7
Jenkins Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Fixed line to long errormbeierl2-2/+2
Fixes the version of requests to match what docker was already pulling in. Truncate log message to 512 characters. Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc JIRA: STORPERF-103 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Pin version of setuptoolsmbeierl1-1/+1
Forces explicit version of setuptools to be used because of an upstream change: https://github.com/pypa/setuptools/issues/937 Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15 JIRA: STORPERF-102 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Hardening FIO interactionmbeierl6-40/+95
Fixes a problem where FIO does not terminate by scheduling a second killall if we get a specific message back from FIO stderr. Introduces a new flavor for StorPerf that has a little more memory as larger memory maps for duplicate blocks sometimes caused out of memory killer to be invoked. Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a JIRA: STORPERF-99 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Fix multiple workload runsmbeierl1-23/+13
Change reporting so that multiple workloads in one job execution can be reported instead of overwriting the previous value. Change the daily job to use a single, multiple workload run. Change-Id: I8e350350ae13d2272b584af7a60ad269de160587 JIRA: STORPERF-98 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Change to Ubuntu 16.04mbeierl1-8/+8
Change the base image used for the agent VM to Ubuntu 16.04 as the 14.04 image has kernel panic when the Cinder Volume is detached Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11 JIRA: STORPERF-97 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Actually check out releng locallymbeierl1-0/+4
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixing up paths and checking out releng locallymbeierl2-2/+2
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixed typombeierl1-1/+0
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18StorPerf Daily Jobmbeierl6-37/+97
Helper script that determines what installer was used. Script to generate RC file for container. Script to determine number of Cinder nodes. Daily job to pull new container, create stack based on number of Cinder nodes, issue a warm up, and then run a series of performance tests against the stack. Deletes stack once complete. JIRA: STORPERF-87 Signed-off-by: mbeierl <mark.beierl@dell.com> Change-Id: I551f21ffc85f11b0c0724205e952551022a94f5b
2016-12-16Use v3 Authmbeierl1-1/+2
Change to detect environment variable and use v3 authentication instead if present. Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a JIRA: STORPERF-88 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-02Change to ParamikoMark Beierl1-0/+2
Use Paramiko ssh client instead of invoking ssh and scp from the command line Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7 JIRA: STORPERF-91 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-25Daily JobMark Beierl6-14/+261
Creation of a daily job script that runs under Jenkins and kicks off a series of tests using the freshly cloned workspace. Change-Id: Ibc63c1df954578ad78604321ea410c8fd8c63c41 JIRA: STORPERF-87 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-11Additional CoverageMark Beierl1-0/+1
Adds HTML output to coverage so we can see it in Jenkins Change-Id: I89595921bf86b8963890051a25e45f7bd08b0636 Signed-off-by: Mark Beierl <mark.beierl@dell.com>