summaryrefslogtreecommitdiffstats
path: root/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-05-29Adding docker tagmbeierl1-1/+6
Adds the tag to use when running docker from the DOCKER_TAG environment variable. Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25 JIRA: STORPERF-128 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-23Specify numpy versionmbeierl1-0/+1
Adds explicit version of numpy so it cannot conflict with any other that may be present in the system path. Change-Id: I23b21bca43f55805b3087646b1c31e1aea686aca JIRA: STORPERF-126 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-02Fix admin.rc generationmbeierl1-1/+1
Explicitly filters out anything that is not an environment variable. Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168 JIRA: STORPERF-124 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-29Use tagged version of graphitembeierl2-4/+3
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-07Changing run length to 30min to see if queue depth 2, block size 8192 ↵mbeierl1-1/+1
stablilizes then instead Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-24Fixing final reportmbeierl1-11/+22
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl1-1/+1
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-01Add URL for results reportmbeierl1-1/+5
Records the URL returned from testresults db. Changes the URL ref from localhost to external and reports in daily job. Change-Id: I0068ea963671fb183779ac20592ba6933647eea0 JIRA: STORPERF-104 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-30Make it easier to see what's happening in Jenkinsmbeierl2-5/+7
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Testresults DB Alignmentmbeierl2-17/+27
Changes the key names sent to the testresults db to align with other projects. Defines a clear PASS/FAIL based on the ability to find steady state for all runs. If one run failed to achieve steady state, run gets labelled as FAIL. Change-Id: I73143779453689eea93829079388ed8035134aa3 JIRA: STORPERF-100 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Dump env so I can see what variables are visible once the job is run under ↵mbeierl1-1/+7
Jenkins Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Fixed line to long errormbeierl2-2/+2
Fixes the version of requests to match what docker was already pulling in. Truncate log message to 512 characters. Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc JIRA: STORPERF-103 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Pin version of setuptoolsmbeierl1-1/+1
Forces explicit version of setuptools to be used because of an upstream change: https://github.com/pypa/setuptools/issues/937 Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15 JIRA: STORPERF-102 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Hardening FIO interactionmbeierl6-40/+95
Fixes a problem where FIO does not terminate by scheduling a second killall if we get a specific message back from FIO stderr. Introduces a new flavor for StorPerf that has a little more memory as larger memory maps for duplicate blocks sometimes caused out of memory killer to be invoked. Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a JIRA: STORPERF-99 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Fix multiple workload runsmbeierl1-23/+13
Change reporting so that multiple workloads in one job execution can be reported instead of overwriting the previous value. Change the daily job to use a single, multiple workload run. Change-Id: I8e350350ae13d2272b584af7a60ad269de160587 JIRA: STORPERF-98 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Change to Ubuntu 16.04mbeierl1-8/+8
Change the base image used for the agent VM to Ubuntu 16.04 as the 14.04 image has kernel panic when the Cinder Volume is detached Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11 JIRA: STORPERF-97 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Actually check out releng locallymbeierl1-0/+4
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixing up paths and checking out releng locallymbeierl2-2/+2
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixed typombeierl1-1/+0
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18StorPerf Daily Jobmbeierl6-37/+97
Helper script that determines what installer was used. Script to generate RC file for container. Script to determine number of Cinder nodes. Daily job to pull new container, create stack based on number of Cinder nodes, issue a warm up, and then run a series of performance tests against the stack. Deletes stack once complete. JIRA: STORPERF-87 Signed-off-by: mbeierl <mark.beierl@dell.com> Change-Id: I551f21ffc85f11b0c0724205e952551022a94f5b
2016-12-16Use v3 Authmbeierl1-1/+2
Change to detect environment variable and use v3 authentication instead if present. Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a JIRA: STORPERF-88 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-02Change to ParamikoMark Beierl1-0/+2
Use Paramiko ssh client instead of invoking ssh and scp from the command line Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7 JIRA: STORPERF-91 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-25Daily JobMark Beierl6-14/+261
Creation of a daily job script that runs under Jenkins and kicks off a series of tests using the freshly cloned workspace. Change-Id: Ibc63c1df954578ad78604321ea410c8fd8c63c41 JIRA: STORPERF-87 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-11Additional CoverageMark Beierl1-0/+1
Adds HTML output to coverage so we can see it in Jenkins Change-Id: I89595921bf86b8963890051a25e45f7bd08b0636 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-07-14Separation of test and sourceMark Beierl1-1/+1
Moving the test files into their own top-level directory to keep things clean Change-Id: Ic50b881045bc59b003807923424345b335dd5c95 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-07-14Enforce Style GuidelinesMark Beierl2-3/+11
Update to fail verify if pep8 compliance not met. Revert back to Coverage 4.1 to show code coverage report in Jenkins again Change-Id: Icb467451f101942255c7944ad796497609dcb07e Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-06-16Force a compatible version of CoverageMark Beierl1-1/+1
LiClipse / PyDev only works with 3.4 Change-Id: I351df5f8120889af07b10ebb7a740d1e318cb1c2 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-09Add plotsMark Beierl1-0/+1
Adds matplotlib Adds support for generating graphs showing performance results Change-Id: Iba344baab89e35c0d5891a9d6b4c22c37666511e JIRA: STORPERF-44 JIRA: STORPERF-50 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-06 Add Stats report and Swagger UIMark Beierl1-0/+1
Add Swagger web ui at /swagger Add ability to fetch read/write latency status via ReST ui Can now delete where stack was removed from OpenStack but not from the storperf DB Change to use Floating IPs instead of private IP Fix delete bug where there was no dependency on resources in the resource group. JIRA: STORPERF-19 JIRA: STORPERF-20 Change-Id: I1d9627d81f3c309b178a9b68cc306a4101c1a231 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-05 Add Stats report and Swagger UIMark Beierl1-3/+4
Add Swagger web ui at /swagger Add ability to fetch read/write latency status via ReST ui Can now delete where stack was removed from OpenStack but not from the storperf DB Change to use Floating IPs instead of private IP Fix delete bug where there was no dependency on resources in the resource group. JIRA: STORPERF-19 JIRA: STORPERF-20 Change-Id: I0a4b3386789c38d6745906ba896b8ff851dc122f Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-04-25Job run lifecycle reworkMark Beierl1-0/+3
Change the way slave jobs are managed so that they are in step with each other, and we can track the overall thread that is running them. This lays groundwork for STORPERF-20 and STORPERF-44 JIRA: STORPERF-33 STORPERF-43 Change-Id: Iaff48a2823ba85d6512e9782fd9091a72639835c Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-04-15Tests in verifyMark Beierl3-38/+53
Run the tests in the verify command instead of just merge so that way patches can be rejected if tests fail Change-Id: I8907618a324296460a71a51d087926f9089e0d21 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-02-03Developer build process fixMark Beierl1-1/+1
Fix the installation os setuptools so that it does not conflict with mock. Change-Id: I7c497d36c80a795fc99b329da2d171a265e4eacc JIRA: STORPERF-35 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-01-29Remote slave agent workloadMark Beierl4-119/+10
Add storperf master object to manage stack lifecycle. Add configuration db. Creation of CLI vs. main so that ReST API and CLI API can be kept clear. Fixed License in files. Changed DB objects to be thread safe. Added ssh server to container if desired for CLI. Change-Id: Idfe84bfb7920e6ce19d27462593c21ea86e7b406 JIRA: STORPERF-29 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-01-07Switching merge job to virtualenvMark Beierl2-0/+48
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2015-11-23Adding workload modulesmbeierl2-2/+14
Adding the ablity to define workloads in modules which can be referenced from the API. Breaking out the test execution into its own class so it will be easier to support ReST or other interfaces. Added flake8 and code coverage reports where possible to merge and verify jobs Change-Id: Ieb51e4e7e1e989288a6f81f4757709669914a196 JIRA: STORPERF-21 Signed-off-by: mbeierl <mark.beierl@emc.com>
2015-11-05Adding Heat template for staging StorPerf master nodembeierl4-2/+171
Change-Id: I1e55290013f31272952f23869a02d68ca08cd4a7 JIRA: STORPERF-12 Signed-off-by: mbeierl <mark.beierl@emc.com>
2015-10-16Integration with RelengMark Beierl3-0/+6
Added verify, merge and daily jobs that will be called automatically by Gerrit/LF Jenkins on workflow change Change-Id: I3ae85593b6aeac4a1a7abb51354b9cc6fa1fd813 JIRA: RELENG-41 Signed-off-by: Mark Beierl <mark@jemms.net>
2015-10-15Added Jenkins scriptsmbeierl2-0/+2
JIRA: STORPERF-12 JIRA: STORPERF-1 Change-Id: I222381a690c89324058c8b6510b33a94c0ce0052 Signed-off-by: mbeierl <mark.beierl@emc.com>