summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-06-30Docker Compose Updatesmbeierl11-181/+350
Adds docker-compose directory with content to start container suite using nginx as front and and SwaggerUI in its own container. Updates the documentation to reflect new method of starting StorPerf. Change-Id: I469676e330dcad6c968b90133df8866b69eb5ea1 JIRA: STORPERF-181 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-26Allow User to Specify Flavormbeierl6-26/+52
Adds flavor as parameter to ReST /configurations API and passes it through to the heat template creation. Change-Id: Id3632fb571da9da51b4d75db58c7a7c0a91e0ccf JIRA: STORPERF-92 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-21Remove Swagger from StorperfShrenik2-12/+3
Remove Swagger module from Storperf Change-Id: Id491bb7ea1ddd55549d39ddbe4c7a7004d797a59 JIRA: STORPERF-129 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-06-20Creation of Reporting Modulembeierl1-0/+26
Adds a new subdirector where all graphing and reporting content, including the dockerfile, will be stored. Change-Id: I8e9a0d975fe944faf81e97ae3792379a1375166a JIRA: STORPERF-162 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-10Removal of matplotlibmbeierl7-183/+2
Removes the matplotlib modules from the main container. Change-Id: I26a0c171b2172dbf2be66cdf10b897bb72e4bf2b JIRA: STORPERF-161 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-07Allow Filename Targetmbeierl1-1/+1
Changes the default filesize to 1g so that profiling a file works again Change-Id: I060b7af75be08f4ffb411f1c612babb846172dd5 JIRA: STORPERF-153 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-07Allow User-Specified Sample Sizembeierl6-42/+46
Adds the ability to accept steady_state_sample_size as a parameter. Removes deprecated nowarm and nossd. Adds OS_PROJECT_DOMAIN_ID. Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf JIRA: STORPERF-139 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-05Merge "Adding CORS Adds flask-cors module so that SwaggerUI can examine ↵Mark Beierl3-0/+4
content from a different container JIRA: STORPERF-129"
2017-06-05Adding CORSShrenik4-1/+10
Adds flask-cors module so that SwaggerUI can examine content from a different container JIRA: STORPERF-129 Change-Id: I9c47a2ea464da83910c368d771dce13f5364ca23 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-06-01Fixing typombeierl1-1/+1
Change-Id: I40a2367de22afe4db46c7da7d774f0e646cb8a23 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-31Daily Job Parameter Supportmbeierl2-45/+22
Adds environment variables so that the daily jobs can be parameterized from Jenkins. Change-Id: I77518b90595460ca932f1e71f57b2b02ab3dd1f5 JIRA: STORPERF-138 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-29Merge "Adding docker tag"Mark Beierl1-1/+6
2017-05-29Adding docker tagmbeierl1-1/+6
Adds the tag to use when running docker from the DOCKER_TAG environment variable. Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25 JIRA: STORPERF-128 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-26Merge "Removal of Edgar StPierre from Committer List"Mark Beierl1-1/+1
2017-05-24Adding domain to authenticationmbeierl1-7/+11
Adds domain if present in environment variables to user and project Change-Id: I05fca2fbdeef4fa985bfb505f9158ce31da5ab9c JIRA: STORPERF-127 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-24numpy error in containermbeierl1-1/+0
Removes numpy from container as it causes runtime problems. Change-Id: Iaae384c9229e0af5057822d62fca146732d62a53 JIRA: STORPERF-126 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-23Specify numpy versionmbeierl2-0/+2
Adds explicit version of numpy so it cannot conflict with any other that may be present in the system path. Change-Id: I23b21bca43f55805b3087646b1c31e1aea686aca JIRA: STORPERF-126 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-04Adding Release Notesmbeierl2-0/+124
Change-Id: I904e995fa8fb8088053a556ddaf0d243a378098f JIRA: STORPERF-111 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-02Fix admin.rc generationmbeierl1-1/+1
Explicitly filters out anything that is not an environment variable. Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168 JIRA: STORPERF-124 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-04-26Removal of Edgar StPierre from Committer ListTrevor Bramwell1-1/+1
Change-Id: Ia79fd87e5ef15d2226457efb2bb1a21845a1fdd5 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-04-26Pinning version of Swagger UImbeierl1-0/+1
Changes the inclusion of Swagger UI to become a git checkout of a fixed version rather than following the head. Change-Id: I30def6d6c37a166cc37f15857a98064c760eb7c6 JIRA: STORPERF-123 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-31Merge "Fixed paths to match standard"Mark Beierl6-19/+5
2017-03-31Fixed paths to match standardmbeierl6-19/+5
Change-Id: I733d34eb8bbdf0201b06a21d0ceeda50a06dd49f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-30Fixed typombeierl1-1/+0
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 6eb2c8d8a8971ee3ae0693feebe509d4ec30a7a8)
2017-03-30Fixed typombeierl1-1/+0
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-30Use tagged version of graphitembeierl11-39/+272
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 1bcbe0bac328e26341ba68341d4b809c32b8242f)
2017-03-29Use tagged version of graphitembeierl11-39/+272
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-08Adding LabelsShubhamRathi2-0/+4
Labels serve as anchors/ refs when referenced from other documents This patch adds labels to docs/*/*/index.rst Change-Id: I464d17d0b1e3b53daa30a5ecb1725f56aaabf39b Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-03-07Changing run length to 30min to see if queue depth 2, block size 8192 ↵mbeierl1-1/+1
stablilizes then instead Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-06Remove deprecated fieldsmbeierl4-32/+0
Removes the nowarm and nossd fields as it is better to be explicit about running the '_warm_up' workload. Change-Id: I54b67006abdc071f6fd190d6a5eefe026609c150 JIRA: STORPERF-108 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-24Fixing final reportmbeierl4-15/+30
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-23Documentation Updatembeierl7-56/+365
Adds documentation for Danube. Change-Id: I2755cb00b769cd0668e5c956d0b70c33d328d882 JIRA: STORPERF-81 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl8-127/+40
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-16Prevent notifications after terminationmbeierl7-20/+128
Changes the event notification logic inside the FIO invoker so that it no longer publishes events after termination. Prevents false reports after steady state has been detected. Change-Id: I694f77b6493b88820fe4f4cc7f634e3e62c45a9a JIRA: STORPERF-105 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-15Normalize data seriesmbeierl2-13/+43
Changes the data series from using seconds to samples so that slope is not artificially flattened. Change-Id: Idf87926a47c2ba67e66e2254d3572adad7a81b44 JIRA: STORPERF-106 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-01Add URL for results reportmbeierl6-22/+42
Records the URL returned from testresults db. Changes the URL ref from localhost to external and reports in daily job. Change-Id: I0068ea963671fb183779ac20592ba6933647eea0 JIRA: STORPERF-104 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-31Fixing double JSON encoding of results payloadmbeierl2-5/+5
Change-Id: I5e5a8180d5851630b1200ade84f6beb5dfa18466 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-30Make it easier to see what's happening in Jenkinsmbeierl4-11/+32
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Testresults DB Alignmentmbeierl5-51/+110
Changes the key names sent to the testresults db to align with other projects. Defines a clear PASS/FAIL based on the ability to find steady state for all runs. If one run failed to achieve steady state, run gets labelled as FAIL. Change-Id: I73143779453689eea93829079388ed8035134aa3 JIRA: STORPERF-100 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Dump env so I can see what variables are visible once the job is run under ↵mbeierl1-1/+7
Jenkins Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Fixed line to long errormbeierl4-3/+4
Fixes the version of requests to match what docker was already pulling in. Truncate log message to 512 characters. Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc JIRA: STORPERF-103 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Pin version of setuptoolsmbeierl2-1/+2
Forces explicit version of setuptools to be used because of an upstream change: https://github.com/pypa/setuptools/issues/937 Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15 JIRA: STORPERF-102 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Hardening FIO interactionmbeierl11-72/+136
Fixes a problem where FIO does not terminate by scheduling a second killall if we get a specific message back from FIO stderr. Introduces a new flavor for StorPerf that has a little more memory as larger memory maps for duplicate blocks sometimes caused out of memory killer to be invoked. Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a JIRA: STORPERF-99 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Fix multiple workload runsmbeierl5-59/+73
Change reporting so that multiple workloads in one job execution can be reported instead of overwriting the previous value. Change the daily job to use a single, multiple workload run. Change-Id: I8e350350ae13d2272b584af7a60ad269de160587 JIRA: STORPERF-98 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Correct duplicate event notificationmbeierl1-0/+5
Clears the listener list on start and remove listener after run is completed. Change-Id: I76e1f13379d60bdb72fcf2faf57d9762a62f17d3 JIRA: STORPERF-96 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Change to Ubuntu 16.04mbeierl2-9/+9
Change the base image used for the agent VM to Ubuntu 16.04 as the 14.04 image has kernel panic when the Cinder Volume is detached Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11 JIRA: STORPERF-97 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Actually check out releng locallymbeierl1-0/+4
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixing up paths and checking out releng locallymbeierl2-2/+2
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixed typombeierl1-1/+0
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18StorPerf Daily Jobmbeierl6-37/+97
Helper script that determines what installer was used. Script to generate RC file for container. Script to determine number of Cinder nodes. Daily job to pull new container, create stack based on number of Cinder nodes, issue a warm up, and then run a series of performance tests against the stack. Deletes stack once complete. JIRA: STORPERF-87 Signed-off-by: mbeierl <mark.beierl@dell.com> Change-Id: I551f21ffc85f11b0c0724205e952551022a94f5b