summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-07-04Multi-threaded HTTP Supportmbeierl3-4/+10
Adds multithreaded HTTP request abilities to ReST Server. Fixes docker-compose to ensure pull prior to up. Fixes metrics typo to make jobs API query work again. Change-Id: Ibac6188379cae0489792c5ea80f37dd3abf37082 JIRA: STORPERF-183 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-30Docker Compose Updatesmbeierl11-181/+350
Adds docker-compose directory with content to start container suite using nginx as front and and SwaggerUI in its own container. Updates the documentation to reflect new method of starting StorPerf. Change-Id: I469676e330dcad6c968b90133df8866b69eb5ea1 JIRA: STORPERF-181 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-26Allow User to Specify Flavormbeierl6-26/+52
Adds flavor as parameter to ReST /configurations API and passes it through to the heat template creation. Change-Id: Id3632fb571da9da51b4d75db58c7a7c0a91e0ccf JIRA: STORPERF-92 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-21Remove Swagger from StorperfShrenik2-12/+3
Remove Swagger module from Storperf Change-Id: Id491bb7ea1ddd55549d39ddbe4c7a7004d797a59 JIRA: STORPERF-129 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-06-20Creation of Reporting Modulembeierl1-0/+26
Adds a new subdirector where all graphing and reporting content, including the dockerfile, will be stored. Change-Id: I8e9a0d975fe944faf81e97ae3792379a1375166a JIRA: STORPERF-162 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-10Removal of matplotlibmbeierl7-183/+2
Removes the matplotlib modules from the main container. Change-Id: I26a0c171b2172dbf2be66cdf10b897bb72e4bf2b JIRA: STORPERF-161 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-07Allow Filename Targetmbeierl1-1/+1
Changes the default filesize to 1g so that profiling a file works again Change-Id: I060b7af75be08f4ffb411f1c612babb846172dd5 JIRA: STORPERF-153 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-07Allow User-Specified Sample Sizembeierl6-42/+46
Adds the ability to accept steady_state_sample_size as a parameter. Removes deprecated nowarm and nossd. Adds OS_PROJECT_DOMAIN_ID. Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf JIRA: STORPERF-139 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-06-05Merge "Adding CORS Adds flask-cors module so that SwaggerUI can examine ↵Mark Beierl3-0/+4
content from a different container JIRA: STORPERF-129"
2017-06-05Adding CORSShrenik4-1/+10
Adds flask-cors module so that SwaggerUI can examine content from a different container JIRA: STORPERF-129 Change-Id: I9c47a2ea464da83910c368d771dce13f5364ca23 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-06-01Fixing typombeierl1-1/+1
Change-Id: I40a2367de22afe4db46c7da7d774f0e646cb8a23 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-31Daily Job Parameter Supportmbeierl2-45/+22
Adds environment variables so that the daily jobs can be parameterized from Jenkins. Change-Id: I77518b90595460ca932f1e71f57b2b02ab3dd1f5 JIRA: STORPERF-138 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-29Merge "Adding docker tag"Mark Beierl1-1/+6
2017-05-29Adding docker tagmbeierl1-1/+6
Adds the tag to use when running docker from the DOCKER_TAG environment variable. Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25 JIRA: STORPERF-128 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-26Merge "Removal of Edgar StPierre from Committer List"Mark Beierl1-1/+1
2017-05-24Adding domain to authenticationmbeierl1-7/+11
Adds domain if present in environment variables to user and project Change-Id: I05fca2fbdeef4fa985bfb505f9158ce31da5ab9c JIRA: STORPERF-127 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-24numpy error in containermbeierl1-1/+0
Removes numpy from container as it causes runtime problems. Change-Id: Iaae384c9229e0af5057822d62fca146732d62a53 JIRA: STORPERF-126 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-23Specify numpy versionmbeierl2-0/+2
Adds explicit version of numpy so it cannot conflict with any other that may be present in the system path. Change-Id: I23b21bca43f55805b3087646b1c31e1aea686aca JIRA: STORPERF-126 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-04Adding Release Notesmbeierl2-0/+124
Change-Id: I904e995fa8fb8088053a556ddaf0d243a378098f JIRA: STORPERF-111 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-05-02Fix admin.rc generationmbeierl1-1/+1
Explicitly filters out anything that is not an environment variable. Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168 JIRA: STORPERF-124 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-04-26Removal of Edgar StPierre from Committer ListTrevor Bramwell1-1/+1
Change-Id: Ia79fd87e5ef15d2226457efb2bb1a21845a1fdd5 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-04-26Pinning version of Swagger UImbeierl1-0/+1
Changes the inclusion of Swagger UI to become a git checkout of a fixed version rather than following the head. Change-Id: I30def6d6c37a166cc37f15857a98064c760eb7c6 JIRA: STORPERF-123 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-31Merge "Fixed paths to match standard"Mark Beierl6-19/+5
2017-03-31Fixed paths to match standardmbeierl6-19/+5
Change-Id: I733d34eb8bbdf0201b06a21d0ceeda50a06dd49f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-30Fixed typombeierl1-1/+0
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 6eb2c8d8a8971ee3ae0693feebe509d4ec30a7a8)
2017-03-30Fixed typombeierl1-1/+0
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-30Use tagged version of graphitembeierl11-39/+272
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 1bcbe0bac328e26341ba68341d4b809c32b8242f)
2017-03-29Use tagged version of graphitembeierl11-39/+272
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-08Adding LabelsShubhamRathi2-0/+4
Labels serve as anchors/ refs when referenced from other documents This patch adds labels to docs/*/*/index.rst Change-Id: I464d17d0b1e3b53daa30a5ecb1725f56aaabf39b Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-03-07Changing run length to 30min to see if queue depth 2, block size 8192 ↵mbeierl1-1/+1
stablilizes then instead Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-06Remove deprecated fieldsmbeierl4-32/+0
Removes the nowarm and nossd fields as it is better to be explicit about running the '_warm_up' workload. Change-Id: I54b67006abdc071f6fd190d6a5eefe026609c150 JIRA: STORPERF-108 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-24Fixing final reportmbeierl4-15/+30
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-23Documentation Updatembeierl7-56/+365
Adds documentation for Danube. Change-Id: I2755cb00b769cd0668e5c956d0b70c33d328d882 JIRA: STORPERF-81 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl8-127/+40
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-16Prevent notifications after terminationmbeierl7-20/+128
Changes the event notification logic inside the FIO invoker so that it no longer publishes events after termination. Prevents false reports after steady state has been detected. Change-Id: I694f77b6493b88820fe4f4cc7f634e3e62c45a9a JIRA: STORPERF-105 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-15Normalize data seriesmbeierl2-13/+43
Changes the data series from using seconds to samples so that slope is not artificially flattened. Change-Id: Idf87926a47c2ba67e66e2254d3572adad7a81b44 JIRA: STORPERF-106 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-01Add URL for results reportmbeierl6-22/+42
Records the URL returned from testresults db. Changes the URL ref from localhost to external and reports in daily job. Change-Id: I0068ea963671fb183779ac20592ba6933647eea0 JIRA: STORPERF-104 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-31Fixing double JSON encoding of results payloadmbeierl2-5/+5
Change-Id: I5e5a8180d5851630b1200ade84f6beb5dfa18466 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-30Make it easier to see what's happening in Jenkinsmbeierl4-11/+32
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Testresults DB Alignmentmbeierl5-51/+110
Changes the key names sent to the testresults db to align with other projects. Defines a clear PASS/FAIL based on the ability to find steady state for all runs. If one run failed to achieve steady state, run gets labelled as FAIL. Change-Id: I73143779453689eea93829079388ed8035134aa3 JIRA: STORPERF-100 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Dump env so I can see what variables are visible once the job is run under ↵mbeierl1-1/+7
Jenkins Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Fixed line to long errormbeierl4-3/+4
Fixes the version of requests to match what docker was already pulling in. Truncate log message to 512 characters. Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc JIRA: STORPERF-103 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Pin version of setuptoolsmbeierl2-1/+2
Forces explicit version of setuptools to be used because of an upstream change: https://github.com/pypa/setuptools/issues/937 Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15 JIRA: STORPERF-102 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Hardening FIO interactionmbeierl11-72/+136
Fixes a problem where FIO does not terminate by scheduling a second killall if we get a specific message back from FIO stderr. Introduces a new flavor for StorPerf that has a little more memory as larger memory maps for duplicate blocks sometimes caused out of memory killer to be invoked. Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a JIRA: STORPERF-99 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Fix multiple workload runsmbeierl5-59/+73
Change reporting so that multiple workloads in one job execution can be reported instead of overwriting the previous value. Change the daily job to use a single, multiple workload run. Change-Id: I8e350350ae13d2272b584af7a60ad269de160587 JIRA: STORPERF-98 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Correct duplicate event notificationmbeierl1-0/+5
Clears the listener list on start and remove listener after run is completed. Change-Id: I76e1f13379d60bdb72fcf2faf57d9762a62f17d3 JIRA: STORPERF-96 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Change to Ubuntu 16.04mbeierl2-9/+9
Change the base image used for the agent VM to Ubuntu 16.04 as the 14.04 image has kernel panic when the Cinder Volume is detached Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11 JIRA: STORPERF-97 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Actually check out releng locallymbeierl1-0/+4
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixing up paths and checking out releng locallymbeierl2-2/+2
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixed typombeierl1-1/+0
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a Signed-off-by: mbeierl <mark.beierl@dell.com>