summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-06-09Allow Filename Targetdanube.3.0stable/danubembeierl1-1/+1
Changes the default filesize to 1g so that profiling a file works again Change-Id: I060b7af75be08f4ffb411f1c612babb846172dd5 JIRA: STORPERF-153 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit c8c1bc3cf1895c28d9d5cbfaff7ec80ed95b93b8)
2017-06-08Allow User-Specified Sample Sizembeierl6-42/+46
Adds the ability to accept steady_state_sample_size as a parameter. Removes deprecated nowarm and nossd. Adds OS_PROJECT_DOMAIN_ID. Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf JIRA: STORPERF-139 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit c7806a0f08f6114d8b1f037a77af041a2b0364d5)
2017-06-01Fixing typombeierl1-1/+1
Change-Id: I40a2367de22afe4db46c7da7d774f0e646cb8a23 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 73ae1dae45a61926588ad16866721a0cf03f0ff7)
2017-06-01Daily Job Parameter Supportmbeierl2-45/+22
Adds environment variables so that the daily jobs can be parameterized from Jenkins. Change-Id: I77518b90595460ca932f1e71f57b2b02ab3dd1f5 JIRA: STORPERF-138 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit e827181f80d6ffb2e90b1f8dd53061a2d92be7ba)
2017-05-30Merge "Adding domain to authentication" into stable/danubeMark Beierl1-7/+11
2017-05-29Adding docker tagmbeierl1-1/+6
Adds the tag to use when running docker from the DOCKER_TAG environment variable. Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25 JIRA: STORPERF-128 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit d96edc28f85b78f9323d407191d60e0d9c8749e2)
2017-05-25Adding domain to authenticationmbeierl1-7/+11
Adds domain if present in environment variables to user and project Change-Id: I05fca2fbdeef4fa985bfb505f9158ce31da5ab9c JIRA: STORPERF-127 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 99171196e616d0c24568246b4c8d4b1a76f92660)
2017-05-04Adding Release Notesmbeierl2-0/+124
Change-Id: I904e995fa8fb8088053a556ddaf0d243a378098f JIRA: STORPERF-111 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit a214a59f9ca7e9b7503a4042b496417e76d8510c)
2017-05-03Fix admin.rc generationmbeierl1-1/+1
Explicitly filters out anything that is not an environment variable. Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168 JIRA: STORPERF-124 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 8f7c8dbd36e04f4976562bbe527e2b3efcfa332e)
2017-04-27Pinning version of Swagger UImbeierl1-0/+1
Changes the inclusion of Swagger UI to become a git checkout of a fixed version rather than following the head. Change-Id: I30def6d6c37a166cc37f15857a98064c760eb7c6 JIRA: STORPERF-123 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 67ef3ea942d5d2eaff46572936f12d4ccab4d89c)
2017-03-31Fixed paths to match standarddanube.1.0mbeierl6-19/+5
Change-Id: I733d34eb8bbdf0201b06a21d0ceeda50a06dd49f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-30Fixed typombeierl1-1/+0
Change-Id: I03b8df65a13a0c2ddeee6eb40e6071c8843ad5ca JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 6eb2c8d8a8971ee3ae0693feebe509d4ec30a7a8)
2017-03-30Use tagged version of graphitembeierl11-39/+272
Changes the docker build procedure to use a pip install of a specific version of graphite so that it doesn't break when upstream changes occur. Change-Id: I2316912fc04568c441212087665e384075e409a6 JIRA: STORPERF-110 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 1bcbe0bac328e26341ba68341d4b809c32b8242f)
2017-03-08Adding LabelsShubhamRathi2-0/+4
Labels serve as anchors/ refs when referenced from other documents This patch adds labels to docs/*/*/index.rst Change-Id: I464d17d0b1e3b53daa30a5ecb1725f56aaabf39b Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-03-07Changing run length to 30min to see if queue depth 2, block size 8192 ↵mbeierl1-1/+1
stablilizes then instead Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-03-06Remove deprecated fieldsmbeierl4-32/+0
Removes the nowarm and nossd fields as it is better to be explicit about running the '_warm_up' workload. Change-Id: I54b67006abdc071f6fd190d6a5eefe026609c150 JIRA: STORPERF-108 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-24Fixing final reportmbeierl4-15/+30
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-23Documentation Updatembeierl7-56/+365
Adds documentation for Danube. Change-Id: I2755cb00b769cd0668e5c956d0b70c33d328d882 JIRA: STORPERF-81 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl8-127/+40
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-16Prevent notifications after terminationmbeierl7-20/+128
Changes the event notification logic inside the FIO invoker so that it no longer publishes events after termination. Prevents false reports after steady state has been detected. Change-Id: I694f77b6493b88820fe4f4cc7f634e3e62c45a9a JIRA: STORPERF-105 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-15Normalize data seriesmbeierl2-13/+43
Changes the data series from using seconds to samples so that slope is not artificially flattened. Change-Id: Idf87926a47c2ba67e66e2254d3572adad7a81b44 JIRA: STORPERF-106 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-01Add URL for results reportmbeierl6-22/+42
Records the URL returned from testresults db. Changes the URL ref from localhost to external and reports in daily job. Change-Id: I0068ea963671fb183779ac20592ba6933647eea0 JIRA: STORPERF-104 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-31Fixing double JSON encoding of results payloadmbeierl2-5/+5
Change-Id: I5e5a8180d5851630b1200ade84f6beb5dfa18466 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-30Make it easier to see what's happening in Jenkinsmbeierl4-11/+32
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Testresults DB Alignmentmbeierl5-51/+110
Changes the key names sent to the testresults db to align with other projects. Defines a clear PASS/FAIL based on the ability to find steady state for all runs. If one run failed to achieve steady state, run gets labelled as FAIL. Change-Id: I73143779453689eea93829079388ed8035134aa3 JIRA: STORPERF-100 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Dump env so I can see what variables are visible once the job is run under ↵mbeierl1-1/+7
Jenkins Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Fixed line to long errormbeierl4-3/+4
Fixes the version of requests to match what docker was already pulling in. Truncate log message to 512 characters. Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc JIRA: STORPERF-103 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Pin version of setuptoolsmbeierl2-1/+2
Forces explicit version of setuptools to be used because of an upstream change: https://github.com/pypa/setuptools/issues/937 Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15 JIRA: STORPERF-102 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Hardening FIO interactionmbeierl11-72/+136
Fixes a problem where FIO does not terminate by scheduling a second killall if we get a specific message back from FIO stderr. Introduces a new flavor for StorPerf that has a little more memory as larger memory maps for duplicate blocks sometimes caused out of memory killer to be invoked. Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a JIRA: STORPERF-99 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Fix multiple workload runsmbeierl5-59/+73
Change reporting so that multiple workloads in one job execution can be reported instead of overwriting the previous value. Change the daily job to use a single, multiple workload run. Change-Id: I8e350350ae13d2272b584af7a60ad269de160587 JIRA: STORPERF-98 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Correct duplicate event notificationmbeierl1-0/+5
Clears the listener list on start and remove listener after run is completed. Change-Id: I76e1f13379d60bdb72fcf2faf57d9762a62f17d3 JIRA: STORPERF-96 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Change to Ubuntu 16.04mbeierl2-9/+9
Change the base image used for the agent VM to Ubuntu 16.04 as the 14.04 image has kernel panic when the Cinder Volume is detached Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11 JIRA: STORPERF-97 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Actually check out releng locallymbeierl1-0/+4
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixing up paths and checking out releng locallymbeierl2-2/+2
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18Fixed typombeierl1-1/+0
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-18StorPerf Daily Jobmbeierl6-37/+97
Helper script that determines what installer was used. Script to generate RC file for container. Script to determine number of Cinder nodes. Daily job to pull new container, create stack based on number of Cinder nodes, issue a warm up, and then run a series of performance tests against the stack. Deletes stack once complete. JIRA: STORPERF-87 Signed-off-by: mbeierl <mark.beierl@dell.com> Change-Id: I551f21ffc85f11b0c0724205e952551022a94f5b
2017-01-17Expose TENANT_IDmbeierl1-8/+9
Change-Id: I2b07bb9724b19f8b25e35160fba3bf11621a30d7 JIRA: STORPERF-93 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-16Use v3 Authmbeierl4-34/+45
Change to detect environment variable and use v3 authentication instead if present. Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a JIRA: STORPERF-88 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-06Allow 0 to match steady state and don't terminate the warmupmbeierl2-10/+11
Change-Id: I61f8ce4e719e2c2ef7597c0e41aff8c8d79edc2d Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-06Fixed typombeierl1-1/+1
Change-Id: I82cf026017690436a1112daabfa0b084275d8fe7 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-05Steady state detectionMark Beierl17-63/+447
Detection of steady state after 10+ samples of data Change-Id: I29368b06188c6370d17b3d567fece6486d171235 JIRA: STORPERF-72 STORPERF-73 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-12-03Merge "Change to Paramiko"Mark Beierl7-100/+82
2016-12-02Change to ParamikoMark Beierl7-100/+82
Use Paramiko ssh client instead of invoking ssh and scp from the command line Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7 JIRA: STORPERF-91 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-30bugfix: Add BRANCH Argument in the DockerfileMatthewLi1-2/+2
Change-Id: If5ccbe0633ed5331b38d8231e0dd6eadd05ecbe8 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-30Data Handling RefactoringMark Beierl4-56/+185
Break out test db interaction into new module and make the push event driven instead of the sleep that was there before. Change-Id: I9485aba1405f6c3b4ee5000168fbc037efa87c81 JIRA: STORPERF-90 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-30Add BRANCH Argument in the Dockerfilejose.lausuch1-2/+4
This patch allows: - clone the respective repo branch while building the image - slightly reduce the size of the image by cloning only the latest Change-Id: I48994d7d9cf230493fa22f39cf1ed7ef4fd72d9e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-11-25Data Reporting GateMark Beierl3-0/+118
Module that allows passing of a gate only once all other peers have also reported in within a specified time period Change-Id: If4baf1d4377026c7833a6f30bfc2e36698f675e8 JIRA: STORPERF-71 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-25Daily JobMark Beierl8-18/+271
Creation of a daily job script that runs under Jenkins and kicks off a series of tests using the freshly cloned workspace. Change-Id: Ibc63c1df954578ad78604321ea410c8fd8c63c41 JIRA: STORPERF-87 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-23Ability to query job statusMark Beierl3-8/+26
Provide a method to query the status of a job by id Change-Id: I4d3567995e7c7c3359596346009358276e79d65c JIRA: STORPERF-89 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-22Wait for agent statusMark Beierl1-0/+21
Test the agent's ssh port prior to proceeding with test Change-Id: Iff65f2c12a50063aa9f2ee4b75638ec0666ded1b JIRA: STORPERF-34 Signed-off-by: Mark Beierl <mark.beierl@dell.com>