summaryrefslogtreecommitdiffstats
path: root/storperf/storperf_master.py
AgeCommit message (Collapse)AuthorFilesLines
2017-06-08Allow User-Specified Sample Sizembeierl1-0/+10
Adds the ability to accept steady_state_sample_size as a parameter. Removes deprecated nowarm and nossd. Adds OS_PROJECT_DOMAIN_ID. Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf JIRA: STORPERF-139 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit c7806a0f08f6114d8b1f037a77af041a2b0364d5)
2017-05-25Adding domain to authenticationmbeierl1-7/+11
Adds domain if present in environment variables to user and project Change-Id: I05fca2fbdeef4fa985bfb505f9158ce31da5ab9c JIRA: STORPERF-127 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit 99171196e616d0c24568246b4c8d4b1a76f92660)
2017-03-06Remove deprecated fieldsmbeierl1-16/+0
Removes the nowarm and nossd fields as it is better to be explicit about running the '_warm_up' workload. Change-Id: I54b67006abdc071f6fd190d6a5eefe026609c150 JIRA: STORPERF-108 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-24Fixing final reportmbeierl1-2/+1
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl1-3/+9
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-17Expose TENANT_IDmbeierl1-8/+9
Change-Id: I2b07bb9724b19f8b25e35160fba3bf11621a30d7 JIRA: STORPERF-93 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-16Use v3 Authmbeierl1-32/+41
Change to detect environment variable and use v3 authentication instead if present. Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a JIRA: STORPERF-88 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-05Steady state detectionMark Beierl1-2/+2
Detection of steady state after 10+ samples of data Change-Id: I29368b06188c6370d17b3d567fece6486d171235 JIRA: STORPERF-72 STORPERF-73 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-12-02Change to ParamikoMark Beierl1-60/+25
Use Paramiko ssh client instead of invoking ssh and scp from the command line Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7 JIRA: STORPERF-91 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-23Ability to query job statusMark Beierl1-0/+3
Provide a method to query the status of a job by id Change-Id: I4d3567995e7c7c3359596346009358276e79d65c JIRA: STORPERF-89 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-22Wait for agent statusMark Beierl1-0/+21
Test the agent's ssh port prior to proceeding with test Change-Id: Iff65f2c12a50063aa9f2ee4b75638ec0666ded1b JIRA: STORPERF-34 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-10Create Stack FixesMark Beierl1-20/+24
Removes check stack as that can timeout when a large number of agents are requested Waits for stack to be created before returning JIRA: STORPERF-70 Change-Id: I1cbe45b1f60f0ecab0691f0822ed5643778d218b Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-05-13Fixed logic indendation bugMark Beierl1-1/+2
Change-Id: I6cb17c699ae3b88a591278da23d60dfc0da91e40 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-12Results DB ReportingMark Beierl1-3/+2
Add the ability to push results to the test result db. If the environment variable TEST_DB_URL is defined, results will be pushed there. If not, no push is attempted. Change-Id: Ib833530d7379c5f37f0d2904a83d31a4ee559ae6 JIRA: STORPERF-13 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-11Max test durationMark Beierl1-0/+8
Add a maximum time limit for any one given test so that silly mistakes like block size 512, queue depth 1 does not end up running for 2 days JIRA: STORPERF-53 Change-Id: I1f3e5046e1dd346fc5b28a7b935df2ee9aa6ba3d Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-11Job Run MetadataMark Beierl1-3/+8
Add the ability to store arbitrary metadata about the job for later reporting Change-Id: If7f1d0a69111567d69db865baec6c20f9a1f494f Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-10Auth timeout fix and VM image selectionMark Beierl1-2/+33
Fix the OpenStack client authentication timeout bug where we never reauthenticate after authentication expires Add the ability to specify what OS image from the Glance catalog should be used for the Agent VM Change-Id: I2ff8f5598b8d58ee2bf654b3572e9841b24cc9de JIRA: STORPERF-42 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-09Add plotsMark Beierl1-1/+25
Adds matplotlib Adds support for generating graphs showing performance results Change-Id: Iba344baab89e35c0d5891a9d6b4c22c37666511e JIRA: STORPERF-44 JIRA: STORPERF-50 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-05-05 Add Stats report and Swagger UIMark Beierl1-16/+30
Add Swagger web ui at /swagger Add ability to fetch read/write latency status via ReST ui Can now delete where stack was removed from OpenStack but not from the storperf DB Change to use Floating IPs instead of private IP Fix delete bug where there was no dependency on resources in the resource group. JIRA: STORPERF-19 JIRA: STORPERF-20 Change-Id: I0a4b3386789c38d6745906ba896b8ff851dc122f Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-04-26Cancel Job APIMark Beierl1-1/+3
Add the ability to terminate a running job via the API JIRA: STORPERF-20 Change-Id: I73a701cff9712207f5e14cfcc6b8fb7e0ab59aed Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-04-25Job run lifecycle reworkMark Beierl1-3/+0
Change the way slave jobs are managed so that they are in step with each other, and we can track the overall thread that is running them. This lays groundwork for STORPERF-20 and STORPERF-44 JIRA: STORPERF-33 STORPERF-43 Change-Id: Iaff48a2823ba85d6512e9782fd9091a72639835c Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-04-06Incorrect nameMark Beierl1-3/+3
StorPerf agent now uses storperf in ssh HOT uses default name StorPerf Ubuntu 14.04 Change-Id: Ie87443955c73d1e81fb3a75b90e4a65a9ac6560b JIRA: STORPERF-39 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-03-08Cinder fixMark Beierl1-1/+2
Fix so that Cinder will use Tenant ID instead of name Change-Id: I2d30db61dffc4f381d64e8d99449a2c55c5928a9 JIRA: STORPERF-38 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-01-29Remote slave agent workloadMark Beierl1-0/+342
Add storperf master object to manage stack lifecycle. Add configuration db. Creation of CLI vs. main so that ReST API and CLI API can be kept clear. Fixed License in files. Changed DB objects to be thread safe. Added ssh server to container if desired for CLI. Change-Id: Idfe84bfb7920e6ce19d27462593c21ea86e7b406 JIRA: STORPERF-29 Signed-off-by: Mark Beierl <mark.beierl@emc.com>