summaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-06-08Allow User-Specified Sample Sizembeierl1-5/+8
Adds the ability to accept steady_state_sample_size as a parameter. Removes deprecated nowarm and nossd. Adds OS_PROJECT_DOMAIN_ID. Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf JIRA: STORPERF-139 Signed-off-by: mbeierl <mark.beierl@dell.com> (cherry picked from commit c7806a0f08f6114d8b1f037a77af041a2b0364d5)
2017-02-24Fixing final reportmbeierl1-1/+1
Makes the report readable instead of JSON escaped and dumps it to the Jenkins daily when done. Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-17Steady State Metricsmbeierl1-5/+0
Changes the overall value of all metrics to be based on the calculated steady state values instead of the average for the entire run. Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab JIRA: STORPERF-107 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-16Prevent notifications after terminationmbeierl4-8/+110
Changes the event notification logic inside the FIO invoker so that it no longer publishes events after termination. Prevents false reports after steady state has been detected. Change-Id: I694f77b6493b88820fe4f4cc7f634e3e62c45a9a JIRA: STORPERF-105 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-15Normalize data seriesmbeierl1-10/+22
Changes the data series from using seconds to samples so that slope is not artificially flattened. Change-Id: Idf87926a47c2ba67e66e2254d3572adad7a81b44 JIRA: STORPERF-106 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-02-01Add URL for results reportmbeierl1-3/+4
Records the URL returned from testresults db. Changes the URL ref from localhost to external and reports in daily job. Change-Id: I0068ea963671fb183779ac20592ba6933647eea0 JIRA: STORPERF-104 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-27Testresults DB Alignmentmbeierl1-0/+36
Changes the key names sent to the testresults db to align with other projects. Defines a clear PASS/FAIL based on the ability to find steady state for all runs. If one run failed to achieve steady state, run gets labelled as FAIL. Change-Id: I73143779453689eea93829079388ed8035134aa3 JIRA: STORPERF-100 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-26Hardening FIO interactionmbeierl1-3/+10
Fixes a problem where FIO does not terminate by scheduling a second killall if we get a specific message back from FIO stderr. Introduces a new flavor for StorPerf that has a little more memory as larger memory maps for duplicate blocks sometimes caused out of memory killer to be invoked. Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a JIRA: STORPERF-99 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-01-20Fix multiple workload runsmbeierl1-0/+11
Change reporting so that multiple workloads in one job execution can be reported instead of overwriting the previous value. Change the daily job to use a single, multiple workload run. Change-Id: I8e350350ae13d2272b584af7a60ad269de160587 JIRA: STORPERF-98 Signed-off-by: mbeierl <mark.beierl@dell.com>
2016-12-05Steady state detectionMark Beierl4-14/+238
Detection of steady state after 10+ samples of data Change-Id: I29368b06188c6370d17b3d567fece6486d171235 JIRA: STORPERF-72 STORPERF-73 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-30Data Handling RefactoringMark Beierl2-2/+79
Break out test db interaction into new module and make the push event driven instead of the sleep that was there before. Change-Id: I9485aba1405f6c3b4ee5000168fbc037efa87c81 JIRA: STORPERF-90 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-11-25Data Reporting GateMark Beierl2-0/+60
Module that allows passing of a gate only once all other peers have also reported in within a specified time period Change-Id: If4baf1d4377026c7833a6f30bfc2e36698f675e8 JIRA: STORPERF-71 Signed-off-by: Mark Beierl <mark.beierl@dell.com>
2016-08-24Slope errorMark Beierl1-0/+6
Test and fix for error in slope STORPERF-74 Change-Id: I17a8e0e1e588deb875ecace85290f92167df1d5e Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2016-07-15Add Steady State Detection moduleTim Rault5-36/+228
Added a Steady State Detection module containing a steady_state(data_series) function that is able to return a boolean indicating wether or not steady state is reached with the data_series being passed. This module requires a data_treatment(data_series) and an average(data_series) modules that have been added in this commit as well. The data treatment function aims at formatting the data series that is passed to the high level steady_state function to reach the requirement of each sub-module (slope, average and range). Modified the Slope and Range functions so they return None when passed an empty data series instead of 0 which was wrong. Modified the corresponding test cases. Modified the math_range_test.py file to fix a bug in the 2 last tests. Change-Id: I9c3854cb0a21cc37b0787b8afca0821eefaa203d JIRA: STORPERF-60 JIRA: STORPERF-59 JIRA: STORPERF-61 JIRA: STORPERF-62 Signed-off-by: Tim Rault <tim.rault@cengn.ca>
2016-07-14Separation of test and sourceMark Beierl15-0/+887
Moving the test files into their own top-level directory to keep things clean Change-Id: Ic50b881045bc59b003807923424345b335dd5c95 Signed-off-by: Mark Beierl <mark.beierl@emc.com>
2015-11-23Adding workload modulesmbeierl4-1014/+0
Adding the ablity to define workloads in modules which can be referenced from the API. Breaking out the test execution into its own class so it will be easier to support ReST or other interfaces. Added flake8 and code coverage reports where possible to merge and verify jobs Change-Id: Ieb51e4e7e1e989288a6f81f4757709669914a196 JIRA: STORPERF-21 Signed-off-by: mbeierl <mark.beierl@emc.com>
2015-10-15Logging and timestampmbeierl1-8/+837
Added logging and fixed issue if fio does not produce the current timestamp in its output JIRA: STORPERF-4 Change-Id: Ifd0dbc4e17d984907e63089ebfae1d0e9e749dcc Signed-off-by: mbeierl <mark.beierl@emc.com>
2015-10-15Creation of convertersmbeierl1-0/+120
JIRA: STORPERF-6 Change-Id: Id81a129807a984ad4af669e3f0f84c1e7ced5552 Signed-off-by: mbeierl <mark.beierl@emc.com>
2015-10-15Created convertersmbeierl3-0/+65
JIRA: STORPERF-6 Change-Id: Idba1718a8ad8243872ca100ed10b1c457221d147 Signed-off-by: mbeierl <mark.beierl@emc.com>