Age | Commit message (Collapse) | Author | Files | Lines |
|
Removes the nowarm and nossd fields as it is better to be
explicit about running the '_warm_up' workload.
Change-Id: I54b67006abdc071f6fd190d6a5eefe026609c150
JIRA: STORPERF-108
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Makes the report readable instead of JSON escaped and dumps it
to the Jenkins daily when done.
Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the overall value of all metrics to be based on the
calculated steady state values instead of the average for the
entire run.
Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab
JIRA: STORPERF-107
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the event notification logic inside the FIO invoker
so that it no longer publishes events after termination.
Prevents false reports after steady state has been detected.
Change-Id: I694f77b6493b88820fe4f4cc7f634e3e62c45a9a
JIRA: STORPERF-105
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the data series from using seconds to samples
so that slope is not artificially flattened.
Change-Id: Idf87926a47c2ba67e66e2254d3572adad7a81b44
JIRA: STORPERF-106
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Records the URL returned from testresults db.
Changes the URL ref from localhost to external and reports in
daily job.
Change-Id: I0068ea963671fb183779ac20592ba6933647eea0
JIRA: STORPERF-104
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I5e5a8180d5851630b1200ade84f6beb5dfa18466
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the key names sent to the testresults db to align with other
projects.
Defines a clear PASS/FAIL based on the ability to find steady state for
all runs. If one run failed to achieve steady state, run gets labelled
as FAIL.
Change-Id: I73143779453689eea93829079388ed8035134aa3
JIRA: STORPERF-100
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Fixes the version of requests to match what docker was already
pulling in.
Truncate log message to 512 characters.
Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc
JIRA: STORPERF-103
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Fixes a problem where FIO does not terminate by scheduling a
second killall if we get a specific message back from FIO
stderr.
Introduces a new flavor for StorPerf that has a little more
memory as larger memory maps for duplicate blocks sometimes
caused out of memory killer to be invoked.
Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a
JIRA: STORPERF-99
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change reporting so that multiple workloads in one job execution can
be reported instead of overwriting the previous value.
Change the daily job to use a single, multiple workload run.
Change-Id: I8e350350ae13d2272b584af7a60ad269de160587
JIRA: STORPERF-98
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Clears the listener list on start and remove listener after run
is completed.
Change-Id: I76e1f13379d60bdb72fcf2faf57d9762a62f17d3
JIRA: STORPERF-96
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change the base image used for the agent VM to Ubuntu 16.04 as
the 14.04 image has kernel panic when the Cinder Volume is detached
Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11
JIRA: STORPERF-97
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I2b07bb9724b19f8b25e35160fba3bf11621a30d7
JIRA: STORPERF-93
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change to detect environment variable and use v3 authentication
instead if present.
Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a
JIRA: STORPERF-88
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I61f8ce4e719e2c2ef7597c0e41aff8c8d79edc2d
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Detection of steady state after 10+ samples of data
Change-Id: I29368b06188c6370d17b3d567fece6486d171235
JIRA: STORPERF-72 STORPERF-73
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Use Paramiko ssh client instead of invoking ssh and scp
from the command line
Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7
JIRA: STORPERF-91
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Break out test db interaction into new module and
make the push event driven instead of the sleep
that was there before.
Change-Id: I9485aba1405f6c3b4ee5000168fbc037efa87c81
JIRA: STORPERF-90
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Module that allows passing of a gate only once all other
peers have also reported in within a specified time period
Change-Id: If4baf1d4377026c7833a6f30bfc2e36698f675e8
JIRA: STORPERF-71
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Creation of a daily job script that runs under Jenkins and
kicks off a series of tests using the freshly cloned workspace.
Change-Id: Ibc63c1df954578ad78604321ea410c8fd8c63c41
JIRA: STORPERF-87
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Provide a method to query the status of a job by id
Change-Id: I4d3567995e7c7c3359596346009358276e79d65c
JIRA: STORPERF-89
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Test the agent's ssh port prior to proceeding with test
Change-Id: Iff65f2c12a50063aa9f2ee4b75638ec0666ded1b
JIRA: STORPERF-34
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Removes check stack as that can timeout when a large
number of agents are requested
Waits for stack to be created before returning
JIRA: STORPERF-70
Change-Id: I1cbe45b1f60f0ecab0691f0822ed5643778d218b
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Test and fix for error in slope
STORPERF-74
Change-Id: I17a8e0e1e588deb875ecace85290f92167df1d5e
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Added a Steady State Detection module containing a steady_state(data_series)
function that is able to return a boolean indicating wether or not steady
state is reached with the data_series being passed.
This module requires a data_treatment(data_series) and an average(data_series)
modules that have been added in this commit as well. The data treatment function
aims at formatting the data series that is passed to the high level steady_state
function to reach the requirement of each sub-module (slope, average and range).
Modified the Slope and Range functions so they return None when passed an empty
data series instead of 0 which was wrong. Modified the corresponding test cases.
Modified the math_range_test.py file to fix a bug in the 2 last tests.
Change-Id: I9c3854cb0a21cc37b0787b8afca0821eefaa203d
JIRA: STORPERF-60
JIRA: STORPERF-59
JIRA: STORPERF-61
JIRA: STORPERF-62
Signed-off-by: Tim Rault <tim.rault@cengn.ca>
|
|
Moving the test files into their own top-level
directory to keep things clean
Change-Id: Ic50b881045bc59b003807923424345b335dd5c95
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Update to fail verify if pep8 compliance not met.
Revert back to Coverage 4.1 to show code coverage
report in Jenkins again
Change-Id: Icb467451f101942255c7944ad796497609dcb07e
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
|
|
Added a range_value function in utilities/math.py able to compute the range
of a series of y values : [y1, y2, ..., yn].
Implemented a test harness for this range_value function in the tests/utilities
section.
Renamed the math_slope.py and math_range.py test files to add _test.py for
Jenkins.
Cleaned up the code so it is compliant to the pep8 rules.
Renamed the previous 'math' modules (storperf/utilities/math.py
and storperf/test/utilities/math.py) as 'math_slope' to be
coherent with the new notation.
Change-Id: I02ccd2b87f0b72e7a28c416b593aae4d8ad97961
JIRA: STORPERF-57
JIRA: STORPERF-58
Signed-off-by: Tim Rault <tim.rault@cengn.ca>
|
|
All test files must end in _test.py or they don't get
executed
Change-Id: If3a46a66570f7d07d0e93de72438a8a46b3e0a22
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Added a math module in utilities that contains a slope function
able to compute the slope of the best Least Squares curve fit
given a series of [x,y] values.
Implemented a test harness for this math module in the tests/utilities
section.
Change-Id: If4d63af092d0904b2269c5ee0991e18ab84533c0
JIRA: STORPERF-54
JIRA: STORPERF-55
JIRA: STORPERF-51
Signed-off-by: Tim Rault <tim.rault@cengn.ca>
|
|
Change-Id: Ib4b8cb92b4cbc7dd778363335b6d0e22ae1993fb
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change-Id: I004824711abf17f06781302cf48a0b0e3d095ecb
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change-Id: I6cb17c699ae3b88a591278da23d60dfc0da91e40
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add the ability to push results to the test result db. If
the environment variable TEST_DB_URL is defined, results
will be pushed there. If not, no push is attempted.
Change-Id: Ib833530d7379c5f37f0d2904a83d31a4ee559ae6
JIRA: STORPERF-13
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add a maximum time limit for any one given test so
that silly mistakes like block size 512, queue depth 1
does not end up running for 2 days
JIRA: STORPERF-53
Change-Id: I1f3e5046e1dd346fc5b28a7b935df2ee9aa6ba3d
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add the ability to store arbitrary metadata about the job for
later reporting
Change-Id: If7f1d0a69111567d69db865baec6c20f9a1f494f
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change-Id: I47f20dec309d7ab8402f40f6cf09828aa134e902
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Fix the OpenStack client authentication timeout bug where we never
reauthenticate after authentication expires
Add the ability to specify what OS image from the Glance catalog
should be used for the Agent VM
Change-Id: I2ff8f5598b8d58ee2bf654b3572e9841b24cc9de
JIRA: STORPERF-42
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Adds matplotlib
Adds support for generating graphs showing performance results
Change-Id: Iba344baab89e35c0d5891a9d6b4c22c37666511e
JIRA: STORPERF-44
JIRA: STORPERF-50
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add Swagger web ui at /swagger
Add ability to fetch read/write latency status via ReST ui
Can now delete where stack was removed from OpenStack but not from the
storperf DB
Change to use Floating IPs instead of private IP
Fix delete bug where there was no dependency on resources in
the resource group.
JIRA: STORPERF-19
JIRA: STORPERF-20
Change-Id: I1d9627d81f3c309b178a9b68cc306a4101c1a231
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add Swagger web ui at /swagger
Add ability to fetch read/write latency status via ReST ui
Can now delete where stack was removed from OpenStack but not from the
storperf DB
Change to use Floating IPs instead of private IP
Fix delete bug where there was no dependency on resources in
the resource group.
JIRA: STORPERF-19
JIRA: STORPERF-20
Change-Id: I0a4b3386789c38d6745906ba896b8ff851dc122f
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change-Id: Idd0f4bec503578c2f2031cbcdee97ea27d22ac14
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Add the ability to terminate a running job via the API
JIRA: STORPERF-20
Change-Id: I73a701cff9712207f5e14cfcc6b8fb7e0ab59aed
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change the way slave jobs are managed so that they are in step
with each other, and we can track the overall thread that is
running them. This lays groundwork for STORPERF-20 and
STORPERF-44
JIRA: STORPERF-33 STORPERF-43
Change-Id: Iaff48a2823ba85d6512e9782fd9091a72639835c
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change test run to default to 64k blocks with 100% of attached storage
being tested.
JIRA: STORPERF-33
Change-Id: Id803d0493fb2c35691911ed79d226443a01503f3
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
StorPerf agent now uses storperf in ssh
HOT uses default name StorPerf Ubuntu 14.04
Change-Id: Ie87443955c73d1e81fb3a75b90e4a65a9ac6560b
JIRA: STORPERF-39
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Use sudo for fio when profiling a device.
Change-Id: Ibbcbb15a2c33e1e58b7e340f9c3f6de5958f5636
JIRA: STORPERF-40
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|