Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I0def9ef07f9530eb468e47992b660ec98757726f
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Moves the dockerfiles for the different submodules/containers into
their respective directories.
Adds a docker compose file that can build the containers from the
local filesystem, and mounts the local filesystem as a volume,
making it easier for developer testing as local changes are
automatically reflected in the final container.
Change-Id: I2376034258cab2a3dc3a0d1ac3f01bbf5d1f59e7
JIRA: STORPERF-189
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the paths of all source code so that it exists under the dockerfile location
for each container. This way we can use COPY instead of git clone, as well as use the
existing JJB.
Change-Id: I883b2957d89659c164fff0a1ebc4d677c534796d
JIRA: STORPERF-188
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds multithreaded HTTP request abilities to ReST Server.
Fixes docker-compose to ensure pull prior to up.
Fixes metrics typo to make jobs API query work again.
Change-Id: Ibac6188379cae0489792c5ea80f37dd3abf37082
JIRA: STORPERF-183
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds docker-compose directory with content to start container suite using
nginx as front and and SwaggerUI in its own container.
Updates the documentation to reflect new method of starting StorPerf.
Change-Id: I469676e330dcad6c968b90133df8866b69eb5ea1
JIRA: STORPERF-181
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds flavor as parameter to ReST /configurations API and passes
it through to the heat template creation.
Change-Id: Id3632fb571da9da51b4d75db58c7a7c0a91e0ccf
JIRA: STORPERF-92
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Removes the matplotlib modules from the main container.
Change-Id: I26a0c171b2172dbf2be66cdf10b897bb72e4bf2b
JIRA: STORPERF-161
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds the ability to accept steady_state_sample_size as a parameter.
Removes deprecated nowarm and nossd.
Adds OS_PROJECT_DOMAIN_ID.
Change-Id: I00c01b05cd2cbf001bc5446faa30f36137350ccf
JIRA: STORPERF-139
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
content from a different container JIRA: STORPERF-129"
|
|
Adds flask-cors module so that SwaggerUI can examine content from a different container
JIRA: STORPERF-129
Change-Id: I9c47a2ea464da83910c368d771dce13f5364ca23
Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
|
|
Change-Id: I40a2367de22afe4db46c7da7d774f0e646cb8a23
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds environment variables so that the daily jobs can be parameterized
from Jenkins.
Change-Id: I77518b90595460ca932f1e71f57b2b02ab3dd1f5
JIRA: STORPERF-138
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds the tag to use when running docker from the DOCKER_TAG environment
variable.
Change-Id: Idde85510df01f8a809049dac62872db0c8a5bf25
JIRA: STORPERF-128
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Adds explicit version of numpy so it cannot conflict with any other that
may be present in the system path.
Change-Id: I23b21bca43f55805b3087646b1c31e1aea686aca
JIRA: STORPERF-126
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Explicitly filters out anything that is not an environment variable.
Change-Id: I0694649623b837d2ab4b2196abf45973d0e63168
JIRA: STORPERF-124
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the docker build procedure to use a pip install of a
specific version of graphite so that it doesn't break when
upstream changes occur.
Change-Id: I2316912fc04568c441212087665e384075e409a6
JIRA: STORPERF-110
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
stablilizes then instead
Change-Id: I360c1198f0464edb84fcfd04ef6bf3e35d1e7e4f
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Makes the report readable instead of JSON escaped and dumps it
to the Jenkins daily when done.
Change-Id: Ic3788672b185461369e2c41221ae36fc4b45436b
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the overall value of all metrics to be based on the
calculated steady state values instead of the average for the
entire run.
Change-Id: I121929d5fe2dd43df7f289b82e9f5291c9ea9aab
JIRA: STORPERF-107
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Records the URL returned from testresults db.
Changes the URL ref from localhost to external and reports in
daily job.
Change-Id: I0068ea963671fb183779ac20592ba6933647eea0
JIRA: STORPERF-104
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I3ac727faa98c1e87dcd9522c0063ca6b251c62b4
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Changes the key names sent to the testresults db to align with other
projects.
Defines a clear PASS/FAIL based on the ability to find steady state for
all runs. If one run failed to achieve steady state, run gets labelled
as FAIL.
Change-Id: I73143779453689eea93829079388ed8035134aa3
JIRA: STORPERF-100
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Jenkins
Change-Id: I576a75864fa0d7c6d12990c91984e12b1489258f
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Fixes the version of requests to match what docker was already
pulling in.
Truncate log message to 512 characters.
Change-Id: Idba9374c0f339c8b4cb6902c921c8b26fef573cc
JIRA: STORPERF-103
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Forces explicit version of setuptools to be used because
of an upstream change:
https://github.com/pypa/setuptools/issues/937
Change-Id: I4124dedee38713ca1bfa445944d8d79cf1be6c15
JIRA: STORPERF-102
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Fixes a problem where FIO does not terminate by scheduling a
second killall if we get a specific message back from FIO
stderr.
Introduces a new flavor for StorPerf that has a little more
memory as larger memory maps for duplicate blocks sometimes
caused out of memory killer to be invoked.
Change-Id: I06856561ad73fef582a81d4136a36a1bea47654a
JIRA: STORPERF-99
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change reporting so that multiple workloads in one job execution can
be reported instead of overwriting the previous value.
Change the daily job to use a single, multiple workload run.
Change-Id: I8e350350ae13d2272b584af7a60ad269de160587
JIRA: STORPERF-98
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change the base image used for the agent VM to Ubuntu 16.04 as
the 14.04 image has kernel panic when the Cinder Volume is detached
Change-Id: I37e41939826fbc7c1efcc4360b99b1a2b34b8d11
JIRA: STORPERF-97
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I50358e0685be45abd9330639fcdfa9c8a39ff5ba
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: I62d877acc37a10391e59db1611c0a0af3d57fca3
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Change-Id: Iedc8f023636325dee664bfafab45381997d6403a
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Helper script that determines what installer was used.
Script to generate RC file for container.
Script to determine number of Cinder nodes.
Daily job to pull new container, create stack based on
number of Cinder nodes, issue a warm up, and then run
a series of performance tests against the stack. Deletes
stack once complete.
JIRA: STORPERF-87
Signed-off-by: mbeierl <mark.beierl@dell.com>
Change-Id: I551f21ffc85f11b0c0724205e952551022a94f5b
|
|
Change to detect environment variable and use v3 authentication
instead if present.
Change-Id: Iada49741b3297f20b740e232b2b35bec92fda91a
JIRA: STORPERF-88
Signed-off-by: mbeierl <mark.beierl@dell.com>
|
|
Use Paramiko ssh client instead of invoking ssh and scp
from the command line
Change-Id: Ibc8395b98842fd7f40b49c4dafa2688d8e64abc7
JIRA: STORPERF-91
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Creation of a daily job script that runs under Jenkins and
kicks off a series of tests using the freshly cloned workspace.
Change-Id: Ibc63c1df954578ad78604321ea410c8fd8c63c41
JIRA: STORPERF-87
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Adds HTML output to coverage so we can see it in Jenkins
Change-Id: I89595921bf86b8963890051a25e45f7bd08b0636
Signed-off-by: Mark Beierl <mark.beierl@dell.com>
|
|
Moving the test files into their own top-level
directory to keep things clean
Change-Id: Ic50b881045bc59b003807923424345b335dd5c95
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Update to fail verify if pep8 compliance not met.
Revert back to Coverage 4.1 to show code coverage
report in Jenkins again
Change-Id: Icb467451f101942255c7944ad796497609dcb07e
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
LiClipse / PyDev only works with 3.4
Change-Id: I351df5f8120889af07b10ebb7a740d1e318cb1c2
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Adds matplotlib
Adds support for generating graphs showing performance results
Change-Id: Iba344baab89e35c0d5891a9d6b4c22c37666511e
JIRA: STORPERF-44
JIRA: STORPERF-50
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add Swagger web ui at /swagger
Add ability to fetch read/write latency status via ReST ui
Can now delete where stack was removed from OpenStack but not from the
storperf DB
Change to use Floating IPs instead of private IP
Fix delete bug where there was no dependency on resources in
the resource group.
JIRA: STORPERF-19
JIRA: STORPERF-20
Change-Id: I1d9627d81f3c309b178a9b68cc306a4101c1a231
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add Swagger web ui at /swagger
Add ability to fetch read/write latency status via ReST ui
Can now delete where stack was removed from OpenStack but not from the
storperf DB
Change to use Floating IPs instead of private IP
Fix delete bug where there was no dependency on resources in
the resource group.
JIRA: STORPERF-19
JIRA: STORPERF-20
Change-Id: I0a4b3386789c38d6745906ba896b8ff851dc122f
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Change the way slave jobs are managed so that they are in step
with each other, and we can track the overall thread that is
running them. This lays groundwork for STORPERF-20 and
STORPERF-44
JIRA: STORPERF-33 STORPERF-43
Change-Id: Iaff48a2823ba85d6512e9782fd9091a72639835c
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Run the tests in the verify command instead
of just merge so that way patches can be
rejected if tests fail
Change-Id: I8907618a324296460a71a51d087926f9089e0d21
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Fix the installation os setuptools so that it
does not conflict with mock.
Change-Id: I7c497d36c80a795fc99b329da2d171a265e4eacc
JIRA: STORPERF-35
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Add storperf master object to manage stack
lifecycle.
Add configuration db.
Creation of CLI vs. main so that ReST API
and CLI API can be kept clear.
Fixed License in files.
Changed DB objects to be thread safe.
Added ssh server to container if desired
for CLI.
Change-Id: Idfe84bfb7920e6ce19d27462593c21ea86e7b406
JIRA: STORPERF-29
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
|
|
Adding the ablity to define workloads in modules which can be
referenced from the API. Breaking out the test execution into
its own class so it will be easier to support ReST or other
interfaces.
Added flake8 and code coverage reports where possible to
merge and verify jobs
Change-Id: Ieb51e4e7e1e989288a6f81f4757709669914a196
JIRA: STORPERF-21
Signed-off-by: mbeierl <mark.beierl@emc.com>
|
|
Change-Id: I1e55290013f31272952f23869a02d68ca08cd4a7
JIRA: STORPERF-12
Signed-off-by: mbeierl <mark.beierl@emc.com>
|
|
Added verify, merge and daily jobs that will be
called automatically by Gerrit/LF Jenkins on
workflow change
Change-Id: I3ae85593b6aeac4a1a7abb51354b9cc6fa1fd813
JIRA: RELENG-41
Signed-off-by: Mark Beierl <mark@jemms.net>
|