summaryrefslogtreecommitdiffstats
path: root/docker/storperf-master/storperf
AgeCommit message (Collapse)AuthorFilesLines
2018-08-16Fixing series data.opnfv-7.0.stable.RC3mbeierl2-11/+16
Changes the min and max series to also contain the index to make plotting easier. Change-Id: Ifbb43658338d6389705e7f146fa1ca6e13c202ce Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-15Fixing Suprious Exceptionmbeierl1-0/+3
When the results are too small to calculate the slope, an exception is reported in the logs. This change avoids triggering the exception criteria. Change-Id: Iae886cde6244e9077ff94812bd830c48adaef365 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-02Calculate Data Seriesopnfv-7.0.stable.RC2mbeierl3-5/+75
Adds the min, max and actual slope values to the final report metrics so that end users do not have to calculate these values. Change-Id: Ic98ec5cbfcdf7447d2bffc46e9bd05e087c72965 JIRA: STORPERF-257 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-02Update Toolsmbeierl1-1/+1
Updates to latet tools and corrects non-pep8 compliance Change-Id: Ic1dd8e8ee9d3ac5360e53ed3578d631f4da28161 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-19Merge "Allow user to specify stack name on stack create"Mark Beierl3-12/+35
2018-07-18Allow user to specify stack name on stack createAmeed Ashour3-12/+35
this allow Storperf to run multiple time at same time using same OpenStack Adds stack_name to all /configurations API requests as an optional parameter. Adds stack_name to the /jobs API POST as an optional parameter. Adds stack_name to the /initializations API as an optional parameter. Adds all stack info to the metadata for later reporting. JIRA: STORPERF-256 Change-Id: Ief69c69472e08ee821555f3a006ab9edc7ec177f Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-17Tiding up post runmbeierl1-0/+1
Sometimes extra slave IPs are left behind in memory and deleting a job shows multiples of the same IP being cancelled. Change-Id: I7a1bd2f327a46a89fcb3df7e25356c946afb8262 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-16Allow user to specify subnet cidr on stack createopnfv-7.0.stable.RC1Ameed Ashour2-2/+18
Change-Id: If910ac18f405c98a0e1f48d38d338ad4f61f6004 JIRA: STORPERF-255 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-13Initialization APImbeierl1-2/+2
Adds a new API that performs initialization of the target filename or device instead of having to rely on the magic _warm_up workload name. Change-Id: Icb7ece05fb6190802df08f5a4aeeba62652757db JIRA: STORPERF-254 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-13Merge "Collect slave info"Mark Beierl2-1/+14
2018-07-12Collect slave infombeierl2-1/+14
Adds the output of uname -a to the metadata for each slave. Additional information about each slave can also be added as needed in the future. Change-Id: Ifb3d06599c0f1b7a4ffe06a7c98b151e62ba7bd8 JIRA: STORPERF-253 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-12Revert "Set self.stack_id = None after delete stack"Mark Beierl1-0/+4
This reverts commit 6114b084b3fd47e638172cbbe64c6ea9e627e66d. Change-Id: I089fbbf924a2c979e3cea619d8c5bc90820ff691 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-10Merge "Support Custom Workloads"Mark Beierl7-157/+295
2018-07-10Set self.stack_id = None after delete stackAmeed Ashour1-1/+6
Change-Id: I09ad953776804f17f5eedf296955ced51c5ed3a4 JIRA: STORPERF-251 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-06Support Custom Workloadsmbeierl7-157/+295
Refactors interaction with test_executor to clean up the tight coupling. Adds ability to specify custom workloads. Change-Id: Idbadcec1f42714e96c5f96d1e45c05982a531503 JIRA: STORPERF-246 Co-Authored-By: Ameed.Ashour.Ext@Nokia.com Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-05Adds volume_type supportmbeierl4-31/+85
Adds a new optional parameter, volume_type, to the configurations REST API, allowing the user to specify the volume type to create. Change-Id: I29b7bee442a5e1b6b98be439c06a58e3fd322943 JIRA: STORPERF-217 Co-Authored-By: Ameed.Ashour.Ext@Nokia.com Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-28Fixes daily runmbeierl1-1/+1
Change-Id: I8f17efe0d0866a3dc6ecbbabe07985b93ac445e6 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Use MultiThreaded SNAPSmbeierl1-7/+15
Take advantage of multiple threads in SNAPS to get info on the stack more quickly. Change-Id: Ifbfaec4fb6f1a4a322c327176c82200b5f69d874 JIRA: STORPERF-245 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Adds IP Addresses to Config APImbeierl1-5/+16
Uses the IP addresses of the VMs in the stack to populate a new slave_addresses field in the REST API. Change-Id: I363a4d118cf5c786f4faf8432ea884cb010c6db5 JIRA: STORPERF-239 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-05-10Adds Volume Count and Dynamic Reloadmbeierl6-33/+117
Adds a volume_count parameter that allows the user to change the number of volumes. Test execution still uses each volume specified and appends it to the host ip address in the graphite metrics. Changes the cache policy of the stack from SNAPS-OO so that changes made to the stack are refelcted in StorPerf. Fixes the documentation path and updates the docs for the above changes. Change-Id: I5b9160b469e80d4f7d6906ac270bb3b75411fb5a JIRA: STORPERF-242 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-04-05Fixing daily jobmbeierl1-7/+18
Use Ubuntu 16.04 instead as it is LTS and not subject to change Enhance error reporting on stack creation failure Change-Id: Ie187ae44ce66564da9779733a418fc8bb4e1c320 JIRA: STORPERF-240 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-02-05Updates for JOID Integrationmbeierl1-4/+13
Changes daily to use the script from JOID to fetch OS information. Adds more environment variables to the OSCreds. Change-Id: I8cc07f82d6cc1bb70987a29947cc4093e8a2ff56 JIRA: STORPERF-238 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-01-23Removes Configuration DBmbeierl2-227/+76
Removes the configuration DB from storperf_master and replaces it with direct calls to Heat. Allows for container to discover an existing stack if it already exists. Change-Id: I32e767d5173dbfd58aa1d2127a478a1d36392592 JIRA: STORPERF-236 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-01-11WIP - Use SNAPS to launch StorPerf StackTaseer Ahmed2-156/+57
Change-Id: I8857e6e0dd2bf9cd7c38cf18a7c239d7eb993d05 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-12-20Fixes Availability Zone Supportmbeierl3-4/+8
Fixes typo and passes the availability zone parameter through all the heat templates. Change-Id: I12d9d5d32ceb6461833fcfb4ea2961a34b97c35a JIRA: STORPERF-225 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-12-17Resolve error in fetching metricsShrenik1-1/+1
There seems to be an update in the json format used. The data is present at ['details']['metrics'] rather than ['metrics'] JIRA: STORPERF-229 Change-Id: I7c3ee319ef4a128c33f5e2a26e10b6ff03a471d3 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-11-06Merge "Prevent user from starting a second job while one is already running."Taseer Ahmed1-0/+6
2017-10-18Fixing daily jobmbeierl1-1/+6
Change-Id: I3ec92a7688106e7caa33be89926a7bea6b757596 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-17Improving Reportingmbeierl4-12/+14
Changes IOPS and BW to summation vs. average. Adds fixed 0 y axis to all graphs Change-Id: I3379597bda04b030424a25c7309a02c982fdb706 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-09Prevent user from starting a second job while one is already running.Taseer Ahmed1-0/+6
JIRA: STORPERF-214 Change-Id: I1fe7c0bc61dfa7899d39cee1d13f99b2435115cd Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-06Adding SSL Certificate Supportmbeierl1-4/+11
Change-Id: I4a45e5602afc3a1c303a44adc15c9ef94fe732bb Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-04Fixing test results.mbeierl1-8/+3
Change-Id: I13ea847491f2758fd2003c0b206ec7a1356f3fb2 JIRA: STORPERF-216 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-28Merge "Fix Test Results"Mark Beierl2-13/+18
2017-09-28Fix Test Resultsmbeierl2-13/+18
Updates the key/values that are sent to testresults db. Fixes the PASS/FAIL to ignore _warm_up job. Change-Id: I8af292cd764637cd12cbdb5a2a3e114fbeda5665 Signed-off-by: mbeierl <mark.beierl@dell.com> JIRA: STORPERF-216
2017-09-28Merge "Returns job id and status"Mark Beierl1-3/+12
2017-09-27Returns job id and statusTaseer Ahmed1-3/+12
- If the user GETs for job without ID and type status, return all jobs along with status JIRA: STORPERF-213 Change-Id: I5518acae45f259644c961c6dc9f0cb170b86b6e1 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-09-25Fixing Results DB Keysmbeierl1-2/+2
Update keys pushed to testresults DB so they match the expected values. JIRA: STORPERF-216 Change-Id: I837254fbfb2837d6abfc22d6d33878f60227480c Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-08Remove localhost from emitter.pyShrenik1-32/+30
emitter.py sends metrics to localhost and storperf-graphite. Since no graphite module is present at localhost, it needs to be removed from emitter as well. JIRA: STORPERF-205 Change-Id: I0d5732160ff39a332b088c8ba540ca6f6a483e12 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-09-06Fix Job Status Reportmbeierl1-81/+90
Changes the loop for creating job status and list of job workloads to run down to a single function instead of two loops. Uses single function to drive both status and job workloads to execute. Change-Id: Ia173b8450a857d032a862d03c62bfc1b248583da JIRA: STORPERF-186 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-09-01Support for different agent OSTaseer Ahmed4-18/+93
JIRA: STORPERF-175 Change-Id: I64d13c77c18dd129a79dde3bf9a8bc996019bff5 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-08-28Standardize Outputmbeierl4-87/+78
Re-arrange the JSON output so that it matches the format that gets sent and retrieved from the testresults db. Change-Id: I9f15e553e94b27b9e5a36f4984789c5e710feac4 JIRA: STORPERF-200 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-08-23Graphite Standalone containerShrenik6-70/+120
A new Graphite container is used Metrics are sent to both Graphite instances However, it seems that some metrics might be missing This is however a direct plugin. There are differences in carbon.conf, storage-schemas.conf and other files as well. It is suggested to write own Dockerfile instead of using the image available. We anyway have to do it with respect ARM Support. Change-Id: Id34c728f598150caac23ac167c3cce5eaf183a6c JIRA: STORPERF-142 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in> Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-08-20REST API for logsTaseer Ahmed1-0/+17
JIRA: STORPERF-94 Change-Id: I59189109d7f731977fc682b3fb78e60bc92a8270 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-08-02Update FIO versionmbeierl1-1/+1
Updates FIO to 2.99, and changes metric from 'lat' to 'lat_ns'. Change-Id: Ib46cc2fe10c7b7577ee0eaa9cb4805e0dda4bde2 JIRA: STORPERF-197 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-07-27Add availability zone option to launch agent.Taseer Ahmed2-0/+17
JIRA: STORPERF-178 Change-Id: I1a5c1a0d1c3b700a0858f644b01553bf0b5675de Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-07-25Switch Container Base to Alpinembeierl1-11/+0
Changes the base of StorPerf master docker container to be Alpine based. Compiles FIO statically so no runtime libraries need to be copied to the target VM, just FIO. Change-Id: Ia66dc11442211fc5248103a9f955f48f3186b322 JIRA: STORPERF-174 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-07-24Merge "Returns all job ID's if queried without ID."Mark Beierl2-0/+16
2017-07-25Returns all job ID's if queried without ID.Taseer2-0/+16
JIRA: STORPERF-184 Change-Id: I631b4adbd830420a3b502e4f2a86a66824c87fcd Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-07-20Restore Proper Loggingmbeierl1-51/+0
Puts the logging.json file back into the correct path so that the rest_server.py initializes the logging system correctly. Adds the missing 'TAG=latest' to the documentation. Change-Id: Id9caba86f6470136a7fe128a2fe1fb520133fc0b JIRA: STORPERF-191 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-07-13Add reason for stack creation failureTaseer1-0/+1
JIRA: STORPERF-180 Change-Id: Ic10f5d96ed0d7b38ccd21b59a68b1ccec403023c Signed-off-by: Taseer Ahmed <taseer94@gmail.com>