summaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2019-12-20Add Agent PortMark Beierl6-12/+129
Allows the port number to be added to the IP addresses used for initiating worklaods. This is done specifically for containerized workload where the exposed port might need to be specified per workload agent to allow multiple agents to run on the same host. STORPERF-270 Change-Id: If011e686d89e5667509ca57e25f05fba1ed52ed1 Signed-off-by: Mark Beierl <mbeierl@vmware.com>
2019-12-17Sunset stack supportMark Beierl1-11/+33
Adds sunset marker to all stack related calls. STORPERF-269 Change-Id: I79108104c5bf52d253a52eadf4173e95324ea057 Signed-off-by: Mark Beierl <mbeierl@vmware.com>
2019-12-17Update to Python3Mark Beierl18-76/+91
Updates to make StorPerf Python3 compatible, including pulling in SNAPS-OO as python3. Change-Id: Ie4e7af684bd5a1b8db086893848b1889da6308ba JIRA: STORPERF-268 Signed-off-by: Mark Beierl <mbeierl@vmware.com>
2018-11-09Race condition in job executembeierl2-4/+2
Fixes a problem in job execution where the stack is not checked for slave IP addresses if it is still cached. Change-Id: Ie5719b233e86474b17f6ff04c6b47f8110afcc6d Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-11-05Merge "Add Stackless Support"Mark Beierl7-56/+279
2018-10-29Add Stackless Supportmbeierl7-56/+279
Adds ability to specify IP address list instead of looking up full list from OpenStack Heat. Adds stackless mode to bypass OpenStack heat altogether if we are running against bare metal or other nodes that are not under Heat's domain. Adds ability to create filesystems and mount them for profiling. Adds number of jobs and number of files to create to the initializations API so we can lay down files and fill them with random data ahead of the actual performance run. Change-Id: Ia787f8b863bc92b38dd29b3cf17eda0d48f3bcd5 JIRA: STORPERF-265 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-10-23Support Ocata release in Storperf HOT filesAmeed Ashour3-3/+3
JIRA: STORPERF-264 Change-Id: I826d0e3dff7ed8cd54f7e163bb678d367eeefd95 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-10-15Proper Job Metricsmbeierl2-3/+4
Uses all FIO jobs, not just job.1 when calculating metrics. Fixes bug when multiple volumes are created, but thread gate is not big enough. Change-Id: I473b2d19848c6ebc15e7669d84fade52d10fb97d JIRA: STORPERF-263 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-17Fix 3rd_party link in reportingopnfv-7.0.stable.RC4Shrenik1-2/+2
Updates links to 3rd party resources in reporting module. This fixes graphs not being generated. Change-Id: I8bdb37f3b6948bc2fd09a8cf3d0b0f1588cafaf0 JIRA: STORPERF-258 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2018-08-16Fixing series data.opnfv-7.0.stable.RC3mbeierl3-25/+20
Changes the min and max series to also contain the index to make plotting easier. Change-Id: Ifbb43658338d6389705e7f146fa1ca6e13c202ce Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-15Fixing Suprious Exceptionmbeierl2-0/+8
When the results are too small to calculate the slope, an exception is reported in the logs. This change avoids triggering the exception criteria. Change-Id: Iae886cde6244e9077ff94812bd830c48adaef365 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-02Calculate Data Seriesopnfv-7.0.stable.RC2mbeierl5-5/+145
Adds the min, max and actual slope values to the final report metrics so that end users do not have to calculate these values. Change-Id: Ic98ec5cbfcdf7447d2bffc46e9bd05e087c72965 JIRA: STORPERF-257 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-02Update Toolsmbeierl2-2/+4
Updates to latet tools and corrects non-pep8 compliance Change-Id: Ic1dd8e8ee9d3ac5360e53ed3578d631f4da28161 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-19Merge "Allow user to specify stack name on stack create"Mark Beierl4-21/+117
2018-07-18Allow user to specify stack name on stack createAmeed Ashour4-21/+117
this allow Storperf to run multiple time at same time using same OpenStack Adds stack_name to all /configurations API requests as an optional parameter. Adds stack_name to the /jobs API POST as an optional parameter. Adds stack_name to the /initializations API as an optional parameter. Adds all stack info to the metadata for later reporting. JIRA: STORPERF-256 Change-Id: Ief69c69472e08ee821555f3a006ab9edc7ec177f Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-17Tiding up post runmbeierl2-0/+3
Sometimes extra slave IPs are left behind in memory and deleting a job shows multiples of the same IP being cancelled. Change-Id: I7a1bd2f327a46a89fcb3df7e25356c946afb8262 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-16Allow user to specify subnet cidr on stack createopnfv-7.0.stable.RC1Ameed Ashour3-2/+23
Change-Id: If910ac18f405c98a0e1f48d38d338ad4f61f6004 JIRA: STORPERF-255 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-16Allow multiple initializesmbeierl1-0/+1
Fixes a bug where custom workloads could take priority over the initialization API and the warm up does not actually work Change-Id: I984fc8d5e8e2871bb7f4420924efe38e2608cb4d Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-13Initialization APImbeierl3-11/+73
Adds a new API that performs initialization of the target filename or device instead of having to rely on the magic _warm_up workload name. Change-Id: Icb7ece05fb6190802df08f5a4aeeba62652757db JIRA: STORPERF-254 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-13Merge "Collect slave info"Mark Beierl2-1/+14
2018-07-12Collect slave infombeierl2-1/+14
Adds the output of uname -a to the metadata for each slave. Additional information about each slave can also be added as needed in the future. Change-Id: Ifb3d06599c0f1b7a4ffe06a7c98b151e62ba7bd8 JIRA: STORPERF-253 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-12Revert "Set self.stack_id = None after delete stack"Mark Beierl1-0/+4
This reverts commit 6114b084b3fd47e638172cbbe64c6ea9e627e66d. Change-Id: I089fbbf924a2c979e3cea619d8c5bc90820ff691 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-12Revert FIO to 2.99mbeierl1-1/+1
Change-Id: I14cd60f7d359666a403b4535824d0c9b8a05df34 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-10Merge "Support Custom Workloads"Mark Beierl9-163/+388
2018-07-10Merge "Set self.stack_id = None after delete stack"Mark Beierl1-1/+6
2018-07-10Set self.stack_id = None after delete stackAmeed Ashour1-1/+6
Change-Id: I09ad953776804f17f5eedf296955ced51c5ed3a4 JIRA: STORPERF-251 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-09Switch to upstream nginxmbeierl2-169/+2
Uses the official upstream nginx container image instead of building a custom one to support ARM (aarch64). Uses the official upstream node image instead of building a customer one for ARM. Change-Id: Ib465333204d3f1718da8cfb314cad32d955a3d2b JITA: STORPERF-250 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-06Support Custom Workloadsmbeierl9-163/+388
Refactors interaction with test_executor to clean up the tight coupling. Adds ability to specify custom workloads. Change-Id: Idbadcec1f42714e96c5f96d1e45c05982a531503 JIRA: STORPERF-246 Co-Authored-By: Ameed.Ashour.Ext@Nokia.com Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-05Adds volume_type supportmbeierl7-40/+101
Adds a new optional parameter, volume_type, to the configurations REST API, allowing the user to specify the volume type to create. Change-Id: I29b7bee442a5e1b6b98be439c06a58e3fd322943 JIRA: STORPERF-217 Co-Authored-By: Ameed.Ashour.Ext@Nokia.com Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-28Fixes daily runmbeierl1-1/+1
Change-Id: I8f17efe0d0866a3dc6ecbbabe07985b93ac445e6 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Use MultiThreaded SNAPSmbeierl1-7/+15
Take advantage of multiple threads in SNAPS to get info on the stack more quickly. Change-Id: Ifbfaec4fb6f1a4a322c327176c82200b5f69d874 JIRA: STORPERF-245 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Adds IP Addresses to Config APImbeierl2-6/+20
Uses the IP addresses of the VMs in the stack to populate a new slave_addresses field in the REST API. Change-Id: I363a4d118cf5c786f4faf8432ea884cb010c6db5 JIRA: STORPERF-239 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Speed up Buildsmbeierl5-3/+16
Adding a new keyserver and ulimit to help speed up builds. Change-Id: If79ba1e533bfe2044606d98047abe9fa342aefb4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-05-10Adds Volume Count and Dynamic Reloadmbeierl8-42/+134
Adds a volume_count parameter that allows the user to change the number of volumes. Test execution still uses each volume specified and appends it to the host ip address in the graphite metrics. Changes the cache policy of the stack from SNAPS-OO so that changes made to the stack are refelcted in StorPerf. Fixes the documentation path and updates the docs for the above changes. Change-Id: I5b9160b469e80d4f7d6906ac270bb3b75411fb5a JIRA: STORPERF-242 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-04-12Marking 3rd Party Softwarembeierl13-38/+38
Move all non Apache2.0/CC-BY-4.0 licensed files into a 3rd_party directory Change-Id: I4172063500f8bb2fa3ac767d1be8c6c5cf12aa7b JIRA: STORPERF-241 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-04-05Fixing daily jobmbeierl2-7/+19
Use Ubuntu 16.04 instead as it is LTS and not subject to change Enhance error reporting on stack creation failure Change-Id: Ie187ae44ce66564da9779733a418fc8bb4e1c320 JIRA: STORPERF-240 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-02-05Updates for JOID Integrationmbeierl1-4/+13
Changes daily to use the script from JOID to fetch OS information. Adds more environment variables to the OSCreds. Change-Id: I8cc07f82d6cc1bb70987a29947cc4093e8a2ff56 JIRA: STORPERF-238 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-01-23Removes Configuration DBmbeierl4-320/+76
Removes the configuration DB from storperf_master and replaces it with direct calls to Heat. Allows for container to discover an existing stack if it already exists. Change-Id: I32e767d5173dbfd58aa1d2127a478a1d36392592 JIRA: STORPERF-236 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-01-11WIP - Use SNAPS to launch StorPerf StackTaseer Ahmed5-159/+78
Change-Id: I8857e6e0dd2bf9cd7c38cf18a7c239d7eb993d05 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-12-20Fixes Availability Zone Supportmbeierl4-6/+10
Fixes typo and passes the availability zone parameter through all the heat templates. Change-Id: I12d9d5d32ceb6461833fcfb4ea2961a34b97c35a JIRA: STORPERF-225 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-12-17Resolve error in fetching metricsShrenik1-1/+1
There seems to be an update in the json format used. The data is present at ['details']['metrics'] rather than ['metrics'] JIRA: STORPERF-229 Change-Id: I7c3ee319ef4a128c33f5e2a26e10b6ff03a471d3 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2017-12-07Update pip requirementsTaseer Ahmed1-1/+1
Change-Id: I3d4566e1f2a7893ff9a52179ac4a897fcb53ac18 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-11-11Add SNAPS as a pip requirementTaseer Ahmed1-7/+1
- Remove common OpenStack requirements - Will result in conflicts - Use SNAPS built from master branch JIRA: STORPERF-227 Change-Id: Ie4facfa092bafefe15168042fb94ea7ff9bac7d0 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-11-06Merge "Prevent user from starting a second job while one is already running."Taseer Ahmed1-0/+6
2017-11-06Merge "User Interface for homepage"Taseer Ahmed2-1/+43
2017-10-18Fixing daily jobmbeierl1-1/+6
Change-Id: I3ec92a7688106e7caa33be89926a7bea6b757596 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-17Improving Reportingmbeierl7-37/+52
Changes IOPS and BW to summation vs. average. Adds fixed 0 y axis to all graphs Change-Id: I3379597bda04b030424a25c7309a02c982fdb706 Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-09Prevent user from starting a second job while one is already running.Taseer Ahmed1-0/+6
JIRA: STORPERF-214 Change-Id: I1fe7c0bc61dfa7899d39cee1d13f99b2435115cd Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-10-06Adding SSL Certificate Supportmbeierl1-4/+11
Change-Id: I4a45e5602afc3a1c303a44adc15c9ef94fe732bb Signed-off-by: mbeierl <mark.beierl@dell.com>
2017-10-04Fixing test results.mbeierl1-8/+3
Change-Id: I13ea847491f2758fd2003c0b206ec7a1356f3fb2 JIRA: STORPERF-216 Signed-off-by: mbeierl <mark.beierl@dell.com>