summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-11-09Race condition in job executembeierl2-4/+2
Fixes a problem in job execution where the stack is not checked for slave IP addresses if it is still cached. Change-Id: Ie5719b233e86474b17f6ff04c6b47f8110afcc6d Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-11-09Fix Daily Jobsmbeierl1-7/+3
Update the current set of modules used by the daily job as the previous versions do not work anymore Change-Id: I791cce982668e00460f82388a5cbca48fcd249ea Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-11-05Merge "Add Stackless Support"Mark Beierl10-83/+558
2018-10-29Add Stackless Supportmbeierl10-83/+558
Adds ability to specify IP address list instead of looking up full list from OpenStack Heat. Adds stackless mode to bypass OpenStack heat altogether if we are running against bare metal or other nodes that are not under Heat's domain. Adds ability to create filesystems and mount them for profiling. Adds number of jobs and number of files to create to the initializations API so we can lay down files and fill them with random data ahead of the actual performance run. Change-Id: Ia787f8b863bc92b38dd29b3cf17eda0d48f3bcd5 JIRA: STORPERF-265 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-10-23Support Ocata release in Storperf HOT filesAmeed Ashour3-3/+3
JIRA: STORPERF-264 Change-Id: I826d0e3dff7ed8cd54f7e163bb678d367eeefd95 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-10-22Merge "Additional documentation"Mark Beierl1-6/+190
2018-10-16Additional documentationmbeierl1-6/+190
Change-Id: I9b176794206e39db436d9597d976c42b7e9d22cf Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-10-15Proper Job Metricsmbeierl2-3/+4
Uses all FIO jobs, not just job.1 when calculating metrics. Fixes bug when multiple volumes are created, but thread gate is not big enough. Change-Id: I473b2d19848c6ebc15e7669d84fade52d10fb97d JIRA: STORPERF-263 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-09-25Merge "Local Documentation Builds"Mark Beierl6-4/+28
2018-09-18Local Documentation BuildsAric Gardner6-4/+28
This adds configuration for performing local documentation builds with the following simple command: tox -e docs Change-Id: I8d7b3af60c12f4d426e3d6fc64eae66b356d94a6 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-09-14Fix links to remove references to submodulesAric Gardner2-2/+2
All references to submodules must be removed for docs to work going forward. Can be tested once your project has a local tox file Change-Id: I93cbb1a71696a9c8f8d8a5dd27b800521bb8c84f Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-08-17Fix 3rd_party link in reportingopnfv-7.0.stable.RC4Shrenik1-2/+2
Updates links to 3rd party resources in reporting module. This fixes graphs not being generated. Change-Id: I8bdb37f3b6948bc2fd09a8cf3d0b0f1588cafaf0 JIRA: STORPERF-258 Signed-off-by: Shrenik <shrenik.jain@research.iiit.ac.in>
2018-08-16Fixing series data.opnfv-7.0.stable.RC3mbeierl3-25/+20
Changes the min and max series to also contain the index to make plotting easier. Change-Id: Ifbb43658338d6389705e7f146fa1ca6e13c202ce Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-15Fixing Suprious Exceptionmbeierl2-0/+8
When the results are too small to calculate the slope, an exception is reported in the logs. This change avoids triggering the exception criteria. Change-Id: Iae886cde6244e9077ff94812bd830c48adaef365 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-02Calculate Data Seriesopnfv-7.0.stable.RC2mbeierl6-6/+145
Adds the min, max and actual slope values to the final report metrics so that end users do not have to calculate these values. Change-Id: Ic98ec5cbfcdf7447d2bffc46e9bd05e087c72965 JIRA: STORPERF-257 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-02Update Toolsmbeierl3-9/+11
Updates to latet tools and corrects non-pep8 compliance Change-Id: Ic1dd8e8ee9d3ac5360e53ed3578d631f4da28161 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-19Merge "Allow user to specify stack name on stack create"Mark Beierl5-22/+118
2018-07-18Allow user to specify stack name on stack createAmeed Ashour5-22/+118
this allow Storperf to run multiple time at same time using same OpenStack Adds stack_name to all /configurations API requests as an optional parameter. Adds stack_name to the /jobs API POST as an optional parameter. Adds stack_name to the /initializations API as an optional parameter. Adds all stack info to the metadata for later reporting. JIRA: STORPERF-256 Change-Id: Ief69c69472e08ee821555f3a006ab9edc7ec177f Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-17Tiding up post runmbeierl2-0/+3
Sometimes extra slave IPs are left behind in memory and deleting a job shows multiples of the same IP being cancelled. Change-Id: I7a1bd2f327a46a89fcb3df7e25356c946afb8262 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-16Allow user to specify subnet cidr on stack createopnfv-7.0.stable.RC1Ameed Ashour3-2/+23
Change-Id: If910ac18f405c98a0e1f48d38d338ad4f61f6004 JIRA: STORPERF-255 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-16Allow multiple initializesmbeierl1-0/+1
Fixes a bug where custom workloads could take priority over the initialization API and the warm up does not actually work Change-Id: I984fc8d5e8e2871bb7f4420924efe38e2608cb4d Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-13Initialization APImbeierl4-20/+84
Adds a new API that performs initialization of the target filename or device instead of having to rely on the magic _warm_up workload name. Change-Id: Icb7ece05fb6190802df08f5a4aeeba62652757db JIRA: STORPERF-254 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-13Merge "Collect slave info"Mark Beierl2-1/+14
2018-07-12Collect slave infombeierl2-1/+14
Adds the output of uname -a to the metadata for each slave. Additional information about each slave can also be added as needed in the future. Change-Id: Ifb3d06599c0f1b7a4ffe06a7c98b151e62ba7bd8 JIRA: STORPERF-253 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-12Revert "Set self.stack_id = None after delete stack"Mark Beierl1-0/+4
This reverts commit 6114b084b3fd47e638172cbbe64c6ea9e627e66d. Change-Id: I089fbbf924a2c979e3cea619d8c5bc90820ff691 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-12Revert FIO to 2.99mbeierl1-1/+1
Change-Id: I14cd60f7d359666a403b4535824d0c9b8a05df34 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-10Merge "Support Custom Workloads"Mark Beierl10-176/+486
2018-07-10Merge "Set self.stack_id = None after delete stack"Mark Beierl1-1/+6
2018-07-10Set self.stack_id = None after delete stackAmeed Ashour1-1/+6
Change-Id: I09ad953776804f17f5eedf296955ced51c5ed3a4 JIRA: STORPERF-251 Signed-off-by: Ameed Ashour <Ameed.Ashour.ext@nokia.com>
2018-07-09Switch to upstream nginxmbeierl2-169/+2
Uses the official upstream nginx container image instead of building a custom one to support ARM (aarch64). Uses the official upstream node image instead of building a customer one for ARM. Change-Id: Ib465333204d3f1718da8cfb314cad32d955a3d2b JITA: STORPERF-250 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-06Support Custom Workloadsmbeierl10-176/+486
Refactors interaction with test_executor to clean up the tight coupling. Adds ability to specify custom workloads. Change-Id: Idbadcec1f42714e96c5f96d1e45c05982a531503 JIRA: STORPERF-246 Co-Authored-By: Ameed.Ashour.Ext@Nokia.com Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-05Adds volume_type supportmbeierl7-40/+101
Adds a new optional parameter, volume_type, to the configurations REST API, allowing the user to specify the volume type to create. Change-Id: I29b7bee442a5e1b6b98be439c06a58e3fd322943 JIRA: STORPERF-217 Co-Authored-By: Ameed.Ashour.Ext@Nokia.com Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-28Update release notesmbeierl1-11/+12
Change-Id: I41ae2a5730684056e6854f22201544c5c486bd3e Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-28Fixes daily runmbeierl3-3/+2
Change-Id: I8f17efe0d0866a3dc6ecbbabe07985b93ac445e6 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Use MultiThreaded SNAPSmbeierl1-7/+15
Take advantage of multiple threads in SNAPS to get info on the stack more quickly. Change-Id: Ifbfaec4fb6f1a4a322c327176c82200b5f69d874 JIRA: STORPERF-245 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Adds IP Addresses to Config APImbeierl2-6/+20
Uses the IP addresses of the VMs in the stack to populate a new slave_addresses field in the REST API. Change-Id: I363a4d118cf5c786f4faf8432ea884cb010c6db5 JIRA: STORPERF-239 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-06-26Speed up Buildsmbeierl5-3/+16
Adding a new keyserver and ulimit to help speed up builds. Change-Id: If79ba1e533bfe2044606d98047abe9fa342aefb4 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-05-17Merge "Nomination of Shrenik as Committer"Mark Beierl1-0/+4
2018-05-11Merge "Adds Volume Count and Dynamic Reload"Mark Beierl16-114/+310
2018-05-10Nomination of Shrenik as Committermbeierl1-0/+4
Change-Id: Ia114f41816f73af3fb9312b76e970aff25df21c9 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-05-10Merge "Auto Generated INFO.yaml file"Mark Beierl1-0/+61
2018-05-10Auto Generated INFO.yaml fileagardner1-0/+61
INFO.yaml meant to be machine readable. This file was auto generated from an ldap lookup and your projects INFO file Meeting times are not currently filled out. please ammend this patchset to complete Going forward comitter promotions should be done against this file. PTLs: Must be merged for you to gain delete access on testresults.opnfv.org If project_lead: is missing (my script could not parse) please amend with same from commiters section eg: project_lead: &opnfv_$project_ptl name: 'Lead Name' email: 'lead email' id: 'lead lfid' company: 'lead company' Change-Id: I8b7d209deacfb26e2869ef9b24a2df812be1a5be Signed-off-by: agardner <agardner@linuxfoundation.org>
2018-05-10Adds Volume Count and Dynamic Reloadmbeierl16-114/+310
Adds a volume_count parameter that allows the user to change the number of volumes. Test execution still uses each volume specified and appends it to the host ip address in the graphite metrics. Changes the cache policy of the stack from SNAPS-OO so that changes made to the stack are refelcted in StorPerf. Fixes the documentation path and updates the docs for the above changes. Change-Id: I5b9160b469e80d4f7d6906ac270bb3b75411fb5a JIRA: STORPERF-242 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-04-18Update release notesTaseer Ahmed1-31/+10
Change-Id: Ifc4742dd43a267e6319f5c5a9eb66ed7de49aaa4 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2018-04-12Marking 3rd Party Softwarembeierl13-38/+38
Move all non Apache2.0/CC-BY-4.0 licensed files into a 3rd_party directory Change-Id: I4172063500f8bb2fa3ac767d1be8c6c5cf12aa7b JIRA: STORPERF-241 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-04-05Fixing daily jobmbeierl3-12/+29
Use Ubuntu 16.04 instead as it is LTS and not subject to change Enhance error reporting on stack creation failure Change-Id: Ie187ae44ce66564da9779733a418fc8bb4e1c320 JIRA: STORPERF-240 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-02-05Nomination of Shrenik Jain as commitermbeierl1-0/+1
Change-Id: Ia0ef7b449d2cf8214ef8f0e535d58c719a93d909 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-02-05Updates for JOID Integrationmbeierl3-14/+24
Changes daily to use the script from JOID to fetch OS information. Adds more environment variables to the OSCreds. Change-Id: I8cc07f82d6cc1bb70987a29947cc4093e8a2ff56 JIRA: STORPERF-238 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-01-23Removes Configuration DBmbeierl4-320/+76
Removes the configuration DB from storperf_master and replaces it with direct calls to Heat. Allows for container to discover an existing stack if it already exists. Change-Id: I32e767d5173dbfd58aa1d2127a478a1d36392592 JIRA: STORPERF-236 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-01-11Merge "WIP - Use SNAPS to launch StorPerf Stack"Mark Beierl7-180/+87