<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <title>OPNFV presentation</title> <meta name="description" content="Conversation with the Testing community"> <meta name="author" content="M.Richomme, ...."> <meta name="apple-mobile-web-app-capable" content="yes" /> <meta name="apple-mobile-web-app-status-bar-style" content="black-translucent" /> <meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no, minimal-ui"> <link rel="stylesheet" href="../css/reveal.css"> <link rel="stylesheet" href="../css/theme/OPNFV-Berlin.css" id="theme"> <!-- Code syntax highlighting --> <link rel="stylesheet" href="../lib/css/zenburn.css"> <!-- Printing and PDF exports --> <script> var link = document.createElement( 'link' ); link.rel = 'stylesheet'; link.type = 'text/css'; link.href = window.location.search.match( /print-pdf/gi ) ? '../css/print/pdf.css' : '../css/print/paper.css'; document.getElementsByTagName( 'head' )[0].appendChild( link ); </script> <!--[if lt IE 9]> <script src="lib/js/html5shiv.js"></script> <![endif]--> </head> <body> <div class="reveal"> <!-- Any section element inside of this container is displayed as a slide --> <div class="slides"> <section data-background="../img/title-bg-berlin.png" data-background-transition="none"> <br><br><br><br><br> <h1>Conversation with the Testing Community</h1> <br><br> <h4>OPNFV testing community</h4> <h5>OPNFV Design Summit, 20/6/2016, Berlin</h5> <br> </section> <section data-markdown> >“You make experiments and I make theories. Do you know the difference? A theory is something nobody believes, except the person who made it. An experiment is something everybody believes, except the person who made it." A.Einstein </section> <section data-markdown> # Agenda * Who are we? * Upstream, Upstream, Upstream * Towards Telco Cloud KPI </section> <section data-markdown> # Who are we? ![team](../img/OPNFV_testing_group.png) This is a representation...not a governance! </section> <section> <section> <h3>The test projects</h3> <table> <thead> <tr> <th>Test case</th> <th>Description</th> </tr> </thead> <tbody> <tr> <td>Functest</td> <td>Umbrella project for Functional testing</td> </tr> <tr> <td>Yardstick</td> <td>Umbrella project for performance/qualification testing</td> </tr> <tr> <td>CPerf</td> <td>SDN controller performance testing</td> </tr> <tr> <td>StorPerf</td> <td>Storage performance testing</td> </tr> <tr> <td>VSPerf</td> <td>VSwitch qualification</td> </tr> <tr> <td>Bottlenecks</td> <td>Detect possible bottlenecks</td> </tr> <tr> <td>QTIP</td> <td>Benchmark to boost performance</td> </tr> </tbody> </table> </section> <section data-markdown> # Functest * Functional testing to validate scenarios * Contributors (raise your hands) * Functest presentation (here...1h ago :)) * breakout sessions * Today 3.10PM-3.40PM (vIMS evolution) 4PM (feature project integration), 5PM (Colorado status) * tomorrow 11AM (API, test collection), 1PM (work Upstream), 3.15PM (D Release)(to be confirmed...) </section> <section data-markdown> # Yardstick * Performance testing framework and NFVI Validation * [Contributors](https://wiki.opnfv.org/display/yardstick/People) * Yardstick presentation * How to Do a Pre-deployment NFVI Validation Quickly and Efficiently? Wednesday, June 22, 4:00 PM - 4:30 PM * Yardstick: A Pre-deployment NFVI Validation Tool. Thursday, June 23, 3:10 PM - 3:30 PM * breakout sessions * Tomorrow 2PM (Yardstick in C) </section> <section data-markdown> # CPerf * SDN Controller Performance Testing * Upstream test experts + standards/metrics experts * Goal: Cross-controller perf tests in CI against realistic deployments </section> <section data-markdown> # StorPerf * Cinder Volume Performance Testing * Based on SNIA's SSD Test Specification * Presentation * StorPerf: Cinder Storage Performance Measurement. Wednesday, June 22, 3:40 PM - 3:55 PM * Breakout Session * Tomorrow 10:15 (StorPerf Test Results Working Session) </section> <section data-markdown> # VSPerf </section> <section data-markdown> # Bottlenecks </section> <section data-markdown> # QTIP ## OPNFV Platform Benchmark - Bottom up - testing baremetal components first - More than result - comparing against reference - Setup-Test-Diagnose-Improve - a closed loop to boost platform performance ## Breakout session - 14:30~15:45, June 21st/Tuesday - Room Tegel </section> </section> <section> <section data-markdown> # Upstream, upstream, upstream.. </section> <section data-markdown> ## We are on the shoulders of the giants * Rally (OpenStack) * ODL, ONOS, ... * RobotFramework, Teston * ..... </section> <section data-markdown> ## Time to give back ### How to improve work with testing upstream community </section> </section> <section> <section data-markdown> # Towards Telco Cloud KPI? </section> <section data-markdown> # Testing group goals * Define common needs (naming, rules, tools...) * Unify result collection, reporting, dashboarding, documentation * Share best practice: docker, CLI, .. * Identify testing domains * Encourage testing in poorly covered areas </section> <section data-markdown> # The ultimate goal: define Telco Cloud KPIs * Provide methodology and test suites to qualify a Telco Cloud * Provide reference benchs for plugfest/third party integration: compare apple with apple </section> </section> <section data-markdown> # Thank you </section> </div> <div class='footer'> <img src="../img/logo-OPNFV-Berlin.png" alt="OPNFV logo"> </div> </div> <script src="../lib/js/head.min.js"></script> <script src="../js/reveal.js"></script> <script> // Full list of configuration options available at: // https://github.com/hakimel/reveal.js#configuration Reveal.initialize({ controls: true, progress: true, history: true, center: true, transition: 'slide', // none/fade/slide/convex/concave/zoom // Optional reveal.js plugins dependencies: [ { src: '../lib/js/classList.js', condition: function() { return !document.body.classList; } }, { src: '../plugin/markdown/marked.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } }, { src: '../plugin/markdown/markdown.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } }, { src: '../plugin/highlight/highlight.js', async: true, condition: function() { return !!document.querySelector( 'pre code' ); }, callback: function() { hljs.initHighlightingOnLoad(); } }, { src: '../plugin/zoom-js/zoom.js', async: true }, { src: '../plugin/notes/notes.js', async: true } ] }); </script> </body> </html>