##############################################################################
# Copyright (c) 2017 Huawei Technologies Co.,Ltd and others.
#
# All rights reserved. This program and the accompanying materials
# are made available under the terms of the Apache License, Version 2.0
# which accompanies this distribution, and is available at
# http://www.apache.org/licenses/LICENSE-2.0
##############################################################################
---
schema: "yardstick:task:0.1"
description: >
Yardstick TC084 config file;
Measure CPU performance using SPEC CPU2006 in Virtual machines;
{% set provider = provider or none %}
{% set physical_network = physical_network or 'physnet1' %}
{% set segmentation_id = segmentation_id or none %}
{% set benchmark = benchmark or 'int' %}
{% set runspec_iterations = runspec_iterations or 1 %}
{% set runspec_tune = run<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>OPNFV presentation</title>
<meta name="description" content="Conversation with the Testing community">
<meta name="author" content="OPNFV Testing Worjing Group">
<meta name="apple-mobile-web-app-capable" content="yes" />
<meta name="apple-mobile-web-app-status-bar-style" content="black-translucent" />
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no, minimal-ui">
<link rel="stylesheet" href="../../reveal.js/css/reveal.css">
<link rel="stylesheet" href="../../../css/theme/OPNFV-Berlin.css" id="theme">
<!-- Code syntax highlighting -->
<link rel="stylesheet" href="../../reveal.js/lib/css/zenburn.css">
<!-- Printing and PDF exports -->
<script>
var link = document.createElement( 'link' );
link.rel = 'stylesheet';
link.type = 'text/css';
link.href = window.location.search.match( /print-pdf/gi ) ? '../../reveal.js/css/print/pdf.css' : '../../reveal.js/css/print/paper.css';
document.getElementsByTagName( 'head' )[0].appendChild( link );
</script>
<!--[if lt IE 9]>
<script src="lib/js/html5shiv.js"></script>
<![endif]-->
</head>
<body>
<div class="reveal">
<!-- Any section element inside of this container is displayed as a slide -->
<div class="slides">
<section data-background="../../../img/title-bg-berlin.png" data-background-transition="none">
<br><br><br><br><br>
<h1>Conversation with the Testing Community</h1>
<br><br>
<h4>OPNFV testing community</h4>
<h5>OPNFV Design Summit, 20/6/2016, Berlin</h5>
<br>
</section>
<section data-markdown>
>“You make experiments and I make theories. Do you know the difference? A theory is something nobody believes, except the person who made it. An experiment is something everybody believes, except the person who made it." A.Einstein
</section>
<section data-markdown>
# Agenda
* Who are we?
* Upstream, Upstream, Upstream
* Towards Telco Cloud KPI
</section>
<section data-markdown>
# Who are we?
This is a representation...not a governance!
</section>
<section>
<section>
<h3>The test projects</h3>
<table>
<thead>
<tr>
<th>Test case</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td>Functest</td>
<td>Umbrella project for Functional testing</td>
</tr>
<tr>
<td>Yardstick</td>
<td>Umbrella project for performance/qualification testing</td>
</tr>
<tr>
<td>CPerf</td>
<td>SDN controller performance testing</td>
</tr>
<tr>
<td>StorPerf</td>
<td>Storage performance testing</td>
</tr>
<tr>
<td>VSPerf</td>
<td>VSwitch qualification</td>
</tr>
<tr>
<td>Bottlenecks</td>
<td>Detect possible bottlenecks</td>
</tr>
<tr>
<td>QTIP</td>
<td>Benchmark to boost performance</td>
</tr>
</tbody>
</table>
</section>
<section data-markdown>
# Functest
* Functional testing to validate scenarios
* Contributors (raise your hands)
* Functest presentation (here...1h ago :))
* breakout sessions
* Today 3.10PM-3.40PM (vIMS evolution) 4PM (feature project integration), 5PM (Colorado status)
* tomorrow 11AM (API, test collection), 1PM (work Upstream), 3.15PM (D Release)(to be confirmed...)
</section>
<section data-markdown>
# Yardstick
* Performance testing framework and NFVI Validation
* [Contributors](https://wiki.opnfv.org/display/yardstick/People)
* Yardstick presentation
* How to Do a Pre-deployment NFVI Validation Quickly and Efficiently? Wednesday, June 22, 4:00 PM - 4:30 PM
* Yardstick: A Pre-deployment NFVI Validation Tool. Thursday, June 23, 3:10 PM - 3:30 PM
* breakout sessions
* Tomorrow 2PM (Yardstick in C)
</section>
<section data-markdown>
# CPerf
* SDN Controller Performance Testing
* Upstream test experts + standards/metrics experts
* Goal: Cross-controller perf tests in CI against realistic deployments
</section>
<section data-markdown>
# StorPerf
* Cinder Volume Performance Testing
* Based on SNIA's SSD Test Specification
* Presentation
* StorPerf: Cinder Storage Performance Measurement.
Wednesday, June 22, 3:40 PM - 3:55 PM
* Breakout Session
* Tomorrow 10:15 (StorPerf Test Results Working Session)
</section>
<section data-markdown>
# VSPerf
</section>
<section data-markdown>
# Bottlenecks
</section>
<section data-markdown>
# QTIP
## OPNFV Platform Benchmark
- Bottom up
- testing baremetal components first
- More than result
- comparing against reference
- Setup-Test-Diagnose-Improve
- a closed loop to boost platform performance
## Breakout session
- 14:30~15:45, June 21st/Tuesday
- Room Tegel
</section>
</section>
<section>
<section data-markdown>
# Upstream, upstream, upstream..
</section>
<section data-markdown>
## We are on the shoulders of the giants
* Rally (OpenStack)
* ODL, ONOS, ...
* RobotFramework, Teston
* .....
</section>
<section data-markdown>
## Time to give back
### How to improve work with testing upstream community
</section>
</section>
<section>
<section data-markdown>
# Towards Telco Cloud KPI?
</section>
<section data-markdown>
# Testing group goals
* Define common needs (naming, rules, tools...)
* Unify result collection, reporting, dashboarding, documentation
* Share best practice: docker, CLI, ..
* Identify testing domains
* Encourage testing in poorly covered areas
</section>
<section data-markdown>
# The ultimate goal: define Telco Cloud KPIs
* Provide methodology and test suites to qualify a Telco Cloud
* Provide reference benchs for plugfest/third party integration: compare apple with apple
</section>
</section>
<section data-markdown>
# Thank you
</section>
</div>
<div class='footer'>
<img src="../../../img/logo-OPNFV-Berlin.png" alt="OPNFV logo">
</div>
</div>
<script src="../../reveal.js/lib/js/head.min.js"></script>
<script src="../../reveal.js/js/reveal.js"></script>
<script>
// Full list of configuration options available at:
// https://github.com/hakimel/reveal.js#configuration
Reveal.initialize({
controls: true,
progress: true,
history: true,
center: true,
transition: 'slide', // none/fade/slide/convex/concave/zoom
// Optional reveal.js plugins
dependencies: [
{ src: '../../reveal.js/lib/js/classList.js', condition: function() { return !document.body.classList; } },
{ src: '../../reveal.js/plugin/markdown/marked.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } },
{ src: '../../reveal.js/plugin/markdown/markdown.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } },
{ src: '../../reveal.js/plugin/highlight/highlight.js', async: true, condition: function() { return !!document.querySelector( 'pre code' ); }, callback: function() { hljs.initHighlightingOnLoad(); } },
{ src: '../../reveal.js/plugin/zoom-js/zoom.js', async: true },
{ src: '../../reveal.js/plugin/notes/notes.js', async: true }
]
});
</script>
</body>
</html>
