<!doctype html>
<html lang="en">

	<head>
		<meta charset="utf-8">

		<title>OPNFV presentation</title>

		<meta name="description" content="Conversation with the Testing community">
		<meta name="author" content="M.Richomme, ....">

		<meta name="apple-mobile-web-app-capable" content="yes" />
		<meta name="apple-mobile-web-app-status-bar-style" content="black-translucent" />

		<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no, minimal-ui">

		<link rel="stylesheet" href="../css/reveal.css">
		<link rel="stylesheet" href="../css/theme/OPNFV-Berlin.css" id="theme">

		<!-- Code syntax highlighting -->
		<link rel="stylesheet" href="../lib/css/zenburn.css">

		<!-- Printing and PDF exports -->
		<script>
			var link = document.createElement( 'link' );
			link.rel = 'stylesheet';
			link.type = 'text/css';
			link.href = window.location.search.match( /print-pdf/gi ) ? '../css/print/pdf.css' : '../css/print/paper.css';
			document.getElementsByTagName( 'head' )[0].appendChild( link );
		</script>

		<!--[if lt IE 9]>
		<script src="lib/js/html5shiv.js"></script>
		<![endif]-->
	</head>

	<body>

		<div class="reveal">
			<!-- Any section element inside of this container is displayed as a slide -->
			<div class="slides">

				<section data-background="../img/title-bg-berlin.png" data-background-transition="none">
                     <br><br><br><br><br>
                     <h1>Conversation with the Testing Community</h1>
                     <br><br>
					 <h4>OPNFV testing community</h4>
					 <h5>OPNFV Design Summit, 20/6/2016, Berlin</h5>
					 <br>

				</section>

				<section data-markdown>
						>“You make experiments and I make theories. Do you know the difference? A theory is something nobody believes, except the person who made it. An experiment is something everybody believes, except the person who made it." A.Einstein
				</section>

				<section data-markdown>
					# Agenda
					* Who are we?
					* Upstream, Upstream, Upstream
					* Towards Telco Cloud KPI
				</section>

				<section data-markdown>
					# Who are we?
					![team](../img/OPNFV_testing_group.png)
					This is a representation...not a governance!
				</section>
                <section>
					<section>
						<h3>The test projects</h3>
						<table>
							<thead>
								<tr>
									<th>Test case</th>
									<th>Description</th>
								</tr>
							</thead>
							<tbody>
								<tr>
									<td>Functest</td>
									<td>Umbrella project for Functional testing</td>
								</tr>
								<tr>
									<td>Yardstick</td>
									<td>Umbrella project for performance/qualification testing</td>
								</tr>
								<tr>
									<td>CPerf</td>
									<td>SDN controller performance testing</td>
								</tr>
								<tr>
									<td>StorPerf</td>
									<td>Storage performance testing</td>
								</tr>
								<tr>
									<td>VSPerf</td>
									<td>VSwitch qualification</td>
								</tr>
								<tr>
									<td>Bottlenecks</td>
									<td>Detect possible bottlenecks</td>
								</tr>
								<tr>
									<td>QTIP</td>
									<td>Benchmark to boost performance</td>
								</tr>
							</tbody>
						</table>
					</section>

						<section data-markdown>
							# Functest
							* Functional testing to validate scenarios
							* Contributors (raise your hands)
							* Functest presentation (here...1h ago :))
							* breakout sessions
							  * Today 3.10PM-3.40PM (vIMS evolution) 4PM (feature project integration), 5PM (Colorado status)
							  * tomorrow 11AM (API, test collection), 1PM (work Upstream), 3.15PM (D Release)(to be confirmed...)
						</section>
						<section data-markdown>
							# Yardstick
							* Performance testing framework and NFVI Validation
							* [Contributors](https://wiki.opnfv.org/display/yardstick/People)
							* Yardstick presentation
							  * How to Do a Pre-deployment NFVI Validation Quickly and Efficiently? Wednesday, June 22, 4:00 PM - 4:30 PM
							  * Yardstick: A Pre-deployment NFVI Validation Tool. Thursday, June 23, 3:10 PM - 3:30 PM
							* breakout sessions
							  * Tomorrow 2PM (Yardstick in C)
						</section>
						<section data-markdown>
							# CPerf
							* SDN Controller Performance Testing
							* Upstream test experts + standards/metrics experts
							* Goal: Cross-controller perf tests in CI against realistic deployments
						</section>
						<section data-markdown>
							# StorPerf
							* Cinder Volume Performance Testing
							* Based on SNIA's SSD Test Specification
							* Presentation
							  * StorPerf: Cinder Storage Performance Measurement.
							    Wednesday, June 22, 3:40 PM - 3:55 PM
							* Breakout Session
							  * Tomorrow 10:15 (StorPerf Test Results Working Session)
						</section>
						<section data-markdown>
							# VSPerf
						</section>
						<section data-markdown>
							# Bottlenecks
						</section>
						<section data-markdown>
							# QTIP

							## OPNFV Platform Benchmark

							- Bottom up
								- testing baremetal components first
							- More than result
								- comparing against reference
							- Setup-Test-Diagnose-Improve
								- a closed loop to boost platform performance

							## Breakout session

							- 14:30~15:45, June 21st/Tuesday
							- Room Tegel
						</section>
				</section>
				<section>
				    <section data-markdown>
				    # Upstream, upstream, upstream..
				    </section>
				    <section data-markdown>
				    ## We are on the shoulders of the giants
				    * Rally (OpenStack)
				    * ODL, ONOS, ...
				    * RobotFramework, Teston
				    * .....
				    </section>
				    <section data-markdown>
				    ## Time to give back
				    ### How to improve work with testing upstream community
				    </section>

				</section>

				<section>

				    <section data-markdown>
				    # Towards Telco Cloud KPI?
				    </section>

				    <section data-markdown>
				    # Testing group goals
				    * Define common needs (naming, rules, tools...)
				    * Unify result collection, reporting, dashboarding, documentation
				    * Share best practice: docker, CLI, ..
				    * Identify testing domains
				    * Encourage testing in poorly covered areas
				    </section>

				    <section data-markdown>
				    # The ultimate goal: define Telco Cloud KPIs
				    * Provide methodology and test suites to qualify a Telco Cloud
				    * Provide reference benchs for plugfest/third party integration: compare apple with apple
				    </section>

				</section>

				<section data-markdown>
					# Thank you
				</section>

			</div>
            <div class='footer'>
				 <img src="../img/logo-OPNFV-Berlin.png" alt="OPNFV logo"> 
	        </div>
		</div>

		<script src="../lib/js/head.min.js"></script>
		<script src="../js/reveal.js"></script>

		<script>

			// Full list of configuration options available at:
			// https://github.com/hakimel/reveal.js#configuration
			Reveal.initialize({
				controls: true,
				progress: true,
				history: true,
				center: true,

				transition: 'slide', // none/fade/slide/convex/concave/zoom

				// Optional reveal.js plugins
				dependencies: [
					{ src: '../lib/js/classList.js', condition: function() { return !document.body.classList; } },
					{ src: '../plugin/markdown/marked.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } },
					{ src: '../plugin/markdown/markdown.js', condition: function() { return !!document.querySelector( '[data-markdown]' ); } },
					{ src: '../plugin/highlight/highlight.js', async: true, condition: function() { return !!document.querySelector( 'pre code' ); }, callback: function() { hljs.initHighlightingOnLoad(); } },
					{ src: '../plugin/zoom-js/zoom.js', async: true },
					{ src: '../plugin/notes/notes.js', async: true }
				]
			});

		</script>

	</body>
</html>