summaryrefslogtreecommitdiffstats
path: root/INFO
diff options
context:
space:
mode:
authorAbhijit Sinha <abhijit.sinha@intel.com>2018-10-05 15:44:52 +0100
committerAbhijit Sinha <abhijit.sinha@intel.com>2018-10-30 13:42:00 +0000
commite63084495f47a9f5b5b61b23529792d6898841bb (patch)
treedb1baba242efcedfabf5c206a35b17987f46d9d4 /INFO
parenta4084d27de22c64ecb690369c7bed49175703adf (diff)
Dashboard with Network and Platform NFVi metrics
Added the PROX L3FWD Grafana dashboard with NFVi metrics collected from barometer collectd container. The dashboard has template field for HOST/SUT name to get the collectd metrics from that SUT. JIRA: YARDSTICK-1412 Update: - Added table and graphs for TG NFVi metrics - Added TG and SUT templates as IP address - Added IPC(instruction per cycles) metric Change-Id: I1f8971f551df27ad6a16241693527285610fc82d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
Diffstat (limited to 'INFO')
0 files changed, 0 insertions, 0 deletions
/a> 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817
.. This work is licensed under a Creative Commons Attribution 4.0 International License.
.. SPDX-License-Identifier: CC-BY-4.0


Pulling the Docker image
------------------------
Pull the Functest Docker image ('opnfv/functest') from the public
dockerhub registry under the OPNFV account: [dockerhub_], with the
following docker command::

  docker pull opnfv/functest:<TagIdentifier>

where <TagIdentifier> identifies a release of the Functest docker
container image in the public dockerhub registry. There are many tags
created automatically by the CI mechanisms, and you must ensure you
pull an image with the **correct tag** to match the OPNFV software
release installed in your environment. All available tagged images can
be seen from location [FunctestDockerTags_]. For example, when running
on the first official release of the OPNFV Danube system platform,
tag "danube.1.0" is needed. Pulling other tags might cause some
problems while running the tests.
Docker images pulled without a tag specifier bear the implicitly
assigned label "latest". If you need to specifically pull the latest
Functest docker image, then omit the tag argument::

  docker pull opnfv/functest

After pulling the Docker image, check that it is available with the
following docker command::

  [functester@jumphost ~]$ docker images
  REPOSITORY     TAG             IMAGE ID      CREATED      SIZE
  opnfv/functest latest          8cd6683c32ae  2 weeks ago  1.321 GB
  opnfv/functest danube.1.0    13fa54a1b238  4 weeks ago  1.29 GB
  opnfv/functest colorado.1.0    94b78faa94f7  9 weeks ago  968 MB

The Functest docker container environment can -in principle- be also
used with non-OPNFV official installers (e.g. 'devstack'), with the
**disclaimer** that support for such environments is outside of the
scope and responsibility of the OPNFV project.

Accessing the Openstack credentials
-----------------------------------
OpenStack credentials are mandatory and can be retrieved in different
ways. From inside the running Functest docker container the
"functest env prepare" command will automatically look for the
Openstack credentials file "/home/opnfv/functest/conf/openstack.creds"
and retrieve it unless the file already exists. This Functest
environment preparation step is described later in this document.

WARNING: When the installer type is "joid" you have to have the
credentials file inside the running container **before** initiating the
functest environment preparation. For that reason you have to choose
either one of the options below, since the automated copying does not
work for "joid".

You can also specifically pass in the needed file prior to running the
environment preparation either:

  * by using the -v option when creating the Docker container. This is
    referred to in docker documentation as "Bind Mounting". See the
    usage of this parameter in the following chapter.
  * or creating a local file '/home/opnfv/functest/conf/openstack.creds'
    inside the running container with the credentials in it. Consult
    your installer guide for further details. This is however not
    instructed in this document.

NOTE: When the installer type is "fuel" and virtualized deployment
is used, there you have to explicitly fetch the credentials file
executing the following sequence

  #. Create a container as described in next chapter but do not
     "Bind Mount" the credentials
  #. Log in to container and execute the following command. Replace
     the IP with installer address after the "-a" parameter::

       $REPOS_DIR/releng/utils/fetch_os_creds.sh \
       -d /home/opnfv/functest/conf/openstack.creds \
       -i fuel \
       -a 10.20.0.2 \
       -v
       ( -d specifies the full path to the Openstack credential file
       -i specifies the INSTALLER_TYPE
       -a specifies the INSTALLER_IP
       -v indicates a virtualized environment and takes no arguments )

  #. Continue with your testing, initiate functest environment
     preparation, run tests etc.

In proxified environment you may need to change the credentials file.
There are some tips in chapter: `Proxy support`_

Functest Docker parameters
--------------------------
This chapter explains how to run a container for executing functest
test suites. Numbered list below explains some details of the
recommended parameters for invoking docker container

  #. It is a good practice to assign a precise container name through
     the **--name** option.

  #. Assign parameter for installer type::

       -e "INSTALLER_TYPE=<type>"
       # Use one of following apex, compass, fuel or joid

  #. Functest needs to know the IP of some installers::

       -e "INSTALLER_IP=<Specific IP Address>"

       This IP is needed to fetch RC file from deployment, fetch logs, ...
       If not provided, there is no way to fetch the RC file. It must be
       provided manually as a volume

  #. Credentials for accessing the Openstack.
     Most convenient way of passing them to container is by having a
     local copy of the credentials file in Jumphost and then using the
     **-v** option. In the example we have local file by the name of
     "overcloudrc" and we are using that as an argument::

       -v ~/overcloudrc:/home/opnfv/functest/conf/openstack.creds

       The credentials file needs to exist in the Docker container
       under the path: '/home/opnfv/functest/conf/openstack.creds'.

     **WARNING:** If you are using the Joid installer, you must pass the
     credentials using the **-v** option:
     -v /var/lib/jenkins/admin-openrc:/home/opnfv/functest/conf/openstack.creds.
     See the section `Accessing the Openstack credentials`_ above.

  #. Passing deployment scenario
     When running Functest against any of the supported OPNFV scenarios,
     it is recommended to include also the environment variable
     **DEPLOY_SCENARIO**. The **DEPLOY_SCENARIO** environment variable
     is passed with the format::

       -e "DEPLOY_SCENARIO=os-<controller>-<nfv_feature>-<ha_mode>"
       where:
       os = OpenStack (No other VIM choices currently available)
       controller is one of ( nosdn | odl_l2 | odl_l3 | onos | ocl)
       nfv_feature is one or more of ( ovs | kvm | sfc | bgpvpn | nofeature )
                If several features are pertinent then use the underscore
                character '_' to separate each feature (e.g. ovs_kvm)
                'nofeature' indicates no NFV feature is deployed
       ha_mode (high availability) is one of ( ha | noha )

     **NOTE:** Not all possible combinations of "DEPLOY_SCENARIO" are
     supported. The name passed in to the Functest Docker container
     must match the scenario used when the actual OPNFV platform was
     deployed. See release note to see the list of supported scenarios.

     **NOTE:** The scenario name is mainly used to automatically detect
     if a test suite is runnable or not (e.g. it will prevent ONOS test suite
     to be run on ODL scenarios). If not set, Functest will try to run the
     default test cases that might not include SDN controller or a specific
     feature

     **NOTE:** A HA scenario means that 3 OpenStack controller nodes are
     deployed. It does not necessarily mean that the whole system is HA. See
     installer release notes for details.


Putting all above together, when using installer 'fuel' and an invented
INSTALLER_IP of '10.20.0.2', the recommended command to create the
Functest Docker container is as follows::

  docker run --name "FunctestContainer" -it \
  -e "INSTALLER_IP=10.20.0.2" \
  -e "INSTALLER_TYPE=fuel" \
  -e "DEPLOY_SCENARIO=os-odl_l2-ovs_kvm-ha" \
  -v ~/overcloudrc:/home/opnfv/functest/conf/openstack.creds \
  opnfv/functest /bin/bash

After the *run* command, a new prompt appears which means that we are inside
the container and ready to move to the next step.

For tips on how to set up container with installer Apex, see chapter
`Apex Installer Tips`_.

Finally, three additional environment variables can also be passed in
to the Functest Docker Container, using the -e
"<EnvironmentVariable>=<Value>" mechanism. The first two of these are
only relevant to Jenkins CI invoked testing and **should not be used**
when performing manual test scenarios::

  -e "NODE_NAME=<Test POD Name>" \
  -e "BUILD_TAG=<Jenkins Build Tag>" \
  -e "CI_DEBUG=<DebugTraceValue>"
  where:
  <Test POD Name> = Symbolic name of the POD where the tests are run.
                    Visible in test results files, which are stored
                    to the database. This option is only used when
                    tests are activated under Jenkins CI control.
                    It indicates the POD/hardware where the test has
                    been run. If not specified, then the POD name is
                    defined as "Unknown" by default.
                    DO NOT USE THIS OPTION IN MANUAL TEST SCENARIOS.
  <Jenkins Build tag> = Symbolic name of the Jenkins Build Job.
                        Visible in test results files, which are stored
                        to the database. This option is only set when
                        tests are activated under Jenkins CI control.
                        It enables the correlation of test results,
                        which
                        are independently pushed to the results database
                        from different Jenkins jobs.
                        DO NOT USE THIS OPTION IN MANUAL TEST SCENARIOS.
  <DebugTraceValue> = "true" or "false"
                      Default = "false", if not specified
                      If "true" is specified, then additional debug trace
                      text can be sent to the test results file / log files
                      and also to the standard console output.

Apex Installer Tips
-------------------
Some specific tips are useful for the Apex Installer case. If not using
Apex Installer; ignore this section.

In case of Triple-O based installer (like Apex) the docker container
needs to connect to the installer VM, so it is then required that some
known SSH keys are present in docker container. Since the Jumphost root
SSH keys are already known, easiest way is to use those using the
'Bind mount' method. See below for sample parameter::

  -v /root/.ssh/id_rsa:/root/.ssh/id_rsa

  NOTE: You need the "sudo" when creating the container to access root
  users ssh credentials even the docker command itself might not
  require that.

HINT! In case of Triple-O installers you can find value for the
INSTALLER_IP parameter by executing command and note the returned IP
address::

  inst=$(sudo virsh list | grep -iEo "undercloud|instack")
  sudo virsh domifaddr ${inst}

  NOTE: In releases prior to Colorado, the name 'instack' was
  used. Currently the name 'undercloud' is used.

You can copy the credentials file from the "stack" users home directory
in installer VM to Jumphost. Please check the correct IP from the
command above. In the example below we are using invented IP address
"192.168.122.89"::

    scp stack@192.168.122.89:overcloudrc .

Here is an example of the full docker command invocation for an Apex
installed system, using latest Functest docker container, for
illustration purposes::

  sudo docker run -it --name "ApexFuncTestODL" \
  -e "INSTALLER_IP=192.168.122.89" \
  -e "INSTALLER_TYPE=apex" \
  -e "DEPLOY_SCENARIO=os-odl_l2-nofeature-ha" \
  -v /root/.ssh/id_rsa:/root/.ssh/id_rsa \
  -v ~/overcloudrc:/home/opnfv/functest/conf/openstack.creds \
  opnfv/functest /bin/bash

Compass installer local development env usage Tips
--------------------------------------------------
In the compass-functest local test case check and development environment,
in order to get openstack service inside the functest container, some
parameters should be configured during container creation, which are
hard to guess for freshman. This section will provide the guideline, the
parameters values are defaults here, which should be adjusted according
to the settings, the complete steps are given here so as not to appear
too abruptly.

1, Pull Functest docker image from public dockerhub::

    docker pull opnfv/functest:<Tag>

<Tag> here can be "brahmaputra.1.0", "colorado.1.0", etc.
Tag omitted means the latest docker image::

    docker pull opnfv/functest

2, Functest Docker container creation

To make a file used for the environment, such as 'functest-docker-env'::

    OS_AUTH_URL=http://172.16.1.222:35357/v2.0
    OS_USERNAME=admin
    OS_PASSWORD=console
    OS_TENANT_NAME=admin
    OS_VOLUME_API_VERSION=2
    OS_PROJECT_NAME=admin
    INSTALLER_TYPE=compass
    INSTALLER_IP=192.168.200.2
    EXTERNAL_NETWORK=ext-net

Note: please adjust the content according to the environment, such as
'TENANT_ID' maybe used for some special cases.

Then to create the Functest docker::

    docker run --privileged=true --rm -t \
    --env-file functest-docker-env \
    --name <Functest_Container_Name> \
    opnfv/functest:<Tag> /bin/bash

3, To attach Functest container

Before trying to attach the Functest container, the status can be checked by::

   docker ps -a

to attach the 'Up' status Functest container and start bash mode::

   docker exec -it <Functest_Container_Name> bash

4, Functest environemnt preparation and check

To see the Section below `Preparing the Functest environment`_.

Functest docker container directory structure
---------------------------------------------
Inside the Functest docker container, the following directory structure
should now be in place::

  `-- home
      `-- opnfv
        |-- functest
        |   |-- conf
        |   |-- data
        |   `-- results
        `-- repos
            |-- bgpvpn
            |-- copper
            |-- doctor
            |-- domino
            |-- functest
            |-- kingbird
            |-- odl_test
            |-- onos
            |-- parser
            |-- promise
            |-- rally
            |-- releng
            |-- sdnvpn
            |-- securityscanning
            |-- sfc
            |-- tempest
            |-- vims_test
            `-- vnfs

Underneath the '/home/opnfv/' directory, the Functest docker container
includes two main directories:

  * The **functest** directory stores configuration files (e.g. the
    OpenStack creds are stored in path '/home/opnfv/functest/conf/openstack.creds'),
    the **data** directory stores a 'cirros' test image used in some
    functional tests and the **results** directory stores some temporary
    result log files
  * The **repos** directory holds various repositories. The directory
    '/home/opnfv/repos/functest' is used to prepare the needed Functest
    environment and to run the tests. The other repository directories
    are used for the installation of the needed tooling (e.g. rally) or
    for the retrieval of feature projects scenarios (e.g. promise)

The structure under the **functest** repository can be described as
follows::

  . |-- INFO
    |-- LICENSE
    |-- requirements.txt
    |-- run_unit_tests.sh
    |-- setup.py
    |-- test-requirements.txt
    |-- commons
    |   |-- ims
    |   |-- mobile
    |   `--traffic-profile-guidelines.rst
    |-- docker
    |   |-- Dockerfile
    |   |-- config_install_env.sh
    |   `-- docker_remote_api
    |-- docs
    |   |-- com
    |   |-- configguide
    |   |-- devguide
    |   |-- images
    |   |-- internship
    |   |-- release-notes
    |   |-- results
    |   `--userguide
    |-- functest
        |-- __init__.py
        |-- ci
        |   |-- __init__.py
        |   |-- check_os.sh
        |   |-- config_functest.yaml
        |   |-- config_patch.yaml
        |   |-- generate_report.py
        |   |-- prepare_env.py
        |   |-- run_tests.py
        |   |-- testcases.yaml
        |   |-- tier_builder.py
        |   `-- tier_handler.py
        |-- cli
        |   |-- __init__.py
        |   |-- cli_base.py
        |   |-- commands
        |   |-- functest-complete.sh
        |   `-- setup.py
        |-- core
        |   |-- __init__.py
        |   |-- feature_base.py
        |   |-- pytest_suite_runner.py
        |   |-- testcase.py
        |   |-- vnf_base.py
        |-- opnfv_tests
        |   |-- __init__.py
        |   |-- features
        |   |-- mano
        |   |-- openstack
        |   |-- sdn
        |   |-- security_scan
        |   `-- vnf
        |-- tests
        |   |-- __init__.py
        |   `-- unit
        `-- utils
            |-- __init__.py
            |-- config.py
            |-- constants.py
            |-- env.py
            |-- functest_logger.py
            |-- functest_utils.py
            |-- openstack
            |-- openstack_clean.py
            |-- openstack_snapshot.py
            |-- openstack_tacker.py
            `-- openstack_utils.py


    (Note: All *.pyc files removed from above list for brevity...)

We may distinguish several directories, the first level has 4 directories:

* **commons**: This directory is dedicated for storage of traffic
  profile or any other test inputs that could be reused by any test
  project.
* **docker**: This directory includes the needed files and tools to
  build the Funtest Docker image.
* **docs**: This directory includes documentation: Release Notes,
  User Guide, Configuration Guide and Developer Guide.
* **functest**: This directory contains all the code needed to run
  functest internal cases and OPNFV onboarded feature or VNF test cases.

Functest directory has 6 directories:
  * **ci**: This directory contains test structure definition files
    (e.g <filename>.yaml) and bash shell/python scripts used to
    configure and execute Functional tests. The test execution script
    can be executed under the control of Jenkins CI jobs.
  * **cli**: This directory holds the python based Functest CLI utility
    source code, which is based on the Python 'click' framework.
  * **core**: This directory holds the python based Functest core
      source code. Three abstraction classes have been created to ease
      the integration of internal, feature or vnf cases.
  * **opnfv_tests**: This directory includes the scripts required by
    Functest internal test cases and other feature projects test cases.
  * **tests**: This directory includes the functest unit tests
  * **utils**: this directory holds Python source code for some general
    purpose helper utilities, which testers can also re-use in their
    own test code. See for an example the Openstack helper utility:
    'openstack_utils.py'.

Useful Docker commands
----------------------
When typing **exit** in the container prompt, this will cause exiting
the container and probably stopping it. When stopping a running Docker
container all the changes will be lost, there is a keyboard shortcut
to quit the container without stopping it: <CTRL>-P + <CTRL>-Q. To
reconnect to the running container **DO NOT** use the *run* command
again (since it will create a new container), use the *exec* or *attach*
command instead::

  docker ps  # <check the container ID from the output>
  docker exec -ti <CONTAINER_ID> /bin/bash

There are other useful Docker commands that might be needed to manage possible
issues with the containers.

List the running containers::

  docker ps

List all the containers including the stopped ones::

  docker ps -a

Start a stopped container named "FunTest"::

  docker start FunTest

Attach to a running container named "StrikeTwo"::

  docker attach StrikeTwo

It is useful sometimes to remove a container if there are some problems::

  docker rm <CONTAINER_ID>

Use the *-f* option if the container is still running, it will force to
destroy it::

  docker rm -f <CONTAINER_ID>

Check the Docker documentation dockerdocs_ for more information.

Preparing the Functest environment
----------------------------------
Once the Functest docker container is up and running, the required
Functest environment needs to be prepared. A custom built **functest**
CLI utility is available to perform the needed environment preparation
action. Once the environment is prepared, the **functest** CLI utility
can be used to run different functional tests. The usage of the
**functest** CLI utility to run tests is described further in the
Functest User Guide `OPNFV_FuncTestUserGuide`_

Prior to commencing the Functest environment preparation, we can check
the initial status of the environment. Issue the **functest env status**
command at the prompt::

  functest env status
  Functest environment is not installed.

  Note: When the Functest environment is prepared, the command will
  return the status: "Functest environment ready to run tests."

To prepare the Functest docker container for test case execution, issue
the **functest env prepare** command at the prompt::

  functest env prepare

This script will make sure that the requirements to run the tests are
met and will install the needed libraries and tools by all Functest
test cases. It should be run only once every time the Functest docker
container is started from scratch. If you try to run this command, on
an already prepared enviroment, you will be prompted whether you really
want to continue or not::

  functest env prepare
  It seems that the environment has been already prepared.
  Do you want to do it again? [y|n]

  (Type 'n' to abort the request, or 'y' to repeat the
   environment preparation)


To list some basic information about an already prepared Functest
docker container environment, issue the **functest env show** at the
prompt::

  functest env show
  +======================================================+
  | Functest Environment info                            |
  +======================================================+
  |  INSTALLER: apex, 192.168.122.89                     |
  |   SCENARIO: os-odl_l2-nofeature-ha                   |
  |        POD: localhost                                |
  | GIT BRANCH: master                                   |
  |   GIT HASH: 5bf1647dec6860464eeb082b2875798f0759aa91 |
  | DEBUG FLAG: false                                    |
  +------------------------------------------------------+
  |     STATUS: ready                                    |
  +------------------------------------------------------+

  Where:

  INSTALLER:  Displays the INSTALLER_TYPE value
              - here = "apex"
              and the INSTALLER_IP value
              - here = "192.168.122.89"
  SCENARIO:   Displays the DEPLOY_SCENARIO value
              - here = "os-odl_l2-nofeature-ha"
  POD:        Displays the value passed in NODE_NAME
              - here = "localhost"
  GIT BRANCH: Displays the git branch of the OPNFV Functest
              project repository included in the Functest
              Docker Container.
              - here = "master"
                       (In first official colorado release
                        would be "colorado.1.0")
  GIT HASH:   Displays the git hash of the OPNFV Functest
              project repository included in the Functest
              Docker Container.
              - here = "5bf1647dec6860464eeb082b2875798f0759aa91"
  DEBUG FLAG: Displays the CI_DEBUG value
              - here = "false"

  NOTE: In Jenkins CI runs, an additional item "BUILD TAG"
        would also be listed. The value is set by Jenkins CI.

Finally, the **functest** CLI has a **--help** options:

Some examples::

  functest --help Usage: functest [OPTIONS] COMMAND [ARGS]...

  Options:
    --version  Show the version and exit.
    -h, --help Show this message and exit.

  Commands:
    env
    openstack
    testcase
    tier

  functest env --help
  Usage: functest env [OPTIONS] COMMAND [ARGS]...

  Options:
    -h, --help Show this message and exit.

  Commands:
    prepare  Prepares the Functest environment.
    show     Shows information about the current...
    status   Checks if the Functest environment is ready...

Checking Openstack and credentials
----------------------------------
It is recommended and fairly straightforward to check that Openstack
and credentials are working as expected.

Once the credentials are there inside the container, they should be
sourced before running any Openstack commands::

  source /home/opnfv/functest/conf/openstack.creds

After this, try to run any OpenStack command to see if you get any
output, for instance::

  openstack user list

This will return a list of the actual users in the OpenStack
deployment. In any other case, check that the credentials are sourced::

  env|grep OS_

This command must show a set of environment variables starting with
*OS_*, for example::

  OS_REGION_NAME=RegionOne
  OS_DEFAULT_DOMAIN=default
  OS_PROJECT_NAME=admin
  OS_PASSWORD=admin
  OS_AUTH_STRATEGY=keystone
  OS_AUTH_URL=http://172.30.10.3:5000/v2.0
  OS_USERNAME=admin
  OS_TENANT_NAME=admin
  OS_ENDPOINT_TYPE=internalURL
  OS_NO_CACHE=true

If the OpenStack command still does not show anything or complains
about connectivity issues, it could be due to an incorrect url given to
the OS_AUTH_URL environment variable. Check the deployment settings.

SSL Support
-----------
If you need to connect to a server that is TLS-enabled (the auth URL
begins with "https") and it uses a certificate from a private CA or a
self-signed certificate, then you will need to specify the path to an
appropriate CA certificate to use, to validate the server certificate
with the environment variable OS_CACERT::

  echo $OS_CACERT
  /etc/ssl/certs/ca.crt

However, this certificate does not exist in the container by default.
It has to be copied manually from the OpenStack deployment. This can be
done in 2 ways:

  #. Create manually that file and copy the contents from the OpenStack
     controller.
  #. (Recommended) Add the file using a Docker volume when starting the
     container::

       -v <path_to_your_cert_file>:/etc/ssl/certs/ca.cert

You might need to export OS_CACERT environment variable inside the
container::

  export OS_CACERT=/etc/ssl/certs/ca.crt

Certificate verification can be turned off using OS_INSECURE=true. For
example, Fuel uses self-signed cacerts by default, so an pre step would
be::

  export OS_INSECURE=true

Proxy support
-------------
If your Jumphost node is operating behind a http proxy, then there are
2 places where some special actions may be needed to make operations
succeed:

  #. Initial installation of docker engine First, try following the
     official Docker documentation for Proxy settings. Some issues were
     experienced on CentOS 7 based Jumphost. Some tips are documented
     in section: `Docker Installation on CentOS behind http proxy`_
     below.

  #. Execution of the Functest environment preparation inside the
     created docker container Functest needs internet access to
     download some resources for some test cases. This might not
     work properly if the Jumphost is connecting to internet
     through a http Proxy.

If that is the case, make sure the resolv.conf and the needed
http_proxy and https_proxy environment variables, as well as the
'no_proxy' environment variable are set correctly::

  # Make double sure that the 'no_proxy=...' line in the
  # 'openstack.creds' file is commented out first. Otherwise, the
  # values set into the 'no_proxy' environment variable below will
  # be ovewrwritten, each time the command
  # 'source ~/functest/conf/openstack.creds' is issued.

  cd ~/functest/conf/
  sed -i 's/export no_proxy/#export no_proxy/' openstack.creds
  source ./openstack.creds

  # Next calculate some IP addresses for which http_proxy
  # usage should be excluded:

  publicURL_IP=$(echo $OS_AUTH_URL | grep -Eo "([0-9]+\.){3}[0-9]+")

  adminURL_IP=$(openstack catalog show identity | \
  grep adminURL | grep -Eo "([0-9]+\.){3}[0-9]+")

  export http_proxy="<your http proxy settings>"
  export https_proxy="<your https proxy settings>"
  export no_proxy="127.0.0.1,localhost,$publicURL_IP,$adminURL_IP"

  # Ensure that "git" uses the http_proxy
  # This may be needed if your firewall forbids SSL based git fetch
  git config --global http.sslVerify True
  git config --global http.proxy <Your http proxy settings>

Validation check: Before running **'functest env prepare'** CLI command,
make sure you can reach http and https sites from inside the Functest
docker container.

For example, try to use the **nc** command from inside the functest
docker container::

  nc -v opnfv.org 80
  Connection to opnfv.org 80 port [tcp/http] succeeded!

  nc -v opnfv.org 443
  Connection to opnfv.org 443 port [tcp/https] succeeded!

Note: In a Jumphost node based on the CentOS family OS, the **nc**
commands might not work. You can use the **curl** command instead.

  curl http://www.opnfv.org:80
  <HTML><HEAD><meta http-equiv="content-type"
  .
  .
  </BODY></HTML>

  curl https://www.opnfv.org:443
  <HTML><HEAD><meta http-equiv="content-type"
  .
  .
  </BODY></HTML>

  (Ignore the content. If command returns a valid HTML page, it proves
  the connection.)

Docker Installation on CentOS behind http proxy
-----------------------------------------------
This section is applicable for CentOS family OS on Jumphost which
itself is behind a proxy server. In that case, the instructions below
should be followed **before** installing the docker engine::

  1) # Make a directory '/etc/systemd/system/docker.service.d'
     # if it does not exist
     sudo mkdir /etc/systemd/system/docker.service.d

  2) # Create a file called 'env.conf' in that directory with
     # the following contents:
     [Service]
     EnvironmentFile=-/etc/sysconfig/docker

  3) # Set up a file called 'docker' in directory '/etc/sysconfig'
     # with the following contents:
     HTTP_PROXY="<Your http proxy settings>"
     HTTPS_PROXY="<Your https proxy settings>"
     http_proxy="${HTTP_PROXY}"
     https_proxy="${HTTPS_PROXY}"

  4) # Reload the daemon
     systemctl daemon-reload

  5) # Sanity check - check the following docker settings:
     systemctl show docker | grep -i env

     Expected result:
     ----------------
     EnvironmentFile=/etc/sysconfig/docker (ignore_errors=yes)
     DropInPaths=/etc/systemd/system/docker.service.d/env.conf

Now follow the instructions in [`InstallDockerCentOS`_] to download
and install the **docker-engine**. The instructions conclude with a
"test pull" of a sample "Hello World" docker container. This should now
work with the above pre-requisite actions.

.. _dockerdocs: https://docs.docker.com/
.. _dockerhub: https://hub.docker.com/r/opnfv/functest/
.. _Proxy: https://docs.docker.com/engine/admin/systemd/#http-proxy
.. _FunctestDockerTags: https://hub.docker.com/r/opnfv/functest/tags/
.. _InstallDockerCentOS: https://docs.docker.com/engine/installation/linux/centos/
.. _OPNFV_FuncTestUserGuide: http://artifacts.opnfv.org/functest/docs/userguide/index.html