summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-31Merge "Clover initial commit for servicemesh/route_rules, ↵Stephen Wong8-0/+578
orchestration/kube_client, and tools/clover_validate_rr"
2018-03-30Clover initial commit for servicemesh/route_rules,Stephen Wong8-0/+578
orchestration/kube_client, and tools/clover_validate_rr Add an 'orchestration' directory. Please note that 'orchestration' does NOT mean Clover does any orchestration --- similar to how Clover doesn't by itself implement tracing or logging, orchestration is a directory for code related to Docker orchestration client --- such as k8s client kube_client utilizes the Kubernetes python client (a dependency) to perform tasks against Kubernetes API server. For this commit, it is only tested for weighted route rule verification, it does three tasks: (1) get a list of pods under a namespace --- pod dictionary now only contains pod name and label dictionary: used to match pod name with the node name in traces from OpenTracing (2) check to see if a particular pod is up in a particular namespace: used to check if Istio pods are running in istio-system namespace (3) check if a container exists in a list of pods under a namespace: used to check if application pods have istio-proxy container running route_rule directly invokes istioctl as there isn't any Istio Python client yet. Currently it reads and parses routerules from Istio, and validates if a particular trace result matches the routerules Finally, a sample tool clover_validate_rr is provided. This tool assumes a previous test has been ran (with an id with both the route-rule-under-test and corresponding traces are stored --- currently the assumption is tests were ran with redis-master running on system). The tool can be invoked: python clover_validate_rr.py -t <test-id> -s <service name> where test-id is the ID of the test (most likely uuid) and service name is the name of the service running in the Kubernetes cluster upon which test traces should be fetched against Change-Id: Ic8ab6efc23c71ac4643bee796ef986a86f6fc7dd Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
2018-03-31Merge "Added initial nginx services"Stephen Wong20-0/+1255
2018-03-31Develop snort IDS and content inspect serviceEddie Arrage17-0/+1319
- Initial commit to show potential structure of a sample service - This wil be part of a larger sample application currently dubbed Service Delivery Controller - Docker container needs to be built and employs open-source Linux packages - Service is deployable in Istio service mesh using provided yaml - Control snort daemon and add custom rules with GRPC messaging - Process snort alerts actively and send to redis and upstream service mesh components - Integrates a web server for better HTTP signature detection - Improved build script for CI with variables - Render k8s yaml snort manifest dynamically with command line options - Improve snort_client sample script for runtime modifications including passing args on CLI, error checking - Update nginx proxy interface - Added logging to snort server and alert process Change-Id: Ic56f9fcd9ed21f64b84b85ac8ee280d69af7b7c9 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-03-30Merge "Add Functest test hook 2"Stephen Wong1-2/+38
2018-03-30Merge "Initial commit for logging installation and validataion"Stephen Wong6-0/+526
2018-03-30Merge "Initial commit for tracing"Stephen Wong4-0/+358
2018-03-30Added initial nginx servicesEddie Arrage20-0/+1255
- Proxy allows ingress traffic to be sent to another element in service mesh - Mirroring is also in the default configuration - Default configuration is to proxy to a clover-server and mirror to snort-ids - A location_path (URI in HTTP requests) can be reconfigured to restrict proxing; default to '/' - A proxy_path can be reconfigured to specify an alternate destination - A mirror path can be reconfigured to specify where traffic will be spanned - The default server_port (listen port) for the proxy is 9180 but can be reconfigured - The default server_name is http-proxy but can be reconfigured - Reconfiguration is done over GRPC with jinja2 template for nginx - Currently snort ids sends alerts to proxy with stub code in GRPC - Refactored the code to have a nginx base with subservices - Proxy, Load Balancer (lb), and Server can share code - mainly GRPC server - Nginx subservices have separate docker builds - Improved build scripts for CI - Render yaml manifests dynamically - Improve nginx_client for runtime modifications (but not really useful yet) Change-Id: Icbff6890021bcc8a8da4690c9261205d6e1ca43a Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-03-30Add Functest test hook 2QiLiang1-2/+38
- Temporary run functest testcase after all clover env setup. - TODO: Use jenkins to trigger functest job. Change-Id: I5f620496d747c4d742c7bbf8bb825616f8c69499 Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-29Initial commit for tracingEddie Arrage4-0/+358
- Uses REST interface to obtain traces for services from Jaeger - Discover services availabe in tracing - Works only with Jaeger at the moment (not zipkin) - Optional Redis interface added to store traces per test - Install doc and validation script added for Jaeger - Renamed doc to docs Change-Id: I420137c818df290ecd40aa8d318c6961c511a947 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-03-29Initial commit for monitoring by prometheusQiLiang3-0/+241
- install prometheus - validate the installation - add prometheus query function - TODO: test collecting telemetry data from istio JIRA: CLOVER-7 Change-Id: I983be2db78c8c5c20c0acee9ae81e891884e07fb Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-29CI add timeout for k8s+istio deploymentQiLiang1-1/+2
Issue link: https://build.opnfv.org/ci/view/clover/job/clover-daily-deploy-master/13/ Clover daily job often failed, which is caused by bad network at utc 12:OO. (Heavy ci job running in huawei lab at that time.) Find another time slot for clover daily job. https://gerrit.opnfv.org/gerrit/#/c/54589/ Change-Id: I0a9eb3ba0c63a3c440627a7af5afb302dbdaebb5 Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-28Add Functest test hookQiLiang6-0/+68
Change-Id: Idbe25c162fb19c59ad4e57fd32a749d1d5a29f63 Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-26clover fraser: preliminary documents checkinStephen Wong2-0/+181
* add preliminary Clover Fraser release notes * add preliminary Clover Fraser user guide Change-Id: I84b0ae1538aaa175245dd47d90ac2343eaa26cc4 Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
2018-03-23Fix ci deploy job errorQiLiang1-3/+4
Fix issue: https://build.opnfv.org/ci/view/clover/job/clover-daily-deploy-master/4/consoleFull + ssh -i /home/jenkins/opnfv/slave_root/workspace/clover-daily-deploy-master/work/container4nfv/src/vagrant/kubeadm_istio/.vagrant/machines/master/libvirt/private_key vagrant@192.168.121.117 rm -rf clover Host key verification failed. Change-Id: I73ea912ca6eb7ef823b1694b9fb090d809f158ee Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-23Merge "Create document structure"Stephen Wong6-0/+0
2018-03-22Add clover ci deploy skeletonQiLiang3-0/+79
- create kubernetes + istio by continer4nfv kubeadm_istio scenario - add clover real test entry script - add basic .gitignore Change-Id: I3b36cdf71d70db4e24a19e386ad39dbb0a71ac2f Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-22Initial commit for logging installation and validataionYujun Zhang6-0/+526
- install fluentd with elastic stack - validate the installation JIRA: CLOVER-5 Change-Id: I181a7277bc332ceac549d384cf2c3817a182b06e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-03-22Create document structureYujun Zhang6-0/+0
See http://docs.opnfv.org/en/latest/how-to-use-docs/documentation-guide.html Note the structure stands on the view of whole OPNFV platform. Change-Id: Id2ac36cb6f30d6d2d54dbda9f6a77b76648aa4b0 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-03-22Rename doc to docsYujun Zhang1-0/+0
Change-Id: Iaa83d00704a8d077f8671647b999394eac461482 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-03-21Add ci entry scriptsQiLiang3-0/+39
Currently, just some dummy scripts for ci test. Scripts contents Plan: - deploy.sh is for ci daily job deploy and verify - upload.sh is for building/uploading docker image, other resources - verify.sh is for basic patch verify (e.g. ut, lint) Change-Id: If4c9ffb484a265258dcb6afaf6f479c8e394d7ee Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-03-12Merge "Auto Generated INFO.yaml file"Stephen Wong1-0/+43
2018-02-26clover fraser: initial commit for directory structureStephen Wong5-0/+0
Adding the basic directories, and the corresponding __init__.py (empty for now) Change-Id: I811620e170ea4aa9363238f1949f299c6fd9d751 Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
2018-02-02Auto Generated INFO.yaml fileagardner1-0/+43
INFO.yaml meant to be machine readable. This file was auto generated from an ldap lookup and your projects INFO file. Meeting times are not currently filled out. please ammend this patchset to complete Going forward comitter promotions should be done against this file. PTLs: Must be merged for you to gain delete access on testresults.opnfv.org Change-Id: Ibd9878dae47a8343dbda157cc5603ddbaba85a16 Signed-off-by: agardner <agardner@linuxfoundation.org>
2017-11-03Adding INFO and LICENSE for reviewagardner2-0/+21
Change-Id: I9e62d823723f32d0c9b2e558add110eef81f57f6 Signed-off-by: agardner <agardner@linuxfoundation.org>
2017-11-03Initial empty repositoryAric Gardner0-0/+0