summaryrefslogtreecommitdiffstats
path: root/docs/submodules/clover
AgeCommit message (Collapse)AuthorFilesLines
2018-11-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'stable/gambia' - Merge "CLOVER-43: Initial commit for Clovisor" into stable/gambia - CLOVER-43: Initial commit for Clovisor Part of Clover's initial task (during project proposal) is to explore cloud native network tracing tools. Clover the project proposes Clovisor as a way for Clover to use the IOvisor (https://www.iovisor.org/) to perform network tracing. This is the first commit of this module Please note that the BPF code used in this commit were only tested with Linux kernel 4.14+ --- hence, if ubuntu is used, and one prefers LTS, the requirement is 18.04+ A different patch will track the redis and k8s API server watcher code Also, a design doc will be added in the future (TBD) Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com> Change-Id: I30d9f9d474b8703097c470d39628e86bc788f9b6
2018-11-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'stable/gambia' - Merge "Initial UI dashboard added for visibility" into stable/gambia - Initial UI dashboard added for visibility - Add foundation, jquery and jquery-ui open source js/css packages for skin, layout and AJAX - Add plotly and candela js open source graphing packages - Build core visibility view and provide toplevel templates, headers, menu navigation, etc. - Update collector/visibility APIs to align to latest Spark analytics and UI requirements - Refresh page elements at 5 second interval. - Visibility controls to stop continual page refresh and clear visibility. - Multi-select and update service set to analyze. - System count updates for tracing, spans, metrics schemas. - Min/max/avg response times per service (aggregate) table. - Graphs for: per service request counts, user-agent percentages, per service/URL counts, per URL/status code counts, per URL counts - Tabs for distinct URLs, status codes, user-agents, upstream cluster, operation names, nodeids (service names) - Table for metrics counters specified in visibility configuration. - Metrics over time scatter plots for tracked metrics. Change-Id: Ie3ea12fd32e0274ac52f78becc4a56c4c4134660 Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-11-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'stable/gambia' - Merge "Update modsecurity image docker registry" into stable/gambia - Update modsecurity image docker registry The clover-ns-modsecurity-crs docker image is now built by Jenkins and uploaded to the OPNFV docker hub. This patch updates the modsecurity deployment kubernetes manifest to pull image from OPNFV docker hub. Change-Id: I7e8afd27f726600de9247fc98fe3f5d491000f1c Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-11-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'stable/gambia' - Merge "Initial commit for Spark to analyze visibility data" into stable/gambia - Initial commit for Spark to analyze visibility data - Add Apache Spark 2.3 with native Kubernetes support. - Runs self contained within K8s cluster in clover-system namespace. One container (clover-spark) includes Clover Spark JAR artifact. This container interacts with the K8s API to spawn a spark-driver pod. This pod in turn spawns executor pods to execute Spark jobs. - Currently JAR is included in source for convenience and must be built with sbt (install sbt and execute sbt package) - Includes JAR from DataStax to provide Cassandra connector to analyze Cassandra schemas as RDDs (Resilient Distributed Dataset). - Includes Redis interface JAR to write analyzed data back to visibility (UI, CLI or API). - Second container (clover-spark-submit) submits Spark jobs continuously to allow Spark to be operated entirely within the cluster. - Two Spark jobs (CloverSlow, CloverFast) allows some analytics to be provided in real-time and other analytics to be provided over longer horizons. - Each Spark job spawns two executor pods. - Includes yaml manifest to deploy clover-spark-submit with the necessary RBAC permissions to interact with the K8s API. - Data analyzed includes tracing and metrics schemas obtained by clover-collector and written to Cassandra. - Docker builds of clover-spark and clover-spark-submit are provided and will be pushed as OPNFV DockerHub images in a separate patch. Change-Id: I2e92c41fd75d4ebba948c0f8cb60face57005e50 Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-11-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'stable/gambia' - Merge "Add initial Istio validation testcase for CI" into stable/gambia - Add initial Istio validation testcase for CI This work adds testcase for validating Istio installation Change-Id: Ie895b27eb4b3fbec23cf9519699f5fe37236153c Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-10-27Update git submodulesearrage1-0/+0
* Update docs/submodules/clover from branch 'stable/gambia' - Fix broken jmeter binary links - Docker container builds are failing due to expired links for the jmeter binary for jmeter-master and jmeter-slave - Updated link provided Change-Id: Icb364bc234b118e0c00359a04b51461142f832af Signed-off-by: earrage <eddie.arrage@huawei.com> - Merge "Add visibility API in controller and CLI" into stable/gambia - Merge "Add nginx services control functionality" into stable/gambia - Merge "Improve data ingestion reliability and functionality" into stable/gambia - Merge "Remove former check_envs call" into stable/gambia - Remove former check_envs call Else it raises exceptions in __init__(). Change-Id: I4af1f59fbb9a94da1df132e750525fcdb5d0917b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> - Add visibility API in controller and CLI - Modify get visibility to retrieve config and stats - Add visibility REST API in controller to clear, set, and get from redis - Add example yaml to set visibility (service list by name, metric suffixes/prefixes, and custom metrics) from CLI - Modify example yaml to start visibility (collector) for Istio 1.0 from CLI Change-Id: I43304ff6d70bb4b817b345b9c383ce3621fb06c7 Signed-off-by: earrage <eddie.arrage@huawei.com> - Add spinnaker configguide - Supply manifest for creation PV - Add the spinnaker as a service documentation - set the ci.jenkins.enabled to false Change-Id: I66d91aa133085c6c5910913da4303c05fcba9800 Signed-off-by: wutianwei <wutianwei1@huawei.com> - Add nginx services control functionality - Modify nginx server template to use clover-controller in clover-system namespace for file upload - Add ability to set nginx server paths and move uploaded files in clover-controller and set/get file upload metadata - Add cloverctl commands to set nginx server and lb configurations - Add example yaml files to configure nginx server and lb v1/v2 from cloverctl - Modify service definition for http-lb versions to distinguish the two versions for GRPC messaging from clover-controller in SDC deployment yaml Change-Id: I5c6866c5ff3de358939c58ea8c0bde64a69c6eca Signed-off-by: earrage <eddie.arrage@huawei.com> - Improve data ingestion reliability and functionality - Modify deployment namespace to clover-system and account for cassandra moving to the clover-system namespace - Increase k8s compute resource assigned to cassandra to deal with performance issues - Add additional fields (user-agent, request/response size, status codes) to span schema definition and modify primary keys - Improve exception handling to prevent collect process from crashing - Minor changes to support tracing/monitoring with Istio 1.0 - Inhibit logging for debug messages - Increase time back and number of traces to fetch in each sampling interval to deal with Jaeger REST interface returning trace data out of order under load (tested to 300 conn/sec; 12K connections currently) - Move trace insert into batch mode to cassandra - Read visibility services to analyze from redis rather than defaults (cloverctl, UI or clover-controller REST will set) - Remove local directory copies in docker build, as image is based on base clover container Change-Id: Ibae98ef5057e52a6eeddd9ebbcfaeb644caec36c Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-10-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add visibility API in controller and CLI" - Add visibility API in controller and CLI - Modify get visibility to retrieve config and stats - Add visibility REST API in controller to clear, set, and get from redis - Add example yaml to set visibility (service list by name, metric suffixes/prefixes, and custom metrics) from CLI - Modify example yaml to start visibility (collector) for Istio 1.0 from CLI Change-Id: I43304ff6d70bb4b817b345b9c383ce3621fb06c7 Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-10-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add nginx services control functionality" - Add nginx services control functionality - Modify nginx server template to use clover-controller in clover-system namespace for file upload - Add ability to set nginx server paths and move uploaded files in clover-controller and set/get file upload metadata - Add cloverctl commands to set nginx server and lb configurations - Add example yaml files to configure nginx server and lb v1/v2 from cloverctl - Modify service definition for http-lb versions to distinguish the two versions for GRPC messaging from clover-controller in SDC deployment yaml Change-Id: I5c6866c5ff3de358939c58ea8c0bde64a69c6eca Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-10-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Improve data ingestion reliability and functionality" - Improve data ingestion reliability and functionality - Modify deployment namespace to clover-system and account for cassandra moving to the clover-system namespace - Increase k8s compute resource assigned to cassandra to deal with performance issues - Add additional fields (user-agent, request/response size, status codes) to span schema definition and modify primary keys - Improve exception handling to prevent collect process from crashing - Minor changes to support tracing/monitoring with Istio 1.0 - Inhibit logging for debug messages - Increase time back and number of traces to fetch in each sampling interval to deal with Jaeger REST interface returning trace data out of order under load (tested to 300 conn/sec; 12K connections currently) - Move trace insert into batch mode to cassandra - Read visibility services to analyze from redis rather than defaults (cloverctl, UI or clover-controller REST will set) - Remove local directory copies in docker build, as image is based on base clover container Change-Id: Ibae98ef5057e52a6eeddd9ebbcfaeb644caec36c Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-10-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Remove former check_envs call" - Remove former check_envs call Else it raises exceptions in __init__(). Change-Id: I4af1f59fbb9a94da1df132e750525fcdb5d0917b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Updated from global requirements" - Updated from global requirements Change-Id: I81e92ff3db9ca401cc700ff4a9c28c740f7e9060 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add spinnaker configguide" - Add spinnaker configguide - Supply manifest for creation PV - Add the spinnaker as a service documentation - set the ci.jenkins.enabled to false Change-Id: I66d91aa133085c6c5910913da4303c05fcba9800 Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-10-10Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/clover from branch 'master' - Updated from global requirements Change-Id: I92fc0937130b0c70dc5888b64b1082e8816969d4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Local Documentation Builds" - Local Documentation Builds This adds configuration for performing local documentation builds with the following simple command: tox -e docs Change-Id: Ifb8fce66e59432863d042a96308e6c3a89fb11a8 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-09-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add ModSecurity config guide" - Add ModSecurity config guide This patch adds ModSecurity config guide. This patch also deploy the modsecurity and ext_authz filter to clover-gateway namespace. Change-Id: I5ab21e6337b8f8b839ddd028370df378686bd017 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-09-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Spinnaker as a Service" - Spinnaker as a Service JIRA: CLOVER-52 1. Add mainfest to install the spinnaker in kubernetes cluster 2. after using mainfest to install spinnaker, we can interacte with the halyard daemon with its REST API and we can add/delete/list the dockerRegistry/kubernetes accounts. 3. Add the cloverctl to interate with the halyard daemon Change-Id: I71bc5977f2d65aab88fa55f7d7a53ab75eb6a46b Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-09-12Update git submodulesEddie Arrage1-0/+0
* Update docs/submodules/clover from branch 'master' - Fix missing psutil dependency in nginx services - A psutil dependency was added in the latest Clover server version that was not added to the docker builds of the lb/proxy Change-Id: Id48c3446a93d6b9cef65d453266d0bf15eddf6cc Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-09-05Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add file upload/download and configure URL paths" - Add file upload/download and configure URL paths - Compile nginx from source in order to employ additional modules - Add nginx-upload-module for high performance file upload that avoids the need for file copies with a web application. - File upload allows for placement of files for file download for performance benchmarking. - File upload can also be used directly for bi-directional throughput testing having emulated clients upload files while file downloads simultaneously occur. - Nginx file upload stores files with hash to avoid conflicting file names. Upload block in nginx config is configured to send REST message to clover-controller with file metadata (original filename, size, etc.) clover-controller will be responsible for modifying the hashed filename and placing in a target directory within an nginx server. - Build also adds nginx-rtmp module to act as streaming media server L7 loader will be extended to fetch streaming files from RTMP servers. - Add ability to create directories in server site root and create the location directive(s) in nginx configuration - Separated upload for configuration (download files in various paths) from upload for testing (upload to create bi-directional session throughput) - Upload for testing does not sent upload metadata to clover-controller - Added ability to move upload files to file folders in the nginx site root to use for download - Delete files in upload folder - Fixed issue with 426 Upgrade Required error message when upload module sends upload metadata to clover-controller - Added server name to metadata sent to clover-controller Change-Id: Ib4cf6240f92360b82f378c062675f4fdaa19ca93 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-09-05Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Update entry_point to conform with Xtesting" - Update entry_point to conform with Xtesting Functest is being updated to Xtesting 0.60 which leverages on stevedore [1]. [1] https://docs.openstack.org/stevedore/latest/ Change-Id: I2c162c8e08a580f80b547b3a1cd6cc700d12c858 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-05Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Modsecurity as a service" - Modsecurity as a service JIRA: CLOVER-68 1. Add Dockerfile and related files to build clover's modsecurity Docekr container 2. Add mainfest to install the Modsecurity in kubernetes cluster Change-Id: Ia92926e730c04720f931999d7ec30565ce9e54be Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-09-04Update git submodulesWenjing Chu1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add docker and deployment scripts for exemplar video streaming microservice" - Add docker and deployment scripts for exemplar video streaming microservice JIRA: CLOVER-72 This issue falls under the "Edge Cloud-Native Cluster" intern project and is a part of both Clover and Edge cloud projects. The scripts added are of an exemplar video streaming microservice designed to run on the raspberry pi edge cluster. This commit includes the docker scripts to containerize the UV4L stream and the kubernetes deployment script to correctly run the microservice as a pod on the cluster. The detailed description of the project and the instructions for using the scripts are documented in the README. Change-Id: Ice4e5e7e63c2eb617556eaef1255801ffac851e7 Signed-off-by: adarsh1001 <adarshpalsingh1996@gmail.com>
2018-08-31Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add envoy.ext_authz filter" - Add envoy.ext_authz filter JIRA: CLOVER-86 This external authorization HTTP filter calls an external HTTP service (ModSecuruty service) to check if the incoming HTTP request is authorized or not. If the request is deemed unauthorized then the request will be denied normally with 403 (Forbidden) response. Change-Id: I0fe14c73defec027c54f42713cbdf69b0b83e102 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-08-31Update git submodulesAce Lee1-0/+0
* Update docs/submodules/clover from branch 'master' - Bug fix in SDC after istio to 1.0.0 JIRA: CLOVER-84 There will be some Bug in SDC after we upgrade the Istio to 1.0.0 Istio 1.0 have some concept, for example : virtualservice gateway. So we change the yaml file using the 1.0.0 concepts. Add mirror function Change-Id: Id138cfec2c7d94b44eb508a056c91e193ac1b08b Signed-off-by: Ace Lee <liyin11@huawei.com>
2018-08-21Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "upgrade istio to 1.0.0" - upgrade istio to 1.0.0 JIRA: CLOVER-84 we change the env in clover and change some deploy script. will upgrade the doc later Change-Id: I73a78afb91676efc3278b623c5d263a4a215ccd9 Signed-off-by: Ace Lee <liyin11@huawei.com>
2018-08-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Implement initial clover-controller service" - Implement initial clover-controller service - First pass of clover-controller which resides within the k8s cluster and provides interfaces to all Clover services - Only service that should need to be exposed outside of cluster - Docker build of container that uses stack of nginx, gunicorn and flask to provide REST interface - REST interface is intended to serve cloverctl CLI and dashboard browser UI - Implements GRPC messaging to clover-collector and snort - GRPC interfaces files for snort/nginx are added to container from repo. Collector GRPC files will be removed from controller/control/api once patch below is merged https://gerrit.opnfv.org/gerrit/#/c/57245/ and added similarly - Provides first pass callback for file upload from clover-server. - Some REST messages implement JSON for passing params to internal services - Redis interface added to obtain data from services. Currently, a simple interface to retrieve snort event information - YAML manifest renderer to add to k8s. Uses NodePort service currently, defaulting to port 32044. - Removed collector gRPC interface files with merge of collector - Expose tracing and monitoring host/port parameters, as these vary depending on Istio version and Jaeger version - Add logging to flask blueprints - Added jmeter blueprint interface with REST for testplan generation, start test and result retrieval - Added flask Response to REST reply messages - Retrieve some basic stats from collector in json response Change-Id: I59eaeb860445ade4b45bba22747a61fb0cf0bbd4 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-08-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Implement initial cloverctl CLI tool" - Implement initial cloverctl CLI tool - Uses client-go package to interface to k8s API and implement functions as cloverkube package. - Identifies GKE LB IP for clover-controller for user - Identifies NodePort port number for clover-controller for user if environment is local k8s (assumes flannel CNI currently) - Deploys and deletes clover-collector and clover-controller with native client-go constructs (currently images are defined with local registry). Future work will implement other clover services and Istio components. Uses the clover-system namespace. - Uses Cobra go package to implement CLI (used in kubectl and istioctl) using cloverctl <verb> <noun> convention. - Interfaces to clover-controller to configure clover services (visibility, IDS ...) within the cluster via REST messaging - Start visibility (collector) engine using input yaml file or defaults - Init, stop and clear (truncate Cassandra tables) visibility engine or get basic stats. - Add custom rules to IDS from input yaml file and start/stop IDS - Generate jmeter testplan on jmeter-master using input yaml file. Start tests and output log/results from CLI. - Specify number of jmeter slaves to initiate tests on from CLI. Automatically find IP addresses of jmeter slaves within the k8s cluster. - Sample yaml files for adding IDS rules, starting visibility engine and generating jmeter test plans. - Build script to install go and get dependent packages. - Implement a custom Istio inject package for manual sidecar injection (cloverinject). Currently, unused as it is built from Istio 0.8.0/1.0.0 code base. Change-Id: Ibb8d08cb98267bdffb8905c221473f177d51bbb3 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-08-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Implement initial Jmeter master/slave containers" - Implement initial Jmeter master/slave containers - Jmeter can be used for L4-7 functional and performance testing - Jmeter master has gRPC server for management - Generates Jmeter test plans from minimal yaml params file (sample to be added with cloverctl) using template - Optionally span tests across slave containers to allow greater loads to be generated - Specify loop/thread/slave count and URL list, which dictates target and number of connections that will be attempted - clover-controller will interface to gRPC interface on Jmeter master - Start tests on master and retrieve log/result files - Render master and slave k8s manifests files Change-Id: Id144c8f551b7d375ff252c8de0611f895b50387c Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-08-14Update git submodulesWenjing Chu1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add ansible scripts for raspberry pi based kubernetes edge cluster" - Add ansible scripts for raspberry pi based kubernetes edge cluster JIRA: CLOVER-71 This issue falls under the "Edge Cloud-Native Cluster" intern project and is a part of both Clover and Edge cloud projects. The detailed description of the project and the instructions for using the scripts are documented in the README. Change-Id: I4fdb98f17ae0c53f918376ad6fb90be8ff0b0a71 Signed-off-by: adarsh1001 <adarshpalsingh1996@gmail.com>
2018-08-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Adding cassandra service with a separate yaml file." - Adding cassandra service with a separate yaml file. - Left the file samples/scenarios/service_delivery_controller_opnfv.yaml unchanged. - Added a yaml definition of Cassandra StatefulSet and its service into a separate file under tools directory - Cassandra Service run with 1 replica - Deleted 'data-plane-ns' and use 'default' instead for cassandra containers. - Revoked changes for samples/scenarios/service_delivery_controller_opnfv.yaml. - Added new line (Wutien suggested it) JIRA: CLOVER-000 Change-Id: I2bb4249cf2523f5011d6fefc69dc469a90e20eaf Signed-off-by: iharijono <indra.harijono@huawei.com>
2018-08-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Adding clearwater IMS yaml and clearwater live test dockerfile to test istio service-mesh" - Adding clearwater IMS yaml and clearwater live test dockerfile to test istio service-mesh Checking into CLEARWATER_ISTIO branch This part of the project is intended to validate the clearwater IMS with istio service-mesh. Change-Id: Ia5ba86301a363fcf9cfe0bac525606b0d897713e Signed-off-by: Muhammad Shaikh (Salman) <muhammad.shaikh@huawei.com>
2018-08-01Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "[Clover] using elasticsearch to store log" - [Clover] using elasticsearch to store log Change-Id: I0335fa912a3ca2dff5c989fa06183065216f10e4 Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-07-07Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Initial commit for Clover Collector" - Initial commit for Clover Collector - Added a container named clover-collector using clover container as a base with build script - GRPC server to manage collector process - Cassandra DB client interface to initialize visibility keyspace - Init messaging adds table schemas for tracing - traces & spans - Adds table for monitoring - metrics - Does not implement Cassandra server but developed using public Cassandra docker container - Collector process in simple loop that periodically fetches traces and monitoring data and inserts to Cassandra - not optimized for batch retrieval yet for monitoring - CLI interface added to collector process and used by GRPC server for configuration - Simple GRPC client script to test GRPC server and start/stop of collector process - Collector process can be configured with access for tracing, monitoring and Cassandra - Added a return value in monitoring query method - Added ability to truncate tracing, metrics and spans tables in cql - Added cql prepared statements and batch insert for metrics and spans - Align cql connection to cql deployment within k8s - Fix issue with cql host list using ast and collect process args with background argument - Added redis interface to accept service/metric list externally for monitoring (will work in conjunction with clover-controller) - Use k8s DNS names and default ports for monitoring, tracing and cassandra - Added yaml manifest renderer/template for collector Change-Id: I3e4353e28844c4ce9c185ff4638012b66c7fff67 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-07-07Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Sleep 1 sec after set test." - Sleep 1 sec after set test. if we set testid and start test immediately, the first test's result can't be got from jaeger Change-Id: Ia2ab8a91d8c5f9956ea4d3d7c2436fb05490acee Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-07-07Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "[clover] Add script to setup k8s" - [clover] Add script to setup k8s what the script do 1. git clone the XCI repo 2. set variable to deploy k8s how to use run the below command in you teminal ./xci-k8s-setup.sh requirement 1. don't under the root user 2. run sudo without password Change-Id: I5015e12d8d3b0db31285d5e817b3c40d6739ba22 Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-06-28Update git submodulesAric Gardner1-0/+0
* Update docs/submodules/clover from branch 'master' - Fix project LEAD in INFO.yaml Change-Id: Iff9c7bfbae8f5ca46ef88634d4864cd27512aa8a Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-06-15Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Streaming logs from application container" - Streaming logs from application container Change-Id: I6a1e526bec4160bcdac32d4124acb110b9cf6959 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-06-15Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add support for node level logging" - Add support for node level logging Change-Id: Ib5b2240de3276164fe9e272bf36f0d1f89f409c0 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-06-15Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "fix the sdc sample deploy issue" - fix the sdc sample deploy issue there is a issue "No module named google.protobuf", when trying to run the services docker. Add the protobuf in services Dockerfile. Change-Id: I280dc1d5908bcec784e9e1e7c4d07e145f092cdb Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-06-15Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Fix typo of Jaeger port" - Fix typo of Jaeger port Change-Id: I70b766fe26e750fef6a622344d69ad4f6e2b8962 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-06-15Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Fix error in logging installation" - Fix error in logging installation It must be done in two steps otherwise the mixer adapter may not be initialized correctly. Change-Id: Ie59e811fc287fbd52a007be45f0f9c74983149b3 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2018-05-24Update git submodulesAric Gardner1-0/+0
* Update docs/submodules/clover from branch 'master' - Remove INFO file, we only need to maintain INFO.yaml Change-Id: I51fbdaf6991cb43a7cb1b2ce01099e0ed385df13 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-04-27Update git submodulesEddie Arrage1-0/+0
* Update docs/submodules/clover from branch 'master' - Update docs with edits and proper release tag - Incorporated feedback from doc reviews - Fix some rendering issues - Add redis inspect section - Update SDC deploy instructions using Fraser release tag Change-Id: I573dcd04066ad83b9c659fae645c65ab4aaa2007 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-04-26Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Write A-B configuration guide and align with SDC guide" - Write A-B configuration guide and align with SDC guide - Document A-B sample validation script - Remove redundant TOC in docs - Provide reference links in SDC guide - Additional edits to SDC guide Change-Id: Id4135c99df688f7de1af18017c847a6546082bfc Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-04-26Update git submodulesEddie Arrage1-0/+0
* Update docs/submodules/clover from branch 'master' - Updated user guide with edits and reference links - Provided some overall edits to user guide - Fixed titles of index files for release notes and user guide - Added links to SDC, A-B configuration guides and logging, tracing and monitoring install/validation docs Change-Id: I9a0e1e0a2c12b20400eec5a5642f7c5de2dbd7bf Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-04-25Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Experimental commit for A-B testing with Clover Fraser release and on the SDC application" - Experimental commit for A-B testing with Clover Fraser release and on the SDC application Change-Id: I6e1bd84a6d674a2c4c4484722b20415f5402a59c Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
2018-04-25Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Created config guide for SDC sample app" - Created config guide for SDC sample app - Overview with micro-service diagram - Source diagram file in GIMP with layers for editing by others - Deploying the sample - Using the sample - Exposing Jaeger Tracing and Prometheus monitoring browser interfaces - Modifying run-time micro-service configuration including modifying load balancer server list and adding a custom snort rule - Uninstalling the sample - Updated overview with service description, table and traffic flow description, general edits - Link to A/B configuration guide and doc index file - Additional edits - Diagram for Jaeger UI with SDC Change-Id: I5d851316c05a9e1bd48c8aab5511a98116e6893d Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-04-24Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Simplification of Clover Fraser official docs (Double commit from master:I89adbef74aa74071a055dcdf62aa0925e263ffe3, gerrit 56167) Change-Id: I86f12d5ba67f09177eca758c184c614ee9d6dd9d Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
2018-04-24Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Fix snort rule with blank content & WR packet in alert" - Fix snort rule with blank content & WR packet in alert - Fix bug with addition of content field in rule definition that causes rules with a blank content fields to inhibit snort from starting successfully. - Write more of the packet data for snort alert into Redis - Above includes X-Real-IP, X-Forwarded-For header fields for http traffic from proxy that shows source IP Some packet data is missing in alerts from snort. Change-Id: I2c5c29e514d1ca9e8e5b9b3f7990afa87c6311b9 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-04-24Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Fraser official docs simplification [TBD]: link to configguide for sample VNF, link to A-B testing configguide Change-Id: I89adbef74aa74071a055dcdf62aa0925e263ffe3 Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
2018-04-19Update git submodulesStephen Wong1-0/+0
* Update docs/submodules/clover from branch 'master' - Merge "Add section to help user understand how logging works" - Add section to help user understand how logging works Change-Id: Iebfb747450cc08e930eabd36a87670236b23ffff Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>