Age | Commit message (Collapse) | Author | Files | Lines |
|
go-1.11 version such that it would be compatible with netlink library
Change-Id: Iaecef476c651b3359021574678274e78d865f614
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
Change-Id: I6fde9161896115b5acd460cd7457df1a59ee1f6e
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
Change-Id: I9449ee5f699a3cdf471dc8b405de650325ae09f6
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
instance dying abnormally (qdisc deletion is part of exit callback for pod under monitoring, but if clovisor exits abnormally, qdisc would not be deleted, which cause the restarted new clovisor pod unable to load BPF code to the pods under monitoring)"
|
|
instance dying abnormally (qdisc deletion is part of exit callback for
pod under monitoring, but if clovisor exits abnormally, qdisc would not
be deleted, which cause the restarted new clovisor pod unable to load
BPF code to the pods under monitoring)
Change-Id: I5620f34e7f05805e203d1cfda9a8f7a1d42fd4f5
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
|
|
1.) make clovisor work on GKE
2.) running more efficient correlation between k8s service, pods, and
service port name for the pod's container port
3.) add per session trace metrics on Clovisor's traces, including
request and response sizes, trace-id, request-id, and more HTTP header
fields
4.) improve eBPF code to account for TCP sessions which do not finish with
either FIN or RST flags
5.) tested with Clover sample app (the "SDC")
Change-Id: Ia1a6275caf31a63fb1288c93cea42b32a4606307
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
JIRA: CLOVER-99
1. Upgrade the spinnaker to 1.10.5 from 1.7.0
2. Enable the artifact featuer and add s3 artifact
3. Add the user guide to deploy helm charts.
Change-Id: Ic44a88525cc609f3a24d3873b796f064436a57bf
Signed-off-by: wutianwei <wutianwei1@huawei.com>
|
|
- Updates the rpm package download for snort. The docker build
is currently failing due a stale link.
Change-Id: If7cf6b0d29f39be9eb7d5f08b59d763f4715a4c1
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
|
|
- Update the cloverctl tarball with the final Gambia
version
- Install redis to default and clover-system namespaces
when executing 'cloverctl create system visibility'. This
is a hack for now until we update all Clover services to
use redis in clover-system.
- Modify the tag override for 'cloverctl create system'
to use opnfv-7.0.0 instead of latest.
- The opnfv-7.0.0 tag will be created for all Clover
OPNFV DockerHub containers
Change-Id: I5c63a2adc6b822dfbd76ab4081e77aac3381a4df
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- Convert instructions on how to modify runtime config
of snort-ids and http-lb services using cloverctl rather than
using python gRPC client script
- Remove A-B validation from the SDC guide and from the config
guide index, as it was not updated from Fraser to Gambia
- Add a yaml to add icmp ids rule
Change-Id: I0c5391d9eac0130586d4ab25543a3d308c2ed558
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- Add description of new VirtualService and Gateway resources
in Istio 1.0
- Modify manual inject commands to match Istio 1.0
- Update tracing UI graphic with Jaeger that is integrated with Istio 1.0
- Update Istio pod listing
- Update how to expose Prometheus and Jaeger
- Fix the commands to remove Istio 1.0
- Modify SDC yaml for local Docker registry case
Change-Id: I51e2b876699eae48714e94e33e56191364a0dbe5
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
|
|
- Updates to jmeter validation and controller services
guides
- Image for jmeter guide
Change-Id: I175c4052f005d6fbebde8afbcb2bda1df4a4d6d9
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
prometheus has been installed in istio 1.0
so we need to delete the view.sh file.
but we need to change to to NodePort way to expose the port
Change-Id: I8ae6bc1c251ba5effbc94efe984384af6e64adfc
Signed-off-by: Ace Lee <liyin11@huawei.com>
|
|
|
|
Change-Id: I474ccaed8fa16d934f770b555211b6a30ba7bfae
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
configuration guide
Change-Id: I65da13cb9ce503f9b5b2fd2457f147549a13b9f6
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
|
|
|
|
|
|
Change-Id: I9b354e85f7f86872617904dd84ff5f0c516e1ffb
Signed-off-by: Sofia Wallin <sofia.wallin@est.tech>
|
|
- Controller services lump cloverctl CLI and clover-controller
together and this config guide provides brief overview
and deploy/delete instructions
- Intended to be one of the first guides a user follows,
as controller is prerequisite for many other Clover services
- Add new, existing config guides to index
including forthcoming jmeter, visibility guides
- Embedded images forthcoming
Change-Id: Ifef0248d9370df862a1d192b979606e443a82e95
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- Provides brief overview and usage instructions including:
- delete/deploy in k8s using cloverctl CLI and source
- Generate the test plan on the master
- Start tests on master or with slaves
- Retrieve results using cloverctl and interpret
- Embedded images forthcoming
Change-Id: Ibbfa21f5d73c76c16ffac115ad0164c5cf210236
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- This file will be updated when outstanding patches
are merged.
- This is a test for the config guide docs to validate
download procedure.
Change-Id: Iebc79b14b1e74ca09f85f1f5846b0f4f43c782ba
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
Change-Id: I9e878b0302623266a7c900f5ca53825d7a3492c3
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
|
|
|
|
- Improve usability when deploying or deleting various
Clover components using cloverctl
- Add yaml for each of the clover-system services
including controller, collector, spark, redis, cassandra,
clovisor and jmeter separated by k8s resource and available
under a single yaml directory
- Deploy/delete yaml for services in various subsets including:
- visibility(controller, collector, spark, redis, cassandra)
- datastore(redis, cassandra)
- validation(jmeter master/slaves(4))
- clovisor (individually)
- collector (individually)
- controller (individually)
Ex. cloverctl create system controller
Ex. cloverctl create system visibility
- Ability to add nodeport for controller separately
(cloverctl create system controller nodeport)
- Use native client-go methods to create/delete all k8s resources
used by Clover including:
- pods, deployments, statefulsets, daemonsets, services
- serviceaccounts, clusterrolebindings
- Above allows yaml override of values such as image value specified
in deployment or daemonset. This is broken down by:
- tag (ex. latest, opnfv-7.0.0) or repo'(ex. opnfv, localhost:5000)
that can be added with CLI flags as shown below:
(cloverctl create system visibility -t latest -r localhost:5000)
- defaults to -r opnfv -t latest
- Creates/deletes clover-system namespace
- Also added ability to create/delete lb service for controller
external access when running on environment such as GKE
(cloverctl <create/delete> system controller lb)
Change-Id: I2a3c6c80035d4663fa38368b3ff13e9a14090a47
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- Formalize use of cloverctl config file using viper
- Default name of config file is '.cloverctl.yaml'
- Look for file in home directory or relative to
cloverctl executable
- Single value in config is for 'ControllerIP: <IP Address>'
- Still try and retrieve port value of clover-controller nodeport
automatically
- Still try and retrieve IP address of clover-controller LB if
GKE environment is being used and override config file value if found
in current kube context
- Improve error messaging if controller connect fails
- Clean up the CLI help output
- Modify jmeter 'get testresult' command to avoid the use
of flags and use arguments instead
Change-Id: Id95d1b3d1079ac84996681db62da1f9b6b8a88b5
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
Change-Id: Ied0ef2ccd4eb95cace68826a1494e82f2c18d95c
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
|
|
- Change tag from local repo to opnfv for clover-spark
container, which spark-submit references
- Move update of configured visibility services into
loop
Change-Id: I9d09a851977c6006ea2cbba45d7a28be6a4660b9
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- Add user-agent field to jmeter config yaml and jmeter jmx
template that can be configured per URL in testplan
- Add duration time that can be used in combination with
ramp time. Duration is the total time of the test while
ramp time governs how much time is allotted to establish
all configured requests/connections
- Explicitly define clover-jmeter-master service name with
default namespace for clover-controller in clover-system
namespace to reach
- Add missing request_counts.html file
Change-Id: I5e2d388db0b73ea6c28482c94c33cc2a01f1b52e
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
|
|
|
|
|
|
|
|
|
|
Part of Clover's initial task (during project proposal) is to explore
cloud native network tracing tools. Clover the project proposes
Clovisor as a way for Clover to use the IOvisor
(https://www.iovisor.org/) to perform network tracing. This is the first
commit of this module
Please note that the BPF code used in this commit were only tested with
Linux kernel 4.14+ --- hence, if ubuntu is used, and one prefers LTS,
the requirement is 18.04+
A different patch will track the redis and k8s API server watcher code
Also, a design doc will be added in the future (TBD)
Signed-off-by: Stephen Wong <stephen.kf.wong@gmail.com>
Change-Id: I30d9f9d474b8703097c470d39628e86bc788f9b6
|
|
- Add foundation, jquery and jquery-ui open source js/css
packages for skin, layout and AJAX
- Add plotly and candela js open source graphing packages
- Build core visibility view and provide toplevel templates,
headers, menu navigation, etc.
- Update collector/visibility APIs to align to latest Spark
analytics and UI requirements
- Refresh page elements at 5 second interval.
- Visibility controls to stop continual page refresh and clear
visibility.
- Multi-select and update service set to analyze.
- System count updates for tracing, spans, metrics schemas.
- Min/max/avg response times per service (aggregate) table.
- Graphs for: per service request counts, user-agent percentages,
per service/URL counts, per URL/status code counts, per URL counts
- Tabs for distinct URLs, status codes, user-agents, upstream cluster,
operation names, nodeids (service names)
- Table for metrics counters specified in visibility configuration.
- Metrics over time scatter plots for tracked metrics.
Change-Id: Ie3ea12fd32e0274ac52f78becc4a56c4c4134660
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
The clover-ns-modsecurity-crs docker image is now built by Jenkins and uploaded
to the OPNFV docker hub.
This patch updates the modsecurity deployment kubernetes manifest to pull image from OPNFV docker hub.
Change-Id: I7e8afd27f726600de9247fc98fe3f5d491000f1c
Signed-off-by: JingLu5 <lvjing5@huawei.com>
|
|
|
|
Adds the missing index.rst needed to build the documentation.
Change-Id: I6ff27873559718a5ca4e3120646a6ef347120c8a
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
|
|
- Docker container builds are failing due to expired links
for the jmeter binary for jmeter-master and jmeter-slave
- Updated link provided
Change-Id: Icb364bc234b118e0c00359a04b51461142f832af
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
- Add Apache Spark 2.3 with native Kubernetes support.
- Runs self contained within K8s cluster in clover-system
namespace. One container (clover-spark) includes Clover Spark
JAR artifact. This container interacts with the
K8s API to spawn a spark-driver pod. This pod in turn spawns executor
pods to execute Spark jobs.
- Currently JAR is included in source for convenience and must be
built with sbt (install sbt and execute sbt package)
- Includes JAR from DataStax to provide Cassandra connector to analyze
Cassandra schemas as RDDs (Resilient Distributed Dataset).
- Includes Redis interface JAR to write analyzed data back to visibility
(UI, CLI or API).
- Second container (clover-spark-submit) submits Spark jobs
continuously to allow Spark to be operated entirely within the cluster.
- Two Spark jobs (CloverSlow, CloverFast) allows some analytics to be
provided in real-time and other analytics to be provided over longer
horizons.
- Each Spark job spawns two executor pods.
- Includes yaml manifest to deploy clover-spark-submit with the
necessary RBAC permissions to interact with the K8s API.
- Data analyzed includes tracing and metrics schemas obtained by
clover-collector and written to Cassandra.
- Docker builds of clover-spark and clover-spark-submit are provided
and will be pushed as OPNFV DockerHub images in a separate patch.
Change-Id: I2e92c41fd75d4ebba948c0f8cb60face57005e50
Signed-off-by: earrage <eddie.arrage@huawei.com>
|
|
|
|
|
|
|
|
|