aboutsummaryrefslogtreecommitdiffstats
path: root/docker/ansible/roles
AgeCommit message (Collapse)AuthorFilesLines
2021-12-17Merge changes from topic "collectd_6_testing"Emma Foley3-2/+74
* changes: Add a playbook that tests collectd 6 vs collectd5 [docker][ansible] Add a playbook for building the containers Create a flask app to show metrics from collectd
2021-12-17[grafana] Update Dashboard for CPU UsageEmma Foley1-0/+3
After the introduction of the collectd_config roles, for generating configs, some of the configs changed, as they were no longer relying on collectd's defaults. One of these was the cpu plugin, which configured ``ReportPercentage True`` by the config role. The effected the grafana dashboards, because the CPU usage dashboard explicitly selected ``type=cpu``. With the values being reported as percentage, collectd sets the ``type=percent`` for the metrics stored in influx (which grafana retrieves), so the dashboards dodn't have any data to display. By removing the ``type=cpu`` filter, the CPU metrics are once again showing in grafana, and will be shown whether the CPU usage is reported in percentage or the default jiffies. Signed-off-by: "Emma Foley <efoley@redhat.com>" Change-Id: I03a6f01677514d888e7805358855947791ab173c
2021-12-17Add a playbook that tests collectd 6 vs collectd5Emma Foley3-3/+4
The playbook will: * build collectd-6, collectd-latest and flask app containers * generate a set of collectd configs * launch the collectd-6, collectd-latest with the generated configs * run the flask app which has a http_server that receives metrics from collectd v5 and collectd v6 * display the received metrics from both versions of collectd Collectd v5 shows PUTVAL Collectd v6 shows PUTMETRIC The playbook takes the following parameters: * PR (optional) The PRID for an upstream collectd pull request that will be passed to the collectd 6 container build * plugin (optional) The name of the plugin that is bneing ported This will filter the received metrics to show the value passed. Additional updates to existing roles include: * run_collectd parameterises the collectd container name so that the role can be reused for launching multiple collectd containers by passing distinct names. Change-Id: Ia62196c347387d380aae69e14ed0dd8e2c76d9c9 Signed-off-by: Emma Foley <efoley@redhat.com>
2021-12-17[docker][ansible] Add a playbook for building the containersEmma Foley1-0/+71
To run the playbook and build the containers, run:: sudo ansible-playbook docker/ansible/collectd_build.yml Change-Id: I60e044f09c8da53f6d5a56d2aaa7b837b19a0b0b Signed-off-by: Emma Foley <efoley@redhat.com>
2021-12-13Merge "[ansible][logparser] Enable logparser by default in one-click install"Emma Foley2-3/+2
2021-09-13[ansible][logparser] Enable logparser by default in one-click installEmma Foley2-3/+2
Signed-off-by: "Emma Foley <efoley@redhat.com>" Change-Id: I6dd8e166433feab16dd06c9767e58d6d96ca948d
2021-09-13[containers] Use anuket/ namespace for containersEmma Foley5-19/+19
Change-Id: If0bea94be66a2c5b88d88e6c70a4c27a9001a3d9 Signed-off-by: Emma Foley <efoley@redhat.com>
2021-08-30[dpdk] Remove dpdkstats and dpdkevents pluginsEmma Foley3-79/+0
Remove old dpdk plugins, since they are superceeded by dpdk_telemetry plugin. JIRA: https://jira.anuket.io/browse/BAROMETER-183 Change-Id: Ie4abf2b1fe37a2197d9d5dd01820ac8b0d01df6d Signed-off-by: Emma Foley <efoley@redhat.com>
2021-08-30Merge "[ansible] Use collectd_config for virt and rdt"Emma Foley5-67/+16
2021-08-26[ansible] Add unixsock to config_files roleEmma Foley1-0/+6
The unixsock plugin is useful for debugging issues in collectd, and can be used to verify that metrics are being collected without having to create CSV files or log into the container. Typically, the unixsock plugin can be queried using the following syntax:: $ docker exec bar-collectd /opt/collectd/bin/collectdctl -s /var/run/collectd-socket listval Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: Id342fe7659c809f4eec71085ae6572f9d855684c
2021-08-26[ansible] Use collectd_config for virt and rdtEmma Foley5-67/+16
Only one of virt and intel_rdt can be enabled at a time, and the existing checks are based on the existance of a {rdt,virt}.conf file to determine whether the other plugin is enabled. This check needed updating, and is now based on whether the other plugin is in the collectd_plugins value. Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: I175d60111bf133965e1ecbf3764cb12a25356576
2021-08-26[ansible] Use collectd_config for pluginsEmma Foley31-430/+117
* Update the following plugins to use collectd_config role * capabilities * csv * dpdk_telemetry * exec * hugepages * ipmi * logfile * network * ovs_events * ovs_stats * syslog * uuid * write_kafka * write_prometheus JIRA: BAROMETER-180 Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: I2ec9e3c2db2c1d907459b40550012834196f0c65
2021-08-26[ansible] Use collectd_config for default_read_pluginsEmma Foley2-103/+31
Update default_plugins to use the collectd_config role [1] [1] https://github.com/infrawatch/collectd-config-ansible-role JIRA: BAROMETER-180 Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: I9ff9bf642b641132771965346d65c95a3d66b996
2021-07-01Merge "[ansible] Use collectd_config in config_files role"Emma Foley4-53/+95
2021-07-01Merge "[ansible][default_plugins] Update how the default plugins are enabled"Emma Foley4-37/+25
2021-06-17[ansible] Use collectd_config in config_files roleEmma Foley4-53/+95
* Add tasks to use collectd_config * Move generated configs to combine with existing and additional configs * Move vars to defaults dir Some of the vars are needed for the collectd_config role, and need to be set before the other values are set. JIRA: BAROMETER-180 Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: Id5a8b8289c5e120eae7eb5bcf946c5d4dd9fdd48
2021-06-16[ansible] Update naming master->latest for SNMP templateEmma Foley2-2/+2
* config_files: Rename templates/master to templates/latest Change-Id: I5db6491695bf35a87851f779603dc16454c117d5 Signed-off-by: Emma Foley <efoley@redhat.com>
2021-06-15[ansible][default_plugins] Update how the default plugins are enabledEmma Foley4-37/+25
By adding the "en_default_all" tag to each task in the default_read_import task, there is no need to have different tasks for that tag vs when individual plugin tags are enabled. JIRA: BAROMETER-180 Change-Id: I15cc77959bbd25516e9da10af064abeea5527ea9 Signed-off-by: Emma Foley <efoley@redhat.com>
2021-06-03[docker] Add collectd-6Emma Foley1-2/+3
* Add instruction to docs/ for using docker/barometer-collectd-experimental/Dockerfile to build collectd version 6 * Add a new COLLECTD_FLAVOR to src/collectd/Makefile to configure tags for a collectd 6 build. * Allow passing COLLECTD_CONFIG_CMD_ARGS to the collectd build For testing with new plugins for collectd-6, as un-ported plugins are disabled by default. This new option lets the ./configure command be run with extra args, e.g. --enable-cpu --enable-<my-newly-ported-plugin>, which means that plugin can be enabled for the PR that is being tested. * Update flavor_image_name selection to include collectd-6 Change-Id: I55ee0bbcb5d89357b1ef11ab17c5b029603ecdf7 Signed-off-by: Emma Foley <efoley@redhat.com>
2021-04-09[ansible][capabilities] Remove the capabilities template from experimentalEmma Foley2-2/+1
Capabilities plugin was interoduced in collectd-5.11, which is part of the barometer-collectd container, so it can be included by default. Change-Id: Ia91d883907025ab8618b39147e14d47a4fc541c3 Signed-off-by: Emma Foley <efoley@redhat.com>
2020-11-24[ansible][dpdk] Disable dpdkstats and dpdkevents by defaultEmma Foley1-0/+3
The dpdk_telemetry plugin superceeds the dpdk{stats,events} plugins, and these cannot be enabled together. Since the stable container on CentOS 8 uses DPDK 19.11, the dpdk_telemetry plugin should be used instead. Change-Id: I20e087b40ff90ba95741aaff641ef1a745d77dd8 Signed-off-by: Emma Foley <efoley@redhat.com>
2020-11-11[ansible] remove deprecated filtersEmma Foley6-11/+11
The succeeded and failed checks are no longer supported for use as filters. Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: If5bdae81b34c1e63d7a2bda349beee5823e2550d
2020-10-06Enabling dpdk_telemetry pluginJabir Kanhira Kadavathu2-0/+27
Enabling dpdk_telemetry plugin with One Click Install. Added the config. templates and the related Documentation. Signed-off-by: Jabir Kanhira Kadavathu <jabir.kanhira.kadavathu@intel.com> Change-Id: Ibecd96d4102cd76a71d31613879ae57950f5108f
2020-07-14Temperorily revert "Rename collectd container to barometer-collectd-latest"Emma Foley3-3/+3
This reverts commit 59338794c8ae8ff82c00dc14ea47a9279cc213d4. The reason for reverting is that there is not yet a container image available on Dockerhub for barometer-collectd-latest Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: Ia6e37af99787a6c02eb368fc7bfdd9d584716f2b
2020-06-30Rename collectd container to barometer-collectd-latestEmma Foley3-3/+3
Change-Id: I0dfff659b4e05e3e619ea62f1771db79f7a8f0df Signed-off-by: Emma Foley <efoley@redhat.com>
2020-05-25Update SNMP agent configEmma Foley1-5/+14
The one-click install was not working with SNMP. The manual install also wasn't working due to the ``Instance true`` config option in the config. ``Instance true`` is not a valid config option for snmp agent. This option appears in the stable container config, and also in the ansible config, but not in the master container. Removing this unsupported option allows the config to be read and collectd to be started. JIRA: BAROMETER-134 Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: If154b3190d82d1cd3638a9c258d2b48bb0efe9af
2020-01-30Temperarily disable SNMP in one click installEmma Foley1-1/+1
SNMP config has been causing the one click install to fail. Disabling it temperorily so that it doesn't block Iruya release JIRA: BAROMETER-134 Change-Id: Ia7944eb6461497c0cd17a2f7ba5b2c2018ffd2a2 Signed-off-by: Emma Foley <efoley@redhat.com>
2019-12-17Merge "Updates/Fix on Legal/License Headers"Matthias Runge7-12/+35
2019-12-17Updates/Fix on Legal/License Headersjabirkkclt7-12/+35
Signed-off-by: jabirkkclt <jabir.kanhira.kadavathu@intel.com> Change-Id: Id29ba83455d2cea21ec634d3e0eee38d84de465b
2019-12-13Merge "Fix the Makefile for intel-cmt-cat so it can be build without errors ↵Matthias Runge1-5/+20
on CentOS 7. Mount the /sys/fs/resctrl from host to container to avoid issues with intel_rdt plugin."
2019-12-09Fix the Makefile for intel-cmt-cat so it can be build without errors onjabirkkclt1-5/+20
CentOS 7. Mount the /sys/fs/resctrl from host to container to avoid issues with intel_rdt plugin. Change-Id: I04d22fccb950aabbde774c1850a5b44ee57908f5 Signed-off-by: jabirkkclt <jabir.kanhira.kadavathu@intel.com> Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2019-12-06Add capabilities plugin (PR 3292 on collectd github) to experimental ↵jabirkkclt3-0/+47
container. Update one-click install of experimental container to add capabilities plugin. Signed-off-by: jabirkkclt <jabir.kanhira.kadavathu@intel.com> Change-Id: I1753c4d8af279ad9c7de29e7a198dbd8161c516d
2019-10-02Update ansible scripts to use py3 for Ubuntu and FedoraEmma Foley3-4/+60
Signed-off-by: Emma Foley <efoley@redhat.com> Change-Id: Ia62933a4b824f1280a693fc8004d29c67dc5e2ac
2019-05-08ansible: add variable to select collectd containerKamil Wiatrowski7-4/+531
Add a variable to playbooks to select type of collectd container. Container flavor can be stable, master or experimental. Change-Id: Ie591ca3b7816210c377c5bffbb54117f8ee764aa Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2019-05-07barometer: update conf filesKamil Wiatrowski1-1/+2
Updated intel_pmu.conf for ansible installation to monitor cores 0-4 by default. Add sample conf files for plugins supported by master container: pcie_errors and write_prometheus. Change-Id: Ifedff2f3b099f5d7b5a88d14909c3879d38e4e64 Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2019-04-03ansible: Add zookeeper to one click installKamil Wiatrowski2-3/+44
Previously 'zookeeper' docker container should be installed manually by user - now it is a part of ansible one click install for VES. Change-Id: If3873cffa51ddf04d2c3769705259aaf5928cc45 Signed-off-by: Radoslaw Jablonski <radoslawx.jablonski@intel.com> Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2019-03-21ansible-kafka: Fix zookeeper_host_ip valueRadoslaw Jablonski1-1/+1
Previously 'zookeeper_host_ip' was set to 'localhost' instead of IP address - this caused error during starting kafka container. Change-Id: I55cf6e3375e3d08df2baf69f678aaab74f4aa408 Signed-off-by: Radoslaw Jablonski <radoslawx.jablonski@intel.com>
2019-01-10ansible: install mcelog from sources on Ubuntu 18.04Kamil Wiatrowski2-0/+49
On Ubuntu 18 mcelog is no longer available through apt from standard repositories. It can be downloaded directly, and make on target machine. Mcelog version 161 is used. Change-Id: Ie24990869190f86efa26994081d4f887f879c867 Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2018-12-03Add support for dpdk events and stat to ansible installationKamil Wiatrowski4-0/+92
Add dpdk plugins to ansible installation with default configuration. Change-Id: I1f7949962aff5119141b5712bb6b32db8f45b287 Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2018-10-31Add support for multi influx hostsJohn O Loughlin3-7/+26
Added support for multiple influx hosts. Fix issue where ansible crashes when influx_host is not defined Change-Id: I348e53c9b6147b0fafffdebcd80037acb72d67ce Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-10-11ansible: Set IP address of influxdb for grafanaKamil Wiatrowski2-8/+5
Set ip address to influxdb for grafana based on provided hostname. IP address in numerical format is required by grafana container. Mapping of hostname in /etc/hosts is no longer required. Change-Id: I684de737c6f8e48b5b9f256541901852d7ecc05a Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2018-10-09ansible: Add cleanup for grafana cache under host machineRadoslaw Jablonski1-0/+6
Previously cleaning cache directory for grafana(/var/lib/grafana) was missing and, because of that, changing influxdb_host variable value between one ansible deployment and another was not working. It was a problem because scripts in grafana container are expecting that cache directory will be empty during first run and, if some dashboards exists in cache already (even if they are left by previous deployment), old dashboards will be left untouched with possibly wrong configuration. This bug happened during deploying 3 nodes scenarios more than once (collectd, grafana and influlxdb hosted on separate machines). Now cleanup is done by default and can be skipped using 'clean_grafana_cache=false' value. Change-Id: Ib67cc3437b8a3a2c2930dd55cba44aef8e352cf2 Signed-off-by: Radoslaw Jablonski <radoslawx.jablonski@intel.com>
2018-10-09ansible: Fix custom 'influxdb_host' setting for grafanaRadoslaw Jablonski1-2/+5
Previously there were 2 errors in ansible scripts for grafana: - influxdb_host variable value was unset - entry for /etc/hosts file was adding text "{{ influxdb_hostname }}" instead hostname stored in this variable Change-Id: I1821b3c5f5fea5c29386b1a57e37aadcf90dd2e6 Signed-off-by: Radoslaw Jablonski <radoslawx.jablonski@intel.com>
2018-10-05Merge "Add role to auto install docker on hosts - missing patch"Aaron Smith3-3/+8
2018-10-04Add role to auto install docker on hosts - missing patchKamil Wiatrowski3-3/+8
Small updates to ansible roles. Several minor updates in documentation. Change-Id: Id031cebc23301b6218f8ced0d261f844f270e37f Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2018-10-03Adding support for prometheus using ansibleJohn O Loughlin7-0/+142
To enable add the following with your ip address to your inventory file: [prometheus_hosts] 172.24.4.19 Change-Id: I85add815367bcbcf1240398db2c43c2130537969 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-09-28WIP: Add role to auto install docker on hostsKamil Wiatrowski13-24/+268
Auto install docker with dependencies on hosts: apt install python apt install python-pip pip install docker-py apt install docker.io Set docker proxy using host proxy settings. Updated documentation. Change-Id: Ibec7e0a7e484d5a9a8656cd3598c3acc7c2e2184 Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2018-08-31Fix for Grafana does not plot the RDT plugin data correctly.Kamil Wiatrowski1-1/+1
Fixed the interval of intel_rdt plugin and Grafana dashboard settings to follow the correct interval. Change-Id: Ia792c6b6308526d82f153275d5d5393b0aea312d Signed-off-by: Kamil Wiatrowski <kamilx.wiatrowski@intel.com>
2018-06-18Configure collectd to load ipmi before PMUJohn O'Loughlin1-1/+1
Collectd loads config files in alphabetical order. Ansible creates the config files for collectd. In this patch we change the name ipmi.conf to 0_ipmi.conf This will allow ipmi to be loaded before PMU. If PMU is loaded before ipmi the container will crash. This is a bug in collectd 5.8 Change-Id: I3334a3a1970f596e36f665698649d6c04fd38fbb Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-03-16ansible: add task to copy custom types.db file to targetsGordon Kelly3-0/+28
Change-Id: I0ae30a46d11d53cdc218e38d0b3a852aa5be147d Signed-off-by: Gordon Kelly <gordon.kelly@intel.com>