Commit graph

484 commits

Author SHA1 Message Date
Samuel Clay
5734225d6f Updating Redis to v6, adding redis servers. 2021-10-20 16:46:19 -04:00
Samuel Clay
5915ee1a3e Restarting grafana on build/deploy. 2021-10-19 12:53:11 -04:00
Samuel Clay
ce34d598ca Directory needs changing from elasticsearch_exporter to elasticsearch-exporter. 2021-10-19 11:26:22 -04:00
Samuel Clay
335bc9e235 Merge branch 'metrics'
* metrics:
  Not sure if this removes the redis panel, but this is the latest.
  fix postgres haproxy issue
  Fix node image/ docker-compose issue
  fix: docker-compose was getting an error because there is no .env file.
  Adding redis exporter in dashboard
  add postgres-exporter to docker-compose and pormetheus yml
  add elasticsearch dashboard to grafana
  add querystring logic to mongo db health check to accommodate consul vs haproxy checking
  add elasticsearch_exporter to docker-compose.metrics.yml and prometheus.yml files
  add elasticsearch-exporter role in ansible
2021-10-19 11:01:45 -04:00
Samuel Clay
52b8cfb85b Task servers at , may remove. 2021-10-19 10:58:24 -04:00
Jonathan Math
dd13af5bf1 add querystring logic to mongo db health check to accommodate consul vs haproxy checking 2021-10-11 11:11:42 -05:00
Jonathan Math
cadfc15e75 add elasticsearch-exporter role in ansible 2021-10-11 11:08:51 -05:00
Samuel Clay
532790610d Removing auth from mongo. 2021-09-30 18:02:00 -04:00
Samuel Clay
517086b60e Correcting mongo url for prometheus 2021-09-21 17:25:18 -04:00
Samuel Clay
4e18ceb369 Removing unused code. 2021-09-21 17:00:17 -04:00
Jonathan Math
a3ae90168d add flask_metrics_redis to ansible and update prometheus.consul.yml.j2 2021-09-21 09:52:09 -05:00
Jonathan Math
f96bdb2744 Merge branch 'add_grafana_monitors' into metrics 2021-09-16 11:58:36 -05:00
Samuel Clay
b4e9a56041 Making the docker network is now a docker role task. 2021-09-16 11:55:20 -04:00
Jonathan Math
2ee9971cbe add flask_metrics role to setup_mongo.yml 2021-09-15 11:14:52 -05:00
Jonathan Math
06dc1b0765 update ansible role and consul service for flask_metrics_mongo 2021-09-15 11:12:26 -05:00
Samuel Clay
9f94bcd2dc No more beta 2021-09-15 08:21:21 -04:00
Jonathan Math
e28d440dec add flask_metrics ansible role 2021-09-14 09:52:37 -05:00
Samuel Clay
c6e96831f8 Adding log rotation to node docker. 2021-09-12 14:03:06 -04:00
Samuel Clay
3f00139541 Upgrading sentry on both web and node. 2021-09-10 15:58:22 -04:00
Samuel Clay
30eade8b66 Adding log rotation to docker. 2021-09-10 15:55:11 -04:00
Samuel Clay
683b55994c Mongo exporter is a metrics. 2021-09-07 11:38:18 -04:00
Samuel Clay
8d5123b3a2 Logrotate can be any user. 2021-08-31 11:06:16 -04:00
Samuel Clay
bf2a54e755 Fixing elasticsearch sysctl and config. 2021-08-13 11:44:18 -04:00
Samuel Clay
f03be46425 Removing boto2, upgrading to boto3. Needs testing. 2021-08-04 20:04:53 -04:00
Samuel Clay
af390d5fd1 Adding elasticsearch to py3, upgrading monitor, need to fix boto -> boto3. 2021-08-04 18:42:58 -04:00
Samuel Clay
040c165164 Adding db mongo analytics back. 2021-08-04 18:04:06 -04:00
Samuel Clay
413da7b517 Have to use UID 2021-08-03 20:01:17 -04:00
Samuel Clay
dd62491fd7 Mongo analytics needs correct user. 2021-08-03 19:59:45 -04:00
Samuel Clay
4a81611b01 Mongo analytics is its own server, with authentication. 2021-08-03 19:43:27 -04:00
Samuel Clay
bc69e859eb Adding mongo analytics flask db monitor. 2021-08-03 19:10:20 -04:00
Samuel Clay
d767310a31 Not sure where redis log is coming from, but it should still be recorded. 2021-08-03 16:46:34 -04:00
Samuel Clay
078ce11034 Adding db-mongo-analytics specific conf. 2021-08-03 16:40:28 -04:00
Samuel Clay
607da1a524 Executable backups for mongo 2021-07-30 16:07:35 -04:00
Samuel Clay
8aa172a590 Always restart celery 2021-07-29 18:36:39 -04:00
Samuel Clay
de4098e023 Moving to SERVER_NAME for monitor as network mode is host. 2021-07-24 09:55:52 -04:00
Samuel Clay
37451fbafd Mongo backup exec line. 2021-07-23 19:01:06 -04:00
Samuel Clay
02b2546825 Adding hostnames to docker containers, changing mongo to just use host network mode dammit, and adding possibility for logging to dnsmasq. 2021-07-23 18:13:19 -04:00
Samuel Clay
edf9caafb6 Hard-coding working node-page volume. 2021-07-22 22:26:44 -04:00
Samuel Clay
f78cd24124 Adding volume to node-page. 2021-07-22 21:16:33 -04:00
Samuel Clay
df050acb8e Don't disregard authentication error 2021-07-21 21:27:56 -04:00
Samuel Clay
1ac16508f8 Changing how mongo is registered on consul. Now allows members before they are part of the replica set. 2021-07-21 21:10:02 -04:00
Samuel Clay
4f37953df4 Mongo backups should use a dual-docker solution: 1) Use docker to backup mongo from the mongo container, 2) use newsblur_web container to upload to S3. 2021-07-16 12:25:25 -04:00
Samuel Clay
82e46fe04b Mounting DO volume on mongo machines. 2021-07-16 11:51:52 -04:00
Samuel Clay
5eea1c6b76 Mongo optime format namespaced under 'ts'. 2021-07-14 21:45:12 -04:00
Samuel Clay
a78e21de90 Capturing mongo internal IP for use with db monitor. 2021-07-14 21:37:49 -04:00
Samuel Clay
57bb169629 Turning off auth, need to move to template 2021-07-14 20:09:14 -04:00
Samuel Clay
bf5bf29bfc Turning auth back on 2021-07-14 20:06:42 -04:00
Samuel Clay
d454ab40d4 Removing auth 2021-07-14 20:03:58 -04:00
Samuel Clay
4ddb345e32 Retrying mongodb keyfile auth. 2021-07-14 19:59:00 -04:00
Samuel Clay
925c13bd6e Sanity checker logs needs permissions for writing. 2021-07-14 17:42:13 -04:00