Commit graph

595 commits

Author SHA1 Message Date
Jonathan Math
cbe6c58b0c add 10 year retention for data in prometheus 2021-12-06 17:25:15 -05:00
Samuel Clay
ec33dfab48 Separating consul from haproxy health checks. Consul doesn't care what the status of the service is so long as it's reachable. Don't take out bad nodes, let the software do that. 2021-12-06 15:12:12 -05:00
Samuel Clay
966f0998fc Removing unused traces of older redis servers. 2021-12-06 13:56:09 -05:00
Samuel Clay
c4bbd3a7a8 New file system finder, finds static assets. 2021-11-16 11:27:09 -05:00
Samuel Clay
e6367605cd Merge branch 'master' into pipeline
* master:
  Removing dependencies from ssh helper.
  Specifying docker build platform (--platform linux/amd64) so M1 Macs don't build arm64/v8.
  Haproxy shoudl reload on config update, adding celery task group, and allowing task servers to update inventory.
2021-11-14 20:11:10 -05:00
Samuel Clay
38c2004479 Haproxy shoudl reload on config update, adding celery task group, and allowing task servers to update inventory. 2021-11-14 17:21:04 -05:00
Samuel Clay
b6db14dacd Switching from Jammit to django-pipeline. Doesn't work yet, needs compressor hooked up and assets checked. 2021-11-14 13:42:06 -05:00
Samuel Clay
bf70f2aaf7 Redis replica user 2021-10-25 21:24:00 -04:00
Samuel Clay
db5cb4bd94 Moving redis conf to template to distinguish servers. 2021-10-20 17:27:20 -04:00
Samuel Clay
24d6868108 Redis port 2021-10-20 17:18:28 -04:00
Samuel Clay
e0af49022e Adjusting redis conf dirs. 2021-10-20 17:12:24 -04:00
Samuel Clay
5734225d6f Updating Redis to v6, adding redis servers. 2021-10-20 16:46:19 -04:00
Samuel Clay
5915ee1a3e Restarting grafana on build/deploy. 2021-10-19 12:53:11 -04:00
Samuel Clay
ce34d598ca Directory needs changing from elasticsearch_exporter to elasticsearch-exporter. 2021-10-19 11:26:22 -04:00
Samuel Clay
335bc9e235 Merge branch 'metrics'
* metrics:
  Not sure if this removes the redis panel, but this is the latest.
  fix postgres haproxy issue
  Fix node image/ docker-compose issue
  fix: docker-compose was getting an error because there is no .env file.
  Adding redis exporter in dashboard
  add postgres-exporter to docker-compose and pormetheus yml
  add elasticsearch dashboard to grafana
  add querystring logic to mongo db health check to accommodate consul vs haproxy checking
  add elasticsearch_exporter to docker-compose.metrics.yml and prometheus.yml files
  add elasticsearch-exporter role in ansible
2021-10-19 11:01:45 -04:00
Samuel Clay
52b8cfb85b Task servers at , may remove. 2021-10-19 10:58:24 -04:00
Jonathan Math
dd13af5bf1 add querystring logic to mongo db health check to accommodate consul vs haproxy checking 2021-10-11 11:11:42 -05:00
Jonathan Math
cadfc15e75 add elasticsearch-exporter role in ansible 2021-10-11 11:08:51 -05:00
Samuel Clay
532790610d Removing auth from mongo. 2021-09-30 18:02:00 -04:00
Samuel Clay
517086b60e Correcting mongo url for prometheus 2021-09-21 17:25:18 -04:00
Samuel Clay
4e18ceb369 Removing unused code. 2021-09-21 17:00:17 -04:00
Jonathan Math
a3ae90168d add flask_metrics_redis to ansible and update prometheus.consul.yml.j2 2021-09-21 09:52:09 -05:00
Jonathan Math
f96bdb2744 Merge branch 'add_grafana_monitors' into metrics 2021-09-16 11:58:36 -05:00
Samuel Clay
b4e9a56041 Making the docker network is now a docker role task. 2021-09-16 11:55:20 -04:00
Jonathan Math
2ee9971cbe add flask_metrics role to setup_mongo.yml 2021-09-15 11:14:52 -05:00
Jonathan Math
06dc1b0765 update ansible role and consul service for flask_metrics_mongo 2021-09-15 11:12:26 -05:00
Samuel Clay
9f94bcd2dc No more beta 2021-09-15 08:21:21 -04:00
Jonathan Math
e28d440dec add flask_metrics ansible role 2021-09-14 09:52:37 -05:00
Samuel Clay
c6e96831f8 Adding log rotation to node docker. 2021-09-12 14:03:06 -04:00
Samuel Clay
3f00139541 Upgrading sentry on both web and node. 2021-09-10 15:58:22 -04:00
Samuel Clay
30eade8b66 Adding log rotation to docker. 2021-09-10 15:55:11 -04:00
Samuel Clay
683b55994c Mongo exporter is a metrics. 2021-09-07 11:38:18 -04:00
Samuel Clay
8d5123b3a2 Logrotate can be any user. 2021-08-31 11:06:16 -04:00
Samuel Clay
bf2a54e755 Fixing elasticsearch sysctl and config. 2021-08-13 11:44:18 -04:00
Samuel Clay
f03be46425 Removing boto2, upgrading to boto3. Needs testing. 2021-08-04 20:04:53 -04:00
Samuel Clay
af390d5fd1 Adding elasticsearch to py3, upgrading monitor, need to fix boto -> boto3. 2021-08-04 18:42:58 -04:00
Samuel Clay
040c165164 Adding db mongo analytics back. 2021-08-04 18:04:06 -04:00
Samuel Clay
413da7b517 Have to use UID 2021-08-03 20:01:17 -04:00
Samuel Clay
dd62491fd7 Mongo analytics needs correct user. 2021-08-03 19:59:45 -04:00
Samuel Clay
4a81611b01 Mongo analytics is its own server, with authentication. 2021-08-03 19:43:27 -04:00
Samuel Clay
bc69e859eb Adding mongo analytics flask db monitor. 2021-08-03 19:10:20 -04:00
Samuel Clay
d767310a31 Not sure where redis log is coming from, but it should still be recorded. 2021-08-03 16:46:34 -04:00
Samuel Clay
078ce11034 Adding db-mongo-analytics specific conf. 2021-08-03 16:40:28 -04:00
Samuel Clay
607da1a524 Executable backups for mongo 2021-07-30 16:07:35 -04:00
Samuel Clay
8aa172a590 Always restart celery 2021-07-29 18:36:39 -04:00
Samuel Clay
de4098e023 Moving to SERVER_NAME for monitor as network mode is host. 2021-07-24 09:55:52 -04:00
Samuel Clay
37451fbafd Mongo backup exec line. 2021-07-23 19:01:06 -04:00
Samuel Clay
02b2546825 Adding hostnames to docker containers, changing mongo to just use host network mode dammit, and adding possibility for logging to dnsmasq. 2021-07-23 18:13:19 -04:00
Samuel Clay
edf9caafb6 Hard-coding working node-page volume. 2021-07-22 22:26:44 -04:00
Samuel Clay
f78cd24124 Adding volume to node-page. 2021-07-22 21:16:33 -04:00