sictiru
3dd01ba2ef
Merge master into sictiru
2022-03-06 20:33:19 -08:00
sictiru
df6a225da2
Merge master into sictiru
2022-02-16 21:16:24 -08:00
Samuel Clay
9aff554201
Finishing up PostgreSQL migration. Needs to test backups.
2022-01-07 10:07:19 -05:00
Samuel Clay
688b3524a3
Fixing grafana sentry integration.
2022-01-05 15:18:26 -05:00
Samuel Clay
6108f2a067
Adding sentry grafana pluging.
2022-01-05 13:22:24 -05:00
Samuel Clay
d06e871ee2
Boosting timeout for docker prune
2022-01-04 15:14:22 -05:00
Samuel Clay
3e348329b3
Don't prune docker unless needed.
2022-01-04 15:09:01 -05:00
Samuel Clay
8de2bfcbae
Fixing names for state timeline, also fixing node server bootstrap.
2022-01-04 14:44:47 -05:00
Samuel Clay
af7524a976
Bumping haproxy state timeline scrapes.
2022-01-04 12:51:45 -05:00
Samuel Clay
e227e651ed
Pruning docker, updating sentry release webhook only on local.
2022-01-03 17:24:57 -05:00
Samuel Clay
259dff477e
Adding Sentry release webhook to deployment of web, task, monitor, and node.
2022-01-03 15:27:53 -05:00
Samuel Clay
e5e3162f89
Moving from hosted Sentry to self-hosted sentry.
2022-01-03 14:48:39 -05:00
Samuel Clay
f33c1b3600
Using new repo password for postgres.
2021-12-17 17:35:01 -05:00
Samuel Clay
6b8e747ebc
Moving around postgres config
2021-12-17 17:11:54 -05:00
Samuel Clay
aee543d913
Moving directories.
2021-12-17 16:56:30 -05:00
Samuel Clay
62529e96c2
Adding postgresql backup restoration. Working on config.
2021-12-17 16:53:28 -05:00
Samuel Clay
f36a4f8fd5
Mongo auth
2021-12-16 20:30:27 -05:00
Samuel Clay
ef62d212ab
Deploying new analytics server.
2021-12-16 15:31:12 -05:00
Samuel Clay
8b6452b094
Create mongodb database user. Only runs on analytics, but should work fine on main mongo.
2021-12-16 15:02:27 -05:00
Samuel Clay
ea6103bc8f
Adding second mongo analytics db, cleaning up mongo analytics auth.
2021-12-16 13:48:20 -05:00
Samuel Clay
e70ba4a8c0
Revert "Merge branch 'state_timeline'"
...
This reverts commit 83e4609af1
, reversing
changes made to 089161b20f
.
2021-12-15 14:17:48 -05:00
Samuel Clay
5008d42a8e
Merge branch 'master' into state_timeline
...
* master:
Solving docker networking container issues by turning iptables back on but using ufw after.rules that allow ufw to retain blocking ability. Works on Redis, now to move to mongo.
Mongo analytics monitor not reayd yet
Turning consul monitor back on.
Turning on analytics
Need to strip csv values.
Binding redis to public interface.
2021-12-15 13:34:11 -05:00
Samuel Clay
089161b20f
Solving docker networking container issues by turning iptables back on but using ufw after.rules that allow ufw to retain blocking ability. Works on Redis, now to move to mongo.
2021-12-15 13:34:01 -05:00
Jonathan Math
cf917b43e5
fix flask_metrics ansible role
2021-12-15 11:37:43 -05:00
Jonathan Math
99dd44a435
move state timeline to one single flask that gets astate for all services
2021-12-15 11:35:16 -05:00
Samuel Clay
8da118f653
Restore postgres backup. Needs work.
2021-12-14 08:22:19 -05:00
Samuel Clay
777e69ae82
Prepping postgres backup
2021-12-13 17:09:37 -05:00
Samuel Clay
5b0ef4dbd6
Prepping redis for moving back to primary.
2021-12-13 15:31:21 -05:00
Samuel Clay
8bceaada80
Updating redis backup to include percentage progress and access to the correct data dump.
2021-12-13 14:26:20 -05:00
Samuel Clay
be3237cdc3
Updating to boto3 syntax.
2021-12-13 12:45:47 -05:00
Samuel Clay
58d6c00bfa
Bumping mongo size
2021-12-09 13:20:02 -05:00
Samuel Clay
35bc9ad07f
Rewriting readme from #1545 .
2021-12-08 14:55:26 -05:00
Samuel Clay
d385495ef5
Explicit prometheus command, modeled after the dockerhub image. We're not using --web.console.libraries=/usr/share/prometheus/console_libraries --web.console.templates=/usr/share/prometheus/consoles
2021-12-07 16:23:05 -05:00
Samuel Clay
e63ad6193b
Explicit config file
2021-12-07 11:16:00 -05:00
Samuel Clay
b7995547e4
Merge branch 'master' into prometheus_retention
...
* master:
Turning refresh stale feeds back on.
Terraform Digital Ocean v2.0
Adjusting sizes
Better topline metrics
Cleaning up redis dashboard.
Flask metrics may not have the port, use default.
2021-12-07 11:11:18 -05:00
Samuel Clay
0f81b9dfa1
Flask metrics may not have the port, use default.
2021-12-07 07:16:31 -05:00
Jonathan Math
cbe6c58b0c
add 10 year retention for data in prometheus
2021-12-06 17:25:15 -05:00
Samuel Clay
ec33dfab48
Separating consul from haproxy health checks. Consul doesn't care what the status of the service is so long as it's reachable. Don't take out bad nodes, let the software do that.
2021-12-06 15:12:12 -05:00
Samuel Clay
966f0998fc
Removing unused traces of older redis servers.
2021-12-06 13:56:09 -05:00
Samuel Clay
38c2004479
Haproxy shoudl reload on config update, adding celery task group, and allowing task servers to update inventory.
2021-11-14 17:21:04 -05:00
Samuel Clay
bf70f2aaf7
Redis replica user
2021-10-25 21:24:00 -04:00
Samuel Clay
db5cb4bd94
Moving redis conf to template to distinguish servers.
2021-10-20 17:27:20 -04:00
Samuel Clay
24d6868108
Redis port
2021-10-20 17:18:28 -04:00
Samuel Clay
e0af49022e
Adjusting redis conf dirs.
2021-10-20 17:12:24 -04:00
Samuel Clay
5734225d6f
Updating Redis to v6, adding redis servers.
2021-10-20 16:46:19 -04:00
Samuel Clay
5915ee1a3e
Restarting grafana on build/deploy.
2021-10-19 12:53:11 -04:00
Samuel Clay
ce34d598ca
Directory needs changing from elasticsearch_exporter to elasticsearch-exporter.
2021-10-19 11:26:22 -04:00
Samuel Clay
335bc9e235
Merge branch 'metrics'
...
* metrics:
Not sure if this removes the redis panel, but this is the latest.
fix postgres haproxy issue
Fix node image/ docker-compose issue
fix: docker-compose was getting an error because there is no .env file.
Adding redis exporter in dashboard
add postgres-exporter to docker-compose and pormetheus yml
add elasticsearch dashboard to grafana
add querystring logic to mongo db health check to accommodate consul vs haproxy checking
add elasticsearch_exporter to docker-compose.metrics.yml and prometheus.yml files
add elasticsearch-exporter role in ansible
2021-10-19 11:01:45 -04:00
Samuel Clay
52b8cfb85b
Task servers at , may remove.
2021-10-19 10:58:24 -04:00
Jonathan Math
dd13af5bf1
add querystring logic to mongo db health check to accommodate consul vs haproxy checking
2021-10-11 11:11:42 -05:00