Commit graph

54 commits

Author SHA1 Message Date
Samuel Clay
1f5e9053dd Handling too many feeds tasked. 2024-02-28 09:33:10 -05:00
Samuel Clay
c2d6c2f22e All postgres servers need to know secondary 2024-02-25 13:14:13 -05:00
Samuel Clay
41bf125467 Last minute changes to migration strategy. 2024-02-25 12:30:42 -05:00
Samuel Clay
7a5ef1a26c Getting postgres working on hetzner. 2024-01-31 17:28:34 -05:00
Samuel Clay
697d6ec270 Task server names, postgres replication, storing grafana. 2024-01-28 17:58:18 -05:00
Samuel Clay
c85792ccab Adding CMD to postgres dockerfile. 2024-01-28 00:38:05 -05:00
Samuel Clay
e11197c333 Moving postgres Dockerfile 2024-01-27 23:16:09 -05:00
Samuel Clay
1453c3ee27 Updating postgres for standby. 2024-01-27 23:11:36 -05:00
Samuel Clay
1ed3c9f40a Adding postgres and elasticsearch to hetzner. Updating redis flask metrics. 2024-01-27 18:11:36 -05:00
Samuel Clay
6691487724 New postgres server 2023-04-23 17:27:41 -04:00
Samuel Clay
5ff59ff056 Adding elasticsearch and postgres backup cleaner. 2022-12-28 22:01:51 -05:00
Samuel Clay
ba3618cc19 ansible_ssh_host -> ansible_host 2022-08-17 09:35:53 -04:00
Samuel Clay
82c156daf2 Postgres restore now explicit about primary server. 2022-06-05 08:55:58 -04:00
Samuel Clay
ea485e464d Upgrading Postgres server. Just have mongo left to do and then :racecar: 2022-05-27 06:58:32 -04:00
Samuel Clay
ed0dbd9ef8 Don't change file permissions, let's see what happens. 2022-05-13 17:15:42 -04:00
Samuel Clay
b2cdff8a85 Bumping postgres server size, fixing monitor disk usage cronjob. 2022-05-13 16:59:57 -04:00
Samuel Clay
4170cd8f77 Adding pg_ident.conf. 2022-05-02 13:21:02 -04:00
Samuel Clay
b586d519c9 Moving pg basebackup to a backup role 2022-05-02 09:32:35 -04:00
Samuel Clay
3670faf99d Adding a secondary postgres that starts from a pg_basebackup. Still needs testing. 2022-04-30 07:24:46 -04:00
Samuel Clay
de309183c5 Adding timestamps to backup logs 2022-04-30 06:51:11 -04:00
Samuel Clay
9ea16aadb7 No TTY/input needed on backups. 2022-04-30 06:47:09 -04:00
Samuel Clay
43bf7a0c89 Adding postgres backup log. 2022-02-04 13:55:23 -05:00
Samuel Clay
5e2c3f7a10 Moving to postgres backup directory. 2022-02-03 15:49:55 -05:00
Samuel Clay
4fb48aa754 Executable postgres backup script. 2022-02-03 15:41:35 -05:00
Samuel Clay
699bbceeba Fixing postgres backup site. Also fixing Mongo backup collections. 2022-02-03 13:21:06 -05:00
Samuel Clay
5407fb526e Fixing postgres backup cron job. 2022-02-03 07:50:26 -05:00
Samuel Clay
09551d5d8f Finishing up PostgreSQL migration. Needs to test backups. 2022-01-07 15:47:36 -05:00
Samuel Clay
f33c1b3600 Using new repo password for postgres. 2021-12-17 17:35:01 -05:00
Samuel Clay
6b8e747ebc Moving around postgres config 2021-12-17 17:11:54 -05:00
Samuel Clay
aee543d913 Moving directories. 2021-12-17 16:56:30 -05:00
Samuel Clay
62529e96c2 Adding postgresql backup restoration. Working on config. 2021-12-17 16:53:28 -05:00
Samuel Clay
8da118f653 Restore postgres backup. Needs work. 2021-12-14 08:22:19 -05:00
Samuel Clay
777e69ae82 Prepping postgres backup 2021-12-13 17:09:37 -05:00
Samuel Clay
ec33dfab48 Separating consul from haproxy health checks. Consul doesn't care what the status of the service is so long as it's reachable. Don't take out bad nodes, let the software do that. 2021-12-06 15:12:12 -05:00
Samuel Clay
02b2546825 Adding hostnames to docker containers, changing mongo to just use host network mode dammit, and adding possibility for logging to dnsmasq. 2021-07-23 18:13:19 -04:00
Jonathan Math
0e81d2f346 no need to pass filename into backup_psql.py in ansible postgres backup. removing it 2021-06-27 14:40:00 -06:00
Jonathan Math
8ede5a3987 change get_postgres_credentials.py to get_credentials.py so it can also be used to get the s3 bucket name. Fix postgres backups 2021-06-27 14:11:14 -06:00
Jonathan Math
baee7a798b add multiline command syntax >- to cronjobs for sanity checkers 2021-06-27 13:24:07 -06:00
Jonathan Math
dfe72b3e04 add -it to disk usage commands for cronjobs. capitalize OUTPUT in disk usage commands 2021-06-25 11:46:09 -06:00
Jonathan Math
972f13b394 edit ansible files so that all disk usage sanity checkers run hourly 2021-06-25 11:42:21 -06:00
Jonathan Math
309155faeb fix docker commands for backups 2021-06-19 13:01:38 -06:00
Jonathan Math
c2bef5565b add backup to ansible for postgres 2021-06-19 12:35:28 -06:00
Jonathan Math
bf140f1aea fix disk usage sanity checker to check host machine and pass the data into the container to evaluate the disk usage and send an email 2021-06-18 14:57:29 -06:00
Jonathan Math
5bea910d46 keep sanity checkers alive, fix ln directive in ansible 2021-06-07 16:30:51 -04:00
Jonathan Math
17c64e4acc add disk usage sanity checker 2021-06-07 15:44:59 -04:00
Samuel Clay
f0aafc7413 Forgive me for this commit. It's a stopgap in consul configs. I need to be able to automate changes to consul configs, but what I was doing was manually juggling these configs on the old datacenter. While this is ugly, it works and as soon as the old DC is retired, we can rip this out. I mean this is basically /etc/hosts, just uglier. 2021-04-08 15:55:58 -04:00
Jonathan Math
26fe4f82b8 use ansible_ssh_host ip address for consul service health checks 2021-03-04 13:30:02 -05:00
Samuel Clay
14daddc018 Using port 5579 for monitor. 2021-03-04 12:55:41 -05:00
Jonathan Math
45a37a5a99 remove unnecessary DOCKERBUILD env variable from postgres container role 2021-03-02 10:42:25 -05:00
Jonathan Math
bcb74c6401 change consul_service.json files to include health checks using local monitor for database services 2021-03-02 10:37:21 -05:00