Commit graph

66 commits

Author SHA1 Message Date
Samuel Clay
e9fdaadc70 Updating redis pubusb port 2024-02-25 14:24:58 -05:00
Samuel Clay
dc59b019a3 Moving to new redis ports. 2024-02-25 13:54:14 -05:00
Samuel Clay
41bf125467 Last minute changes to migration strategy. 2024-02-25 12:30:42 -05:00
Samuel Clay
f709bd7e18 Updating consul and docker for arm64. Using old redis ports. 2024-02-17 17:14:35 -05:00
Samuel Clay
af30c80aac Elasticsearch secondary 2024-02-14 16:58:24 -05:00
Samuel Clay
a222fc0675 Switching to 127.0.0.1 from localhost since ipv6 is being prioritized on hetzner. 2024-02-08 20:11:58 -05:00
Samuel Clay
eaadf21b83 Fixing mongo and redis db monitor. 2024-01-26 08:39:36 -05:00
Samuel Clay
96016e82e6 Adding hetzner mongo servers. 2024-01-22 18:59:58 -05:00
Samuel Clay
f9ad93e336 Adding hetzner servers. 2024-01-07 10:00:39 -05:00
Samuel Clay
bd1da6bc93 Updating terraform 2022-06-22 15:06:10 -04:00
Samuel Clay
aa3c33c7d3 Fixing docker permissions for redis, web, mongo. Also removing /etc/hosts. 2022-05-25 16:02:37 -04:00
Samuel Clay
bdbe7b8797 Upgrading to MongoDB 4.0, and upping mongo servers. 2022-05-09 21:20:51 -04:00
Samuel Clay
b6763d872f XoneB 4 LIFE 2022-02-08 15:32:43 -05:00
Samuel Clay
ed08c035cc Explicitly uploading mongo backups 2022-02-03 16:37:15 -05:00
Samuel Clay
5fdeedbbb2 Correcting permissions on mongo backup 2022-02-03 15:20:08 -05:00
Samuel Clay
a3b35933c3 Fixing mongo upload to s3 by using host networking mode. 2022-02-03 14:34:34 -05:00
Samuel Clay
2b2d947dca Adding progress bar to mongo backup. 2022-02-03 14:22:43 -05:00
Samuel Clay
e8a88740bb Refactoring aws keys for mongo backups. 2022-02-03 14:03:58 -05:00
Samuel Clay
58abe3792e Moving mongo backups 2022-02-03 13:49:23 -05:00
Samuel Clay
eadcfc4426 Adjusting backup for mongo to live on mounted volume. 2022-02-03 13:38:36 -05:00
Samuel Clay
699bbceeba Fixing postgres backup site. Also fixing Mongo backup collections. 2022-02-03 13:21:06 -05:00
Samuel Clay
f36a4f8fd5 Mongo auth 2021-12-16 20:30:27 -05:00
Samuel Clay
8b6452b094 Create mongodb database user. Only runs on analytics, but should work fine on main mongo. 2021-12-16 15:02:27 -05:00
Samuel Clay
ea6103bc8f Adding second mongo analytics db, cleaning up mongo analytics auth. 2021-12-16 13:48:20 -05:00
Samuel Clay
58d6c00bfa Bumping mongo size 2021-12-09 13:20:02 -05:00
Samuel Clay
532790610d Removing auth from mongo. 2021-09-30 18:02:00 -04:00
Samuel Clay
b4e9a56041 Making the docker network is now a docker role task. 2021-09-16 11:55:20 -04:00
Samuel Clay
413da7b517 Have to use UID 2021-08-03 20:01:17 -04:00
Samuel Clay
dd62491fd7 Mongo analytics needs correct user. 2021-08-03 19:59:45 -04:00
Samuel Clay
4a81611b01 Mongo analytics is its own server, with authentication. 2021-08-03 19:43:27 -04:00
Samuel Clay
d767310a31 Not sure where redis log is coming from, but it should still be recorded. 2021-08-03 16:46:34 -04:00
Samuel Clay
078ce11034 Adding db-mongo-analytics specific conf. 2021-08-03 16:40:28 -04:00
Samuel Clay
607da1a524 Executable backups for mongo 2021-07-30 16:07:35 -04:00
Samuel Clay
de4098e023 Moving to SERVER_NAME for monitor as network mode is host. 2021-07-24 09:55:52 -04:00
Samuel Clay
37451fbafd Mongo backup exec line. 2021-07-23 19:01:06 -04:00
Samuel Clay
02b2546825 Adding hostnames to docker containers, changing mongo to just use host network mode dammit, and adding possibility for logging to dnsmasq. 2021-07-23 18:13:19 -04:00
Samuel Clay
1ac16508f8 Changing how mongo is registered on consul. Now allows members before they are part of the replica set. 2021-07-21 21:10:02 -04:00
Samuel Clay
4f37953df4 Mongo backups should use a dual-docker solution: 1) Use docker to backup mongo from the mongo container, 2) use newsblur_web container to upload to S3. 2021-07-16 12:25:25 -04:00
Samuel Clay
82e46fe04b Mounting DO volume on mongo machines. 2021-07-16 11:51:52 -04:00
Samuel Clay
4ddb345e32 Retrying mongodb keyfile auth. 2021-07-14 19:59:00 -04:00
Samuel Clay
0754c0c049 Adding authentication for mongo. Hopefully this covers everything needed. 2021-07-12 11:45:25 -04:00
Samuel Clay
e160a86d2a Switching celery to local log driver for docker due to logs filling up disk space. 2021-06-30 00:22:09 -04:00
Samuel Clay
17e6f7f424 Adding logrotate for mongo. 2021-06-29 17:51:14 -04:00
Jonathan Math
4846457bc4 fix syntax for mongo backups 2021-06-27 14:32:37 -06:00
Jonathan Math
baee7a798b add multiline command syntax >- to cronjobs for sanity checkers 2021-06-27 13:24:07 -06:00
Jonathan Math
dfe72b3e04 add -it to disk usage commands for cronjobs. capitalize OUTPUT in disk usage commands 2021-06-25 11:46:09 -06:00
Jonathan Math
972f13b394 edit ansible files so that all disk usage sanity checkers run hourly 2021-06-25 11:42:21 -06:00
Jonathan Math
a71069994c add mongo backup cronjob for ansible and integrate backup_mongo.py with docker setup 2021-06-19 12:02:29 -06:00
Jonathan Math
bf140f1aea fix disk usage sanity checker to check host machine and pass the data into the container to evaluate the disk usage and send an email 2021-06-18 14:57:29 -06:00
Jonathan Math
5bea910d46 keep sanity checkers alive, fix ln directive in ansible 2021-06-07 16:30:51 -04:00