Commit graph

99 commits

Author SHA1 Message Date
Samuel Clay
1dc0e98448 Renaming postgresql backups 2022-04-29 16:53:47 -04:00
Samuel Clay
464fecd18e Adding postgres restore command and updating backup script. 2022-04-29 16:45:17 -04:00
Samuel Clay
ed08c035cc Explicitly uploading mongo backups 2022-02-03 16:37:15 -05:00
Samuel Clay
43e61cc5aa Only need date once in filename 2022-02-03 16:31:33 -05:00
Samuel Clay
0f09de6218 Rotating mongo backups 2022-02-03 16:17:32 -05:00
Samuel Clay
922269a945 Using full path for progress. 2022-02-03 16:11:13 -05:00
Samuel Clay
d8f1081935 Showing full path of postgres backup. 2022-02-03 16:08:45 -05:00
Samuel Clay
386861a479 Separating out restoring backups and storing backups. 2022-02-03 15:53:42 -05:00
Samuel Clay
5bde153147 Compressing Postgres db sql backup. 2022-02-03 15:39:36 -05:00
Samuel Clay
1397693d54 Adding date to tarball to allow for versioning. 2022-02-03 15:24:49 -05:00
Samuel Clay
5fdeedbbb2 Correcting permissions on mongo backup 2022-02-03 15:20:08 -05:00
Samuel Clay
a3b35933c3 Fixing mongo upload to s3 by using host networking mode. 2022-02-03 14:34:34 -05:00
Samuel Clay
d05c3b1599 Removing unused backup code. 2022-02-03 14:24:12 -05:00
Samuel Clay
cd23d068c3 Forgot import 2022-02-03 14:23:13 -05:00
Samuel Clay
2b2d947dca Adding progress bar to mongo backup. 2022-02-03 14:22:43 -05:00
Samuel Clay
e8a88740bb Refactoring aws keys for mongo backups. 2022-02-03 14:03:58 -05:00
Samuel Clay
eadcfc4426 Adjusting backup for mongo to live on mounted volume. 2022-02-03 13:38:36 -05:00
Samuel Clay
777e69ae82 Prepping postgres backup 2021-12-13 17:09:37 -05:00
Samuel Clay
8bceaada80 Updating redis backup to include percentage progress and access to the correct data dump. 2021-12-13 14:26:20 -05:00
Samuel Clay
be3237cdc3 Updating to boto3 syntax. 2021-12-13 12:45:47 -05:00
Samuel Clay
d677373e3b No more settings.get. 2021-12-13 12:42:30 -05:00
Samuel Clay
f03be46425 Removing boto2, upgrading to boto3. Needs testing. 2021-08-04 20:04:53 -04:00
Samuel Clay
607da1a524 Executable backups for mongo 2021-07-30 16:07:35 -04:00
Samuel Clay
07e3292ed6 Changing datetime format for mongo backups 2021-07-29 18:22:58 -04:00
Samuel Clay
535497a1b0 Backing up mongo on db-mongo-secondary1 2021-07-29 18:21:00 -04:00
Samuel Clay
5aaf4d5c38 Rewriting mongo backup, adding in rotation. 2021-07-29 18:17:02 -04:00
Samuel Clay
b57b70a9df Better exception handling 2021-07-23 19:06:00 -04:00
Samuel Clay
ea094cc4d6 Remove unused s3 bucket code. 2021-07-23 19:05:05 -04:00
Samuel Clay
ad9b805d0a Updating backup to use boto3 2021-07-23 19:04:30 -04:00
Samuel Clay
37451fbafd Mongo backup exec line. 2021-07-23 19:01:06 -04:00
Samuel Clay
286809ace7 Backup permissions 2021-07-16 12:50:13 -04:00
Jonathan Math
0e81d2f346 no need to pass filename into backup_psql.py in ansible postgres backup. removing it 2021-06-27 14:40:00 -06:00
Jonathan Math
a78dec3ed9 fix syntax for backup_redis and duse socket for getting hostname instead of passing in as an argument 2021-06-27 14:36:24 -06:00
Jonathan Math
4846457bc4 fix syntax for mongo backups 2021-06-27 14:32:37 -06:00
Jonathan Math
8ede5a3987 change get_postgres_credentials.py to get_credentials.py so it can also be used to get the s3 bucket name. Fix postgres backups 2021-06-27 14:11:14 -06:00
Jonathan Math
4cea718d40 add redis backup and remove redundant redis backup scripts. Use one script and pass in hostname argument instead 2021-06-19 12:52:04 -06:00
Jonathan Math
c2bef5565b add backup to ansible for postgres 2021-06-19 12:35:28 -06:00
Jonathan Math
97bc306567 add python paths to backup_mongo.py and backup_psql.py to make them executable 2021-06-19 12:24:33 -06:00
Jonathan Math
1dfd36630f make backup_postgres compatible with docker/ansible 2021-06-19 12:17:19 -06:00
Jonathan Math
a71069994c add mongo backup cronjob for ansible and integrate backup_mongo.py with docker setup 2021-06-19 12:02:29 -06:00
Samuel Clay
d1e9f6764f Merge branch 'master' into dashboard3
* master:
  Backing up postgres version
2021-02-18 20:59:22 -05:00
Samuel Clay
8e224de2b9 Backing up postgres version 2021-02-18 20:57:56 -05:00
Samuel Clay
ab2d9804ef Adjusting to newsblur_web. Also adding feed chooser to dashboard river. Needs hookup. 2021-01-12 15:52:10 -05:00
Samuel Clay
b89e7dc429 Merge branch 'django1.11' into django2.0
* django1.11: (152 commits)
  request.raw_post_data -> request.body (django 1.6)
  Upgrading pgbouncer to 1.15.0.
  Finishing off Postgresql 13 upgrade.
  Upgrading to Postgresql 13.
  Ubuntu 20.04
  Fixing supervisor path issues
  Upgrading setuptools
  Fixing flask
  Handling over capacity for twitter.
  Max length for image_urls.
  Properly filtering newsletter feeds.
  Fixing issue with text importer on feed-less urls.
  Removing dependency, fixing encoding issue for pages.
  Fixing DB Monitor.
  Updating User Agent for all fetchers.
  Ignoring VSCode.
  Fixing DB Monitor.
  Updating User Agent for all fetchers.
  Ignoring VSCode.
  Fixing Statistics by fixing how timezones are handled.
  ...
2020-12-03 14:04:26 -05:00
Samuel Clay
baa4d505a4 Updating env vars, attempting to deploy django 1.11. 2020-11-09 12:24:32 -05:00
Jonathan Math
2e8deade58 2to3 the rest of utils/ 2020-06-19 02:29:40 -04:00
Samuel Clay
055fcbc0ea Fixing notifications dialog bug. 2016-11-17 11:37:10 -08:00
Samuel Clay
70c6dc78b2 PostgreSQL 9.2 -> 9.4. 2015-07-20 18:55:41 -07:00
Samuel Clay
a266d9f585 Adding DF missing users. 2015-05-26 17:58:45 -07:00
Samuel Clay
bd4e3c322e Fixing delete feeds recreator. 2015-05-26 17:57:26 -07:00