Samuel Clay
1dc0e98448
Renaming postgresql backups
2022-04-29 16:53:47 -04:00
Samuel Clay
464fecd18e
Adding postgres restore command and updating backup script.
2022-04-29 16:45:17 -04:00
Samuel Clay
2d2ed0a30d
Adding postgres restore command and updating backup script.
2022-04-29 16:44:46 -04:00
Samuel Clay
de1fb57406
Finishing RFC 5005 archive fetcher (for #1109 ). Also fixing mongo commands and adding checks for archive subscribers.
2022-04-29 11:31:32 -04:00
Samuel Clay
4f69d15fcb
RFC5005 fetching should be working, but the test site is changing urls to a weird http://x.com:443 , so maybe we need to normalize the url?
2022-04-20 22:38:51 -04:00
Samuel Clay
104d50ff46
Use new url_normalize library, preserving old just in case anything changes.
2022-04-19 15:28:18 -04:00
Samuel Clay
4ee5525d71
Removing pdb
2022-04-19 15:27:59 -04:00
Samuel Clay
59b44088f6
Checking RFC5005 archive links in feeds. Needs testing, but first a fix for URL normalization. For #1109 .
2022-04-19 13:26:39 -04:00
Samuel Clay
b4c9c4e896
Time to cleanup logging on archive.
2022-04-18 14:29:08 -04:00
Samuel Clay
5981b24588
Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable.
2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db
Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories.
2022-04-18 13:29:13 -04:00
Samuel Clay
43695b8cd4
Back-filling archive pages. This closes #1564 .
2022-04-13 10:43:29 -04:00
Samuel Clay
ed0ed69aa1
Adding premium archive to home page.
2022-04-06 16:52:42 -04:00
Samuel Clay
a633c0983b
Taking archive unreads into account in single feeds.
2022-03-23 16:25:03 -04:00
Samuel Clay
39e68e4744
Premium reason text
2022-03-17 15:36:49 -04:00
Samuel Clay
ab1481333c
Randomizing reasons to upgrade.
2022-03-16 15:28:52 -04:00
Samuel Clay
a6ba249104
Fixing feed chooser selection issue. Adjusting sizes.
2022-03-16 12:01:02 -04:00
Samuel Clay
f33cbcf312
Merge branch 'master' into pro
...
* master: (72 commits)
Missing import
Correctly decoding shared stories in RSS feed.
Adding scroll to feed and story options popover (Style menu).
Magazine view blog post.
Refactoring story content preview with newlines preserved.
Boosting db profiling from 1% to 5%.
Ignore data uris for widget, they are never the big images
Wait to strip data uri header until it's time.
Moving encoding
Don't double encode base64 images for widgets.
Preserving paragraphs in magazine and grid views.
Fixing bad instrumentation on mongo and redis logs.
Wrong url for db profiler.
Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
Fixing strict bug where wasn't defined.
Showing grid image previews. Not sure how this ever worked before.
Grid has image if found already.
Showing grid image on load if youtube
Only monitor river_stories for db times
Not hitting a db shouldnt be colored any differently than a small value.
...
2022-03-09 11:41:40 -05:00
Samuel Clay
d0571e2ab0
Wait to strip data uri header until it's time.
2022-03-08 13:11:08 -05:00
Samuel Clay
ca728af375
Don't double encode base64 images for widgets.
2022-03-08 12:48:57 -05:00
Samuel Clay
0e63da2d74
Fixing bad instrumentation on mongo and redis logs.
2022-03-07 15:57:51 -05:00
Samuel Clay
b1de95dd20
Not hitting a db shouldnt be colored any differently than a small value.
2022-03-04 12:51:43 -05:00
Samuel Clay
0bae64e6fd
Recoloring db times logs.
2022-03-04 12:49:01 -05:00
Samuel Clay
c800dcaddf
Black formatting
2022-03-02 10:55:46 -05:00
Samuel Clay
f0f6c0a828
Fixing issue with some sites spewing tons of headers back and Python failing.
2022-03-02 10:29:24 -05:00
Samuel Clay
06c25df199
No longer sending tons of mail to admins. Logging is where that goes.
2022-02-22 10:19:51 -05:00
Samuel Clay
5451d4a8eb
Merge branch 'master' into pro
...
* master:
XoneB 4 LIFE
Handling recovering mongo db in metrics. (Typo)
Handling recovering mongo db in metrics.
2022-02-08 15:33:26 -05:00
Samuel Clay
b6763d872f
XoneB 4 LIFE
2022-02-08 15:32:43 -05:00
Samuel Clay
88d07b143c
Merge branch 'master' into pro
...
* master: (31 commits)
Adding postgres backup log.
Handling operation failures in flask metrics.
Locking consul to a working version. Also changing flask status code response to handle custom status codes.
Explicitly uploading mongo backups
Only need date once in filename
Rotating mongo backups
Using full path for progress.
Showing full path of postgres backup.
Separating out restoring backups and storing backups.
Moving to postgres backup directory.
Executable postgres backup script.
Compressing Postgres db sql backup.
Adding date to tarball to allow for versioning.
Correcting permissions on mongo backup
Fixing mongo upload to s3 by using host networking mode.
Removing unused backup code.
Forgot import
Adding progress bar to mongo backup.
Refactoring aws keys for mongo backups.
Moving mongo backups
...
2022-02-04 13:55:38 -05:00
Samuel Clay
ed08c035cc
Explicitly uploading mongo backups
2022-02-03 16:37:15 -05:00
Samuel Clay
43e61cc5aa
Only need date once in filename
2022-02-03 16:31:33 -05:00
Samuel Clay
0f09de6218
Rotating mongo backups
2022-02-03 16:17:32 -05:00
Samuel Clay
922269a945
Using full path for progress.
2022-02-03 16:11:13 -05:00
Samuel Clay
d8f1081935
Showing full path of postgres backup.
2022-02-03 16:08:45 -05:00
Samuel Clay
386861a479
Separating out restoring backups and storing backups.
2022-02-03 15:53:42 -05:00
Samuel Clay
5bde153147
Compressing Postgres db sql backup.
2022-02-03 15:39:36 -05:00
Samuel Clay
1397693d54
Adding date to tarball to allow for versioning.
2022-02-03 15:24:49 -05:00
Samuel Clay
5fdeedbbb2
Correcting permissions on mongo backup
2022-02-03 15:20:08 -05:00
Samuel Clay
a3b35933c3
Fixing mongo upload to s3 by using host networking mode.
2022-02-03 14:34:34 -05:00
Samuel Clay
d05c3b1599
Removing unused backup code.
2022-02-03 14:24:12 -05:00
Samuel Clay
cd23d068c3
Forgot import
2022-02-03 14:23:13 -05:00
Samuel Clay
2b2d947dca
Adding progress bar to mongo backup.
2022-02-03 14:22:43 -05:00
Samuel Clay
e8a88740bb
Refactoring aws keys for mongo backups.
2022-02-03 14:03:58 -05:00
Samuel Clay
eadcfc4426
Adjusting backup for mongo to live on mounted volume.
2022-02-03 13:38:36 -05:00
Samuel Clay
7889fe4cf0
Fixing bookmarklet and saved story tags.
2022-01-28 17:05:23 -05:00
Samuel Clay
55f0bd9324
Adding a RawJSNode to literally read the <script> tags spit out by django-pipeline, and stick those files into embedded JS. But it works and should stay current as it points to the non-cached version. If this gets millions of hits a day, we may want to optimize this, but for now it's fine.
2022-01-28 13:59:51 -05:00
Samuel Clay
39047ee938
Merge branch 'master' into pro
...
* master:
Task deploy needs single sentry update.
Turning off PuSH for standalone installs.
2022-01-25 15:46:25 -05:00
Samuel Clay
6a61620d32
Turning off PuSH for standalone installs.
2022-01-25 15:27:29 -05:00
Samuel Clay
1b9a6f54d5
Activating premium archive subscription.
2022-01-24 17:23:25 -05:00
Samuel Clay
4cf8aa9def
Merge branch 'master' into pro
...
* master:
Better handling of Twitter being down (and returning a 503).
2022-01-21 06:54:45 -05:00