Commit graph

1918 commits

Author SHA1 Message Date
Samuel Clay
cdf5a36b81 Don't delete redis keys because they take time to rebuild and subs can be counted incorrectly during that time. 2022-08-10 17:45:25 -04:00
Samuel Clay
78547af24b Adding cutoff from trimming stories for memory profiling. 2022-07-27 08:19:46 -04:00
Samuel Clay
381953ee78 Bumping highlights max from 1024 characters to 16384 characters. 2022-07-19 10:00:16 -04:00
Samuel Clay
c94bb6640d Improving redis performance by reading the config. 2022-07-18 21:10:42 -04:00
Samuel Clay
3c0cab8d8e Preserve feed even if no subs. 2022-07-01 13:48:10 -04:00
Samuel Clay
f1734e3755 Handling weird exceptions from the exception_retry. 2022-07-01 13:24:47 -04:00
Samuel Clay
1e2ecb19d9 Handling unparseable error in text importer. 2022-07-01 12:21:40 -04:00
Samuel Clay
0e42edeb89 Including size in feed title 2022-06-27 13:16:08 -04:00
Samuel Clay
5674fc981c Adding stories in archive to stats popover. 2022-06-09 10:18:32 -07:00
Samuel Clay
8ab3d871e7 Adding feed archive count and showing it in Statistics (with the feed byte size on hover). 2022-06-06 16:03:50 -04:00
Samuel Clay
c2f6cc3d99 Turning premium setup back on 2022-06-05 19:38:28 -04:00
Samuel Clay
e64dc781ed Ignoring premium setup for now. 2022-06-05 19:19:33 -04:00
Samuel Clay
289eedb46f Only count subscribers if none found. 2022-06-05 19:16:59 -04:00
Samuel Clay
9899816196 Fixing starting page for archives. 2022-05-24 11:40:49 -04:00
Samuel Clay
f6f0738acd Back off counting fs_size so much, only on feed cleanup (2% chance). 2022-05-21 06:22:39 -04:00
Samuel Clay
3881b838c9 Merge branch 'master' into pro
* master:
  Wrong output from mongo featurecompatibilityversion.
  Revert "Prod debug on local postgres."
  Fix strict JS error during folder moves
2022-05-18 10:25:23 -04:00
Samuel Clay
5d3ec41c50 Wrong output from mongo featurecompatibilityversion. 2022-05-17 16:45:35 -04:00
Samuel Clay
e7c507bae9 Adding merge migration for mongo compatibility into pro. 2022-05-17 09:55:25 -04:00
Samuel Clay
022ace9d90 Merge branch 'master' into pro
* master:
  Downgrading to mongodb 4.0 with featureCompatibilityVersion migration to prepare for mongo 4.2.
2022-05-17 09:54:39 -04:00
Samuel Clay
2d4b1f508b Downgrading to mongodb 4.0 with featureCompatibilityVersion migration to prepare for mongo 4.2. 2022-05-17 09:42:04 -04:00
Samuel Clay
bfdfa10bfd Adding file system size (bytes) for feeds, decompressing stories to figure out their true size. Needs to be integrated into the UI. 2022-05-11 15:00:23 -04:00
Samuel Clay
5ff6a340f1 Merge branch 'master' into pro
* master:
  Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery.
  Removing unused mongo mms utils and configs.
  Updating pymongo to mongodb 4.0 compatible. Any further and we lose mongo wire protocol inspection.
  Full arm64 setup for imageproxy.
  Rearranging TF vars
  Upgrading to MongoDB 4.0, and upping mongo servers.
2022-05-10 20:59:03 -04:00
Samuel Clay
31de0f7a97 Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery. 2022-05-10 20:58:47 -04:00
Samuel Clay
a880a24b55 All new icons for the feed list. 2022-05-04 11:27:32 -04:00
Samuel Clay
caf85b679a Merge branch 'master' into pro
* master:
  Showing reason why an original page won't load. Fixes #1519.
2022-05-03 16:50:19 -04:00
Samuel Clay
16f002fd59 Oldest first now also uses feed pager unless unread only filter included. 2022-05-03 15:40:10 -04:00
Samuel Clay
909722b361 Showing reason why an original page won't load. Fixes #1519. 2022-05-02 16:57:15 -04:00
Samuel Clay
de1fb57406 Finishing RFC 5005 archive fetcher (for #1109). Also fixing mongo commands and adding checks for archive subscribers. 2022-04-29 11:31:32 -04:00
Samuel Clay
5981b24588 Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable. 2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories. 2022-04-18 13:29:13 -04:00
Samuel Clay
43695b8cd4 Back-filling archive pages. This closes #1564. 2022-04-13 10:43:29 -04:00
Samuel Clay
f33cbcf312 Merge branch 'master' into pro
* master: (72 commits)
  Missing import
  Correctly decoding shared stories in RSS feed.
  Adding scroll to feed and story options popover (Style menu).
  Magazine view blog post.
  Refactoring story content preview with newlines preserved.
  Boosting db profiling from 1% to 5%.
  Ignore data uris for widget, they are never the big images
  Wait to strip data uri header until it's time.
  Moving encoding
  Don't double encode base64 images for widgets.
  Preserving paragraphs in magazine and grid views.
  Fixing bad instrumentation on mongo and redis logs.
  Wrong url for db profiler.
  Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
  Fixing strict bug where  wasn't defined.
  Showing grid image previews. Not sure how this ever worked before.
  Grid has image if found already.
  Showing grid image on load if youtube
  Only monitor river_stories for db times
  Not hitting a db shouldnt be colored any differently than a small value.
  ...
2022-03-09 11:41:40 -05:00
Samuel Clay
2491e3bf86 Fixing youtube story content encoding bug. 2022-03-03 11:21:06 -05:00
Samuel Clay
e2cdc90e3f More potential checks for youtube videos in story image preview. 2022-02-23 16:28:16 -05:00
Samuel Clay
f403fb624e Using youtube thumbnails as image url in stories. 2022-02-22 15:50:21 -05:00
Samuel Clay
8dc3573b7d Adding active_provider field to profile to capture most recent payment provider in order to show correction options on feedchooser/premium dialog. Paypal now upgrades, just need to write messaging stating switches should happen at rewewal. 2022-02-16 09:20:43 -05:00
Samuel Clay
2792e7305a Syncing redis on premium upgrade to sync new unread date possibilities for archive users. 2022-01-13 16:56:30 -05:00
Samuel Clay
1dd921fa61 Adding DAYS_OF_UNREAD_ARCHIVE and updating all the upread_cutoff's I could find. Doesn't seem to work yet when marking an older story as unread, but there's probably a line somewhere that's preventing the unread from working. 2022-01-13 14:55:44 -05:00
Samuel Clay
3ef72e6f83 Fixing feed fetch status screen to better show how subs are being fetched. 2022-01-12 11:58:28 -05:00
Samuel Clay
f615fccdad Coutning archive and pro premiums correctly. 2022-01-11 15:56:19 -05:00
Samuel Clay
cab90d6ace Adding archive premium accounts. 2022-01-11 10:59:45 -05:00
Samuel Clay
221bf86664 Color 2022-01-11 10:48:07 -05:00
Samuel Clay
9857ddbcb5 Typo 2022-01-10 17:09:55 -05:00
Samuel Clay
db2a87df06 Counting pro subscribers. 2022-01-10 17:00:27 -05:00
Samuel Clay
66863653aa Adding is_pro field to Profile, also making a bunch of null/blank ALTER TABLE migrations and seeing how long they take to apply to a staging prod db. 2022-01-10 16:07:49 -05:00
Samuel Clay
205d35b932 Removing unused readability unparseable error. 2021-10-25 19:46:15 -04:00
Samuel Clay
fcd8652715 Rewriting content before save. 2021-09-30 12:25:28 -04:00
Samuel Clay
5c6535fd2c Newsletters have shorter full text, not longer. 2021-09-30 12:19:36 -04:00
Samuel Clay
fa13a0f9d4 No using extraargs for s3. 2021-08-26 16:21:36 -04:00
Samuel Clay
1469992f2d S3 content-type to contenttype. 2021-08-26 15:50:11 -04:00