Commit graph

1333 commits

Author SHA1 Message Date
Samuel Clay
5981b24588 Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable. 2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories. 2022-04-18 13:29:13 -04:00
Samuel Clay
43695b8cd4 Back-filling archive pages. This closes #1564. 2022-04-13 10:43:29 -04:00
Samuel Clay
f33cbcf312 Merge branch 'master' into pro
* master: (72 commits)
  Missing import
  Correctly decoding shared stories in RSS feed.
  Adding scroll to feed and story options popover (Style menu).
  Magazine view blog post.
  Refactoring story content preview with newlines preserved.
  Boosting db profiling from 1% to 5%.
  Ignore data uris for widget, they are never the big images
  Wait to strip data uri header until it's time.
  Moving encoding
  Don't double encode base64 images for widgets.
  Preserving paragraphs in magazine and grid views.
  Fixing bad instrumentation on mongo and redis logs.
  Wrong url for db profiler.
  Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
  Fixing strict bug where  wasn't defined.
  Showing grid image previews. Not sure how this ever worked before.
  Grid has image if found already.
  Showing grid image on load if youtube
  Only monitor river_stories for db times
  Not hitting a db shouldnt be colored any differently than a small value.
  ...
2022-03-09 11:41:40 -05:00
Samuel Clay
2491e3bf86 Fixing youtube story content encoding bug. 2022-03-03 11:21:06 -05:00
Samuel Clay
e2cdc90e3f More potential checks for youtube videos in story image preview. 2022-02-23 16:28:16 -05:00
Samuel Clay
f403fb624e Using youtube thumbnails as image url in stories. 2022-02-22 15:50:21 -05:00
Samuel Clay
8dc3573b7d Adding active_provider field to profile to capture most recent payment provider in order to show correction options on feedchooser/premium dialog. Paypal now upgrades, just need to write messaging stating switches should happen at rewewal. 2022-02-16 09:20:43 -05:00
Samuel Clay
2792e7305a Syncing redis on premium upgrade to sync new unread date possibilities for archive users. 2022-01-13 16:56:30 -05:00
Samuel Clay
1dd921fa61 Adding DAYS_OF_UNREAD_ARCHIVE and updating all the upread_cutoff's I could find. Doesn't seem to work yet when marking an older story as unread, but there's probably a line somewhere that's preventing the unread from working. 2022-01-13 14:55:44 -05:00
Samuel Clay
3ef72e6f83 Fixing feed fetch status screen to better show how subs are being fetched. 2022-01-12 11:58:28 -05:00
Samuel Clay
f615fccdad Coutning archive and pro premiums correctly. 2022-01-11 15:56:19 -05:00
Samuel Clay
cab90d6ace Adding archive premium accounts. 2022-01-11 10:59:45 -05:00
Samuel Clay
221bf86664 Color 2022-01-11 10:48:07 -05:00
Samuel Clay
9857ddbcb5 Typo 2022-01-10 17:09:55 -05:00
Samuel Clay
db2a87df06 Counting pro subscribers. 2022-01-10 17:00:27 -05:00
Samuel Clay
6db2ed94ce Bump twitter feeds up to 2 hours to fix rate limits. 2021-08-24 17:25:31 -04:00
Samuel Clay
0cd123b60f Ignore feedburner images. 2021-07-08 13:55:56 -04:00
Samuel Clay
c6ce8cc36a Everything is smart bytes when it comes to original pages. 2021-05-12 21:19:09 -04:00
Samuel Clay
c7fac210d5 -1 minute is -1 days 23:59:00, so bumping days. 2021-05-05 14:56:08 -04:00
Samuel Clay
34c9ee712c Fixing search on docker. Also setting up docker installs to always have active subscribers so feeds are never stale. 2021-04-27 20:49:10 -04:00
Samuel Clay
ddc8563080 Boosting single subscriber feeds that publish once a month from 12 hours to 6 hours. 2021-04-20 18:46:16 -04:00
Samuel Clay
a4b7927b92 Nice number of feed fetchers 2021-04-16 17:25:57 -04:00
Samuel Clay
fd2aa291d1 Typo 2021-04-13 16:36:00 -04:00
Samuel Clay
5a682ff2b9 Docker compose should be v2 for mem_limits, not v3 for swarm. 2021-04-13 16:35:06 -04:00
Samuel Clay
4db47a1771 Using redis exclusively for well read score. 2021-04-13 16:24:49 -04:00
Samuel Clay
ba46b2f85a Don't fetch broken feeds immediately as they can get stuck in a loop. 2021-04-07 15:32:17 -04:00
Samuel Clay
1deae3d810 Fixing broken pages. 2021-04-02 14:46:52 -04:00
Samuel Clay
1bd5ac2219 Fixing #1434. Original pages weren't working until now due to encoding issues. 2021-04-01 18:22:50 -04:00
Samuel Clay
5822af1645 Py3 urlparse 2021-03-25 18:47:15 -04:00
Samuel Clay
9f7f00efaa Combining absolute with relative urls. 2021-03-25 18:46:21 -04:00
Samuel Clay
712e44619b Fixing feed autocomplete 2021-03-25 15:38:15 -04:00
Samuel Clay
9d1a61fd79 Handling broken latest_story_content. 2021-03-25 14:54:49 -04:00
Samuel Clay
2fe3153770 Adding MStory str and removing vendorized paypal. 2021-03-25 14:35:14 -04:00
Samuel Clay
1f9eaf4489 5 seconds for existing story check. 2021-03-25 12:23:19 -04:00
Samuel Clay
02138db5ca Switching from elasticsearch and dsl to pyelasticsearch. Feed autocomplete still doesn't work yet. 2021-03-24 21:09:26 -04:00
Samuel Clay
3e61c5e907 Feed autocomplete is trnaslated to elasticsearch 7, but doesn't work quite yet. 2021-03-23 15:30:44 -04:00
Samuel Clay
2906e92499 Merging all four node servers into a single one on port 8008. Updating HAProxy on both consul and docker-compose. 2021-03-16 19:34:11 -04:00
Samuel Clay
dbec2708da Only show active feeds in dashboard river. Also link dashboard river title and icon. 2021-03-04 10:24:17 -05:00
Samuel Clay
8e088ba350 Switching to py3 html parser. 2021-03-02 09:46:59 -05:00
Samuel Clay
88d051abbf Adding first image in original text when the story image no longer appears in the text. This should show more photos when reading by text. 2021-02-26 12:10:30 -05:00
Samuel Clay
c36373de61 cutoff needs to be an integer so mongo can handle the slice. 2021-02-25 19:54:00 -05:00
Samuel Clay
07e7218d4d Fixing py3 issue with total being a float. 2021-02-25 19:34:21 -05:00
Samuel Clay
c5f4734de4 Finally getting sentry to work in feed fetching. 2021-02-25 19:32:48 -05:00
Samuel Clay
1b7addab44 Undoing type change 2021-02-25 19:23:43 -05:00
Samuel Clay
1d16ec88b1 Wrapping feed fetcher in sentry exception capturing. 2021-02-25 19:13:21 -05:00
Jonathan Math
bc66ad7659 handle empty list for drain_task_feeds 2021-02-23 10:08:40 -05:00
Samuel Clay
c7f4cbb13d Fixing a substantial number of encoding errors. Also fixing OPML uploads. 2021-01-24 21:05:22 -05:00
Samuel Clay
8cf070a72d Merge branch 'master' into dashboard3
* master:
  Removing old types field. Needed to upgrade to mongo 3.4.
  Checking if a feed has any notifications on it, set a max of 30 min fetch (yes this is a pretty good way of getting your feeds to fetch faster, but youll have to deal with the notifications).
  Fix task fetch monitor.
  Attempting to see iOS premium status over email.
  Handling work queue missing error.
2021-01-23 17:55:01 -05:00
Samuel Clay
6badcaf294 Removing old types field. Needed to upgrade to mongo 3.4. 2021-01-23 16:48:13 -05:00