Commit graph

511 commits

Author SHA1 Message Date
Samuel Clay
eed3de0f82 Use latest unread_cutoff to fetch stories for inverting. 2022-07-05 12:14:04 -04:00
Samuel Clay
c296948ba8 Fixing issue where marking a story as unread would turn all of the stories read if the mark read date was older than unread cutoff for the user. No need to invert stories if mark read date user-specific unread cutoff is older than story. 2022-07-05 12:10:03 -04:00
Samuel Clay
e32e581562 Cutting feed chunks in half 2022-07-05 10:25:17 -04:00
Samuel Clay
b1c8cf64cd Changing unread cutoff date to use unread cutoff, not days of story hashes. 2022-07-02 11:36:58 -04:00
Samuel Clay
0b77ec3e86 Refactoring story_hashes to be more efficient with the zunionstore's. 2022-06-27 16:16:02 -04:00
Samuel Clay
4081b7b278 Upping river chunk size to decrease latency. 2022-06-27 12:33:36 -04:00
Samuel Clay
7991c9da26 Wrong feed ids when removing temporary unread sets. 2022-06-27 12:32:16 -04:00
Samuel Clay
6e71f847a2 Clearing out unread stories after being used. 2022-06-27 12:28:19 -04:00
Samuel Clay
108d88b785 Attempting to reduce redis db size by deleting unread stories list when no longer needed. 2022-06-27 12:24:49 -04:00
Samuel Clay
4b0a599a03 Removing stories outside a mark read date cutoff. Also slightly optimizing a check for old unread stories by checking existance instead of zrevrange -1 -1. 2022-06-24 18:12:00 -04:00
Samuel Clay
71cd36f215 Removing unecessary pulling of story hashes from pipeline when we can just index into the stored set. 2022-06-24 14:29:58 -04:00
Samuel Clay
f459944b88 Accidentally running full aggregation on chunks and not end of pipeline. 2022-06-23 17:50:47 -04:00
Samuel Clay
c38fcc59cf Refactoring all stories redis calls, now with 99% less traffic. 2022-06-23 17:32:55 -04:00
Samuel Clay
23260a4b72 Removing dump and restore by querying on zinterstore of river hashes. 2022-06-23 17:13:06 -04:00
Samuel Clay
30127d7c72 Refactoring out get_stories and its duplicate implementation and using story_hashes. 2022-06-23 15:50:56 -04:00
Samuel Clay
6792762e27 Refactoring story_hashes grouP-by_feed in prep for removing .get_stories(). 2022-06-23 15:35:20 -04:00
Samuel Clay
8aff53c2ba Re-enabling archive redis calls. 2022-06-23 14:38:13 -04:00
Samuel Clay
81f51f1723 Handling soft time limits while fetching archives. 2022-06-22 17:40:16 -04:00
Samuel Clay
c20eed028c Attempting to impose longer time limits for archive fetch. 2022-06-22 15:44:39 -04:00
Samuel Clay
9759bda53a Overriding time limit for archive feed fetch. 2022-06-22 15:06:30 -04:00
Samuel Clay
04544f9c9f Using correct unread cutoff. 2022-06-21 11:11:38 -04:00
Samuel Clay
82bba3f6a7 Temporarily disabling extra redis calls for archive users. 2022-05-25 18:21:42 -04:00
Samuel Clay
d65ece02d8 Left in a query that should've been higher. 2022-05-25 17:46:46 -04:00
Samuel Clay
1116569160 Adding graphic to archive thank you email. 2022-05-05 16:03:14 -04:00
Samuel Clay
03cab31143 Only use oldest unread story in unread only read filter for archive subscribers. Otherwise it will trim stories older than the oldest unread in All Stories. 2022-04-18 16:23:52 -04:00
Samuel Clay
5981b24588 Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable. 2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories. 2022-04-18 13:29:13 -04:00
Samuel Clay
ea31cef872 Fixed an issue where a feed going from 0 unreads to a manually marked unread would not show up in the river because the unread count was still marked as dirty. Now client will force an immediate feed recount when marking unread. 2022-03-29 12:25:38 -04:00
Samuel Clay
a633c0983b Taking archive unreads into account in single feeds. 2022-03-23 16:25:03 -04:00
Samuel Clay
da1f2c477a Adding user feed unreads to unread story list. That took care of the river it seems. Now for unread counts. 2022-03-18 17:36:27 -04:00
Samuel Clay
efea59efb3 Now cutting down unread story cache based on unread filter's min and max cutoffs. Less to store. 2022-03-18 17:29:35 -04:00
Samuel Clay
e58c135eb6 Rewrote user feed unread to live on redis and to change the stories coming out of UserSubscription.get_stories. Still need to update unread status and work on river. 2022-03-18 17:18:27 -04:00
Samuel Clay
7657f8ecf7 Renaming story can be marked as unread 2022-03-10 15:41:51 -05:00
Samuel Clay
d9b235498c Missing import 2022-03-10 12:04:27 -05:00
Samuel Clay
e061f410cc Stubbing in new MUserUnreadStory model. This is only for unread stories beyond a premium archive user's unread_cutoff. Need to change unread counts and get_stories to consider these stories. 2022-03-09 17:51:32 -05:00
Samuel Clay
3940e3f2a4 Less text 2022-01-19 14:32:27 -05:00
Samuel Clay
fdeca57412 Changing cutoff dates when fetching stories, fixing issues around Oldest first for both unreads and all stories. 2022-01-18 15:25:15 -05:00
Samuel Clay
2792e7305a Syncing redis on premium upgrade to sync new unread date possibilities for archive users. 2022-01-13 16:56:30 -05:00
Samuel Clay
1dd921fa61 Adding DAYS_OF_UNREAD_ARCHIVE and updating all the upread_cutoff's I could find. Doesn't seem to work yet when marking an older story as unread, but there's probably a line somewhere that's preventing the unread from working. 2022-01-13 14:55:44 -05:00
Samuel Clay
548ea15a9f Scheduling feed fetches immediately if found in safety net. 2022-01-12 12:04:25 -05:00
Samuel Clay
c766e781ed JSON Feeds 1.1. 2021-04-02 13:27:33 -04:00
Samuel Clay
dbec2708da Only show active feeds in dashboard river. Also link dashboard river title and icon. 2021-03-04 10:24:17 -05:00
Samuel Clay
889d37cebb Smarter merging of repeat feeds/folders when compacting folders. 2021-03-03 17:56:23 -05:00
Samuel Clay
4cc6246e4e Better logging for user sub folders compaction. 2021-02-02 19:23:53 -05:00
Samuel Clay
22162551d7 Rewriting compact to handle duplicate folders. 2021-02-02 19:18:01 -05:00
Samuel Clay
5869f40fe0 Weird encoding error on redis' part, where a DUMP causes an encoding error due to decode_responses=True. Seems easy enough to work around. 2021-01-14 19:42:38 -05:00
Samuel Clay
c1b9e0b09f Removing pdb 2021-01-14 19:27:15 -05:00
Samuel Clay
a20272ec9b New display options save. Now to hook them up. 2021-01-14 18:14:11 -05:00
Samuel Clay
a1f4d67d27 Changing how tasks are called. 2021-01-06 14:42:24 -05:00
Samuel Clay
82fecb23a6 Merge branch 'docker_django3.1' into dashboard3
* docker_django3.1: (117 commits)
  Adding docker to node scripts.
  Removing node_modules from repo
  Whoops
  Better logging for broken paypal ipns.
  Adding RSS Tracker for Windows to Goodies.
  Refactoring socketio so real-time works around username restrictions.
  Socket.IO v3 on the server too.
  Switching to Socket.IO v3.
  Haproxy splitting for socketio 3
  Socket.io 3
  Handling missing feed.
  Only nb.local.com uses ports for websockets.
  Adding GrazeTEN
  Full node install on setup.
  Updating toprc
  correct newsblur to newsblur_web in tasks
  Changing mongodb server.
  Fixing toprc
  Attempting to collect queries for 1% of requests by using DEBUG.
  Fixing mongo install.
  ...
2021-01-05 19:36:49 -05:00