Commit graph

516 commits

Author SHA1 Message Date
Samuel Clay
a37c8593f7 Expiration unread stories key after 24 hours. 2022-07-07 16:23:18 -04:00
Samuel Clay
501db5895b Don't delete user unread stories keys in prep for using them as part of the river. 2022-07-07 15:42:57 -04:00
Samuel Clay
9314832cf1 Even bigger chunks? 2022-07-06 14:34:52 -04:00
Samuel Clay
8a6330951b Moving to huge redis chunks. 2022-07-06 14:02:56 -04:00
Samuel Clay
c318955283 Reducing redis-story chunk size down to 10 to see if it alleviates pressure. 2022-07-05 16:46:11 -04:00
Samuel Clay
eed3de0f82 Use latest unread_cutoff to fetch stories for inverting. 2022-07-05 12:14:04 -04:00
Samuel Clay
c296948ba8 Fixing issue where marking a story as unread would turn all of the stories read if the mark read date was older than unread cutoff for the user. No need to invert stories if mark read date user-specific unread cutoff is older than story. 2022-07-05 12:10:03 -04:00
Samuel Clay
e32e581562 Cutting feed chunks in half 2022-07-05 10:25:17 -04:00
Samuel Clay
b1c8cf64cd Changing unread cutoff date to use unread cutoff, not days of story hashes. 2022-07-02 11:36:58 -04:00
Samuel Clay
0b77ec3e86 Refactoring story_hashes to be more efficient with the zunionstore's. 2022-06-27 16:16:02 -04:00
Samuel Clay
4081b7b278 Upping river chunk size to decrease latency. 2022-06-27 12:33:36 -04:00
Samuel Clay
7991c9da26 Wrong feed ids when removing temporary unread sets. 2022-06-27 12:32:16 -04:00
Samuel Clay
6e71f847a2 Clearing out unread stories after being used. 2022-06-27 12:28:19 -04:00
Samuel Clay
108d88b785 Attempting to reduce redis db size by deleting unread stories list when no longer needed. 2022-06-27 12:24:49 -04:00
Samuel Clay
4b0a599a03 Removing stories outside a mark read date cutoff. Also slightly optimizing a check for old unread stories by checking existance instead of zrevrange -1 -1. 2022-06-24 18:12:00 -04:00
Samuel Clay
71cd36f215 Removing unecessary pulling of story hashes from pipeline when we can just index into the stored set. 2022-06-24 14:29:58 -04:00
Samuel Clay
f459944b88 Accidentally running full aggregation on chunks and not end of pipeline. 2022-06-23 17:50:47 -04:00
Samuel Clay
c38fcc59cf Refactoring all stories redis calls, now with 99% less traffic. 2022-06-23 17:32:55 -04:00
Samuel Clay
23260a4b72 Removing dump and restore by querying on zinterstore of river hashes. 2022-06-23 17:13:06 -04:00
Samuel Clay
30127d7c72 Refactoring out get_stories and its duplicate implementation and using story_hashes. 2022-06-23 15:50:56 -04:00
Samuel Clay
6792762e27 Refactoring story_hashes grouP-by_feed in prep for removing .get_stories(). 2022-06-23 15:35:20 -04:00
Samuel Clay
8aff53c2ba Re-enabling archive redis calls. 2022-06-23 14:38:13 -04:00
Samuel Clay
81f51f1723 Handling soft time limits while fetching archives. 2022-06-22 17:40:16 -04:00
Samuel Clay
c20eed028c Attempting to impose longer time limits for archive fetch. 2022-06-22 15:44:39 -04:00
Samuel Clay
9759bda53a Overriding time limit for archive feed fetch. 2022-06-22 15:06:30 -04:00
Samuel Clay
04544f9c9f Using correct unread cutoff. 2022-06-21 11:11:38 -04:00
Samuel Clay
82bba3f6a7 Temporarily disabling extra redis calls for archive users. 2022-05-25 18:21:42 -04:00
Samuel Clay
d65ece02d8 Left in a query that should've been higher. 2022-05-25 17:46:46 -04:00
Samuel Clay
1116569160 Adding graphic to archive thank you email. 2022-05-05 16:03:14 -04:00
Samuel Clay
03cab31143 Only use oldest unread story in unread only read filter for archive subscribers. Otherwise it will trim stories older than the oldest unread in All Stories. 2022-04-18 16:23:52 -04:00
Samuel Clay
5981b24588 Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable. 2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories. 2022-04-18 13:29:13 -04:00
Samuel Clay
ea31cef872 Fixed an issue where a feed going from 0 unreads to a manually marked unread would not show up in the river because the unread count was still marked as dirty. Now client will force an immediate feed recount when marking unread. 2022-03-29 12:25:38 -04:00
Samuel Clay
a633c0983b Taking archive unreads into account in single feeds. 2022-03-23 16:25:03 -04:00
Samuel Clay
da1f2c477a Adding user feed unreads to unread story list. That took care of the river it seems. Now for unread counts. 2022-03-18 17:36:27 -04:00
Samuel Clay
efea59efb3 Now cutting down unread story cache based on unread filter's min and max cutoffs. Less to store. 2022-03-18 17:29:35 -04:00
Samuel Clay
e58c135eb6 Rewrote user feed unread to live on redis and to change the stories coming out of UserSubscription.get_stories. Still need to update unread status and work on river. 2022-03-18 17:18:27 -04:00
Samuel Clay
7657f8ecf7 Renaming story can be marked as unread 2022-03-10 15:41:51 -05:00
Samuel Clay
d9b235498c Missing import 2022-03-10 12:04:27 -05:00
Samuel Clay
e061f410cc Stubbing in new MUserUnreadStory model. This is only for unread stories beyond a premium archive user's unread_cutoff. Need to change unread counts and get_stories to consider these stories. 2022-03-09 17:51:32 -05:00
Samuel Clay
3940e3f2a4 Less text 2022-01-19 14:32:27 -05:00
Samuel Clay
fdeca57412 Changing cutoff dates when fetching stories, fixing issues around Oldest first for both unreads and all stories. 2022-01-18 15:25:15 -05:00
Samuel Clay
2792e7305a Syncing redis on premium upgrade to sync new unread date possibilities for archive users. 2022-01-13 16:56:30 -05:00
Samuel Clay
1dd921fa61 Adding DAYS_OF_UNREAD_ARCHIVE and updating all the upread_cutoff's I could find. Doesn't seem to work yet when marking an older story as unread, but there's probably a line somewhere that's preventing the unread from working. 2022-01-13 14:55:44 -05:00
Samuel Clay
548ea15a9f Scheduling feed fetches immediately if found in safety net. 2022-01-12 12:04:25 -05:00
Samuel Clay
c766e781ed JSON Feeds 1.1. 2021-04-02 13:27:33 -04:00
Samuel Clay
dbec2708da Only show active feeds in dashboard river. Also link dashboard river title and icon. 2021-03-04 10:24:17 -05:00
Samuel Clay
889d37cebb Smarter merging of repeat feeds/folders when compacting folders. 2021-03-03 17:56:23 -05:00
Samuel Clay
4cc6246e4e Better logging for user sub folders compaction. 2021-02-02 19:23:53 -05:00
Samuel Clay
22162551d7 Rewriting compact to handle duplicate folders. 2021-02-02 19:18:01 -05:00