Commit graph

318 commits

Author SHA1 Message Date
Samuel Clay
aab1f39df1 Turning off redis dupe story id writer. 2013-08-14 14:32:50 -07:00
Samuel Clay
6162f7026c Allowing empty in-folder in delete feed and delete folder. 2013-08-05 15:30:56 -07:00
Samuel Clay
fb710c870f Beginning of a long 16-day migration of feed's redis story ids into 30 day retention from 14 day retention. Once this migration is complete, can up the DAYS_OF_UNREAD to 30 day with no issues, except for updating scores. 2013-08-02 15:59:03 -07:00
Samuel Clay
b8efcd0713 Fixing redis/mongo logging accidentally duping logs on fast requests. 2013-07-31 11:17:04 -07:00
Samuel Clay
812500b41b Adding logging for new mark story hash as read endpoint. 2013-07-17 15:32:08 -07:00
Samuel Clay
94df1aa6b0 Dirtying user subs and social subs on new mark read with story hash endpoint. 2013-07-17 15:03:16 -07:00
Samuel Clay
b71c4d7b35 Adding mark_story_hash_as_read. Still needs subscription dirtying. 2013-07-17 15:03:16 -07:00
Samuel Clay
f5223015ae Fixing iOS crash on empty unread stories by providing correct data structure. Thanks to @linnet for spotting the bug. 2013-07-15 13:35:17 -07:00
Samuel Clay
a46f8090d6 Typo in missing feeds adder. 2013-07-15 12:11:39 -07:00
Samuel Clay
c0b31a58a9 Adding missing folder feeds to USF. 2013-07-15 12:10:51 -07:00
Samuel Clay
5af6e3835a A bit risky but this commit fixes read status issues with stories found in both blurblogs and feeds. Adds a new redis set of read stories, specific to users and blurblog subscriptions, that won't get cleared out when the story is removed from mongo. 2013-07-05 13:27:34 -07:00
Samuel Clay
32af8dc6fb Coloring trim. 2013-07-02 12:47:49 -07:00
Samuel Clay
a09394df16 Adding feed id to logging for read storty trimmer. 2013-07-02 12:10:46 -07:00
Samuel Clay
431ca3c648 Trimming read stories on feed unread recalc. 2013-07-02 12:08:22 -07:00
Samuel Clay
69492f9a52 Adding read story trimmer. 2013-07-02 12:02:41 -07:00
Samuel Clay
051c46ff11 Expiring read story keys when switching feeds. 2013-07-01 22:39:16 -07:00
Samuel Clay
2917d0b4cf Adding new redis3 host for dupe story read status and feed story status. Now with expiring read stories (that need an expunger, still). 2013-07-01 21:59:09 -07:00
Samuel Clay
02e17f1dd6 Adding better OAuth test to Google Reader import. 2013-07-01 19:17:10 -07:00
Samuel Clay
597cc7da68 Fixing empty folder river issue. Now loads unreads/all correctly, as well as river for all feeds when omitting feed ids. Whew. 2013-07-01 16:52:21 -07:00
Samuel Clay
3b7b5d1275 Expiring unread story keys as part of the fast river. 2013-07-01 08:22:02 -07:00
Samuel Clay
1f15613244 Further chunking river. 2013-06-28 19:25:24 -07:00
Samuel Clay
f95328a298 Chunking those mondo zadd calls. 2013-06-28 19:17:07 -07:00
Samuel Clay
e37e275d7c Whoops, typo on groups. 2013-06-28 19:10:59 -07:00
Samuel Clay
b2f93cb75b Chunking story hash pipeline to let others in. 2013-06-28 19:09:34 -07:00
Samuel Clay
7b84d65d95 Adding training to new fast river. Ready to ship! 2013-06-28 18:30:20 -07:00
Samuel Clay
c0c6d7b07b Fixing river error on empty folder. 2013-06-28 15:07:05 -07:00
Samuel Clay
a5b47c4513 Properly caching and using cached river story hashes. 2013-06-28 12:01:22 -07:00
Samuel Clay
07265badf1 Fixing massive river calls by taking data in and out of redis. 2013-06-27 17:53:47 -07:00
Samuel Clay
86acc97e17 Refactoring river. Something's off about Oldest first. 2013-06-27 17:21:01 -07:00
Samuel Clay
2df28e5095 Refactoring the living crap out of unread story hashes. Now supports ordering, filtering, and timestamps. 2013-06-27 16:23:29 -07:00
Samuel Clay
67b82a3a60 Converting lua script to multi/exec block. 2013-06-27 15:21:13 -07:00
Samuel Clay
14b5a9d2dd Fixing bug in optimized feed river. 2013-06-25 16:08:45 -07:00
Samuel Clay
dd1d89586d Fixing bug for last page of All Site Stories. 2013-06-25 15:51:04 -07:00
Samuel Clay
e62b058638 Major optimization to both single feed loads and river loads. Both are now checking training only for trained feeds, and river makes only a single subscirption call instead of N subscription calls. 2013-06-25 15:41:42 -07:00
Samuel Clay
7be08e15e6 Cutting out some logging. 2013-06-21 14:24:34 -07:00
Samuel Clay
83179de563 Refactoring unread counting for untrained subs. Much faster now that we don't have to fetch stories and read each one. 2013-06-21 14:15:13 -07:00
Samuel Clay
cceda612f6 Better logging for unread counts to see where counts are going moving. 2013-06-21 12:30:06 -07:00
Samuel Clay
b7e3f3c306 Adding a great progress bar and story fetch order. 2013-06-16 21:39:38 -07:00
Samuel Clay
f425a1602d Scheduling stale feeds for flat feed users, too. 2013-06-15 12:48:35 -07:00
Samuel Clay
b8fa01125d Fixing a typo around switching story hashes. 2013-06-04 18:10:20 -07:00
Samuel Clay
a2a427f8b4 Typo 2013-06-04 15:54:36 -07:00
Samuel Clay
3a7e72795f Refactoring story_hash methods lower on the stack into MStory. 2013-06-04 15:34:03 -07:00
Samuel Clay
b50986388a Adding ttls to redis stats sampler. 2013-06-03 15:50:03 -07:00
Samuel Clay
418d949b07 Switching hashes on read stories correctly (wtihout making a slow Redis keys() call). 2013-05-28 10:47:24 -07:00
Samuel Clay
ca5ef47e02 Marking feeds as read when there are no neutral or positive unreads. Dropping negatives. 2013-05-16 11:21:20 -07:00
Samuel Clay
9a6e9078c3 Switching to faster unread counting for socialsubs and usersubs. 2013-05-14 17:31:08 -07:00
Samuel Clay
707798948f Final cleanup before deploying. 2013-05-13 15:11:18 -07:00
Samuel Clay
d38e28f8da Merge branch 'master' into muserstory_remove
* master:
  Publishing realtime update when marking feed as read, only if it was actually marked as read.
  Turning off real-time on mark_feed_as_read. Too much!
2013-05-13 15:09:22 -07:00
Samuel Clay
ceff5929be Publishing realtime update when marking feed as read, only if it was actually marked as read. 2013-05-13 14:22:49 -07:00
Samuel Clay
bcdd1fe221 Merge branch 'master' into muserstory_remove
# By ojiikun (3) and Samuel Clay (2)
* master:
  Fixing hashes only call on folders.
  Handling another unicode decode issue in uploaded OPMLs.
  Make Story.read a boolean rather than an int.
  Upper limit on mark-read batch size auto-flushes.
  Remove forced sleep suspected of causing null activity access in fragments.
2013-05-13 12:59:04 -07:00