Commit graph

402 commits

Author SHA1 Message Date
Samuel Clay
2917d0b4cf Adding new redis3 host for dupe story read status and feed story status. Now with expiring read stories (that need an expunger, still). 2013-07-01 21:59:09 -07:00
Samuel Clay
02e17f1dd6 Adding better OAuth test to Google Reader import. 2013-07-01 19:17:10 -07:00
Samuel Clay
597cc7da68 Fixing empty folder river issue. Now loads unreads/all correctly, as well as river for all feeds when omitting feed ids. Whew. 2013-07-01 16:52:21 -07:00
Samuel Clay
3b7b5d1275 Expiring unread story keys as part of the fast river. 2013-07-01 08:22:02 -07:00
Samuel Clay
1f15613244 Further chunking river. 2013-06-28 19:25:24 -07:00
Samuel Clay
f95328a298 Chunking those mondo zadd calls. 2013-06-28 19:17:07 -07:00
Samuel Clay
e37e275d7c Whoops, typo on groups. 2013-06-28 19:10:59 -07:00
Samuel Clay
b2f93cb75b Chunking story hash pipeline to let others in. 2013-06-28 19:09:34 -07:00
Samuel Clay
7b84d65d95 Adding training to new fast river. Ready to ship! 2013-06-28 18:30:20 -07:00
Samuel Clay
c0c6d7b07b Fixing river error on empty folder. 2013-06-28 15:07:05 -07:00
Samuel Clay
a5b47c4513 Properly caching and using cached river story hashes. 2013-06-28 12:01:22 -07:00
Samuel Clay
07265badf1 Fixing massive river calls by taking data in and out of redis. 2013-06-27 17:53:47 -07:00
Samuel Clay
86acc97e17 Refactoring river. Something's off about Oldest first. 2013-06-27 17:21:01 -07:00
Samuel Clay
2df28e5095 Refactoring the living crap out of unread story hashes. Now supports ordering, filtering, and timestamps. 2013-06-27 16:23:29 -07:00
Samuel Clay
67b82a3a60 Converting lua script to multi/exec block. 2013-06-27 15:21:13 -07:00
Samuel Clay
14b5a9d2dd Fixing bug in optimized feed river. 2013-06-25 16:08:45 -07:00
Samuel Clay
dd1d89586d Fixing bug for last page of All Site Stories. 2013-06-25 15:51:04 -07:00
Samuel Clay
e62b058638 Major optimization to both single feed loads and river loads. Both are now checking training only for trained feeds, and river makes only a single subscirption call instead of N subscription calls. 2013-06-25 15:41:42 -07:00
Samuel Clay
7be08e15e6 Cutting out some logging. 2013-06-21 14:24:34 -07:00
Samuel Clay
83179de563 Refactoring unread counting for untrained subs. Much faster now that we don't have to fetch stories and read each one. 2013-06-21 14:15:13 -07:00
Samuel Clay
cceda612f6 Better logging for unread counts to see where counts are going moving. 2013-06-21 12:30:06 -07:00
Samuel Clay
b7e3f3c306 Adding a great progress bar and story fetch order. 2013-06-16 21:39:38 -07:00
Samuel Clay
f425a1602d Scheduling stale feeds for flat feed users, too. 2013-06-15 12:48:35 -07:00
Samuel Clay
b8fa01125d Fixing a typo around switching story hashes. 2013-06-04 18:10:20 -07:00
Samuel Clay
a2a427f8b4 Typo 2013-06-04 15:54:36 -07:00
Samuel Clay
3a7e72795f Refactoring story_hash methods lower on the stack into MStory. 2013-06-04 15:34:03 -07:00
Samuel Clay
b50986388a Adding ttls to redis stats sampler. 2013-06-03 15:50:03 -07:00
Samuel Clay
418d949b07 Switching hashes on read stories correctly (wtihout making a slow Redis keys() call). 2013-05-28 10:47:24 -07:00
Samuel Clay
ca5ef47e02 Marking feeds as read when there are no neutral or positive unreads. Dropping negatives. 2013-05-16 11:21:20 -07:00
Samuel Clay
9a6e9078c3 Switching to faster unread counting for socialsubs and usersubs. 2013-05-14 17:31:08 -07:00
Samuel Clay
707798948f Final cleanup before deploying. 2013-05-13 15:11:18 -07:00
Samuel Clay
d38e28f8da Merge branch 'master' into muserstory_remove
* master:
  Publishing realtime update when marking feed as read, only if it was actually marked as read.
  Turning off real-time on mark_feed_as_read. Too much!
2013-05-13 15:09:22 -07:00
Samuel Clay
ceff5929be Publishing realtime update when marking feed as read, only if it was actually marked as read. 2013-05-13 14:22:49 -07:00
Samuel Clay
bcdd1fe221 Merge branch 'master' into muserstory_remove
# By ojiikun (3) and Samuel Clay (2)
* master:
  Fixing hashes only call on folders.
  Handling another unicode decode issue in uploaded OPMLs.
  Make Story.read a boolean rather than an int.
  Upper limit on mark-read batch size auto-flushes.
  Remove forced sleep suspected of causing null activity access in fragments.
2013-05-13 12:59:04 -07:00
Samuel Clay
7cc3271126 Fixing hashes only call on folders. 2013-05-13 12:58:57 -07:00
Samuel Clay
b98d129d1b Removing MUserStory entirely. 2013-05-10 16:11:30 -07:00
Samuel Clay
0483273840 Remvoing unused everything_unread param from river stories. 2013-05-09 16:40:06 -07:00
Samuel Clay
cc5d87f795 Using story_hashes instead of fetch_stories parameter. 2013-05-09 16:16:14 -07:00
Samuel Clay
e5a87464ab Moving read stories over to RUserStory when merging feeds. 2013-05-09 14:56:51 -07:00
Samuel Clay
1c5866993b Merge branch 'master' into ruserstory
* master:
  Migrating comment feeds to non-comment feeds.
  Disallowing branched feeds from feed search.
2013-05-07 16:04:31 -07:00
Samuel Clay
5ceb0c45bf Migrating comment feeds to non-comment feeds. 2013-05-07 15:37:36 -07:00
Samuel Clay
b54c062442 Adding optional force param to sub counter. 2013-05-03 17:42:41 -07:00
Samuel Clay
d03a9c30a7 Speeding up unread story counts. 2013-05-03 17:28:05 -07:00
Samuel Clay
b9f6626358 Speeding up unread story counts. 2013-05-03 17:24:02 -07:00
Samuel Clay
93a2f5f784 Adding force calculate sub scores option. 2013-05-03 17:07:45 -07:00
Samuel Clay
b8f2571a1a Fixing global feed to show read stories. 2013-05-03 16:48:17 -07:00
Samuel Clay
d1cb05a09e Fixing reading stories in river blurblog. 2013-05-03 15:08:12 -07:00
Samuel Clay
8da72b2c22 Merge branch 'master' into ruserstory
* master:
  Using story cache when calculating unreads, for those who need unread counts updating.
2013-05-03 14:46:47 -07:00
Samuel Clay
1a04bcd400 Moving river blurblog to no longer use MUserStory. 2013-05-03 14:46:44 -07:00
Samuel Clay
550a33d9ab Using story cache when calculating unreads, for those who need unread counts updating. 2013-05-03 09:43:21 -07:00