471 commits

Author	SHA1	Message	Date
Samuel Clay	d8ed12f15b	Backend for marking feeds/folders as read at a specific timestamp.	2013-09-13 15:02:10 -07:00
Samuel Clay	3f3bbae5d1	Fixing friend user ids when marking stories as read.	2013-09-06 13:20:08 -07:00
Samuel Clay	dec22ac776	Moving to simpler read story endpoint.	2013-09-06 12:42:39 -07:00
Samuel Clay	aab1f39df1	Turning off redis dupe story id writer.	2013-08-14 14:32:50 -07:00
Samuel Clay	6162f7026c	Allowing empty in-folder in delete feed and delete folder.	2013-08-05 15:30:56 -07:00
Samuel Clay	fb710c870f	Beginning of a long 16-day migration of feed's redis story ids into 30 day retention from 14 day retention. Once this migration is complete, can up the DAYS_OF_UNREAD to 30 day with no issues, except for updating scores.	2013-08-02 15:59:03 -07:00
Samuel Clay	b8efcd0713	Fixing redis/mongo logging accidentally duping logs on fast requests.	2013-07-31 11:17:04 -07:00
Samuel Clay	812500b41b	Adding logging for new mark story hash as read endpoint.	2013-07-17 15:32:08 -07:00
Samuel Clay	94df1aa6b0	Dirtying user subs and social subs on new mark read with story hash endpoint.	2013-07-17 15:03:16 -07:00
Samuel Clay	b71c4d7b35	Adding mark_story_hash_as_read. Still needs subscription dirtying.	2013-07-17 15:03:16 -07:00
Samuel Clay	f5223015ae	Fixing iOS crash on empty unread stories by providing correct data structure. Thanks to @linnet for spotting the bug.	2013-07-15 13:35:17 -07:00
Samuel Clay	a46f8090d6	Typo in missing feeds adder.	2013-07-15 12:11:39 -07:00
Samuel Clay	c0b31a58a9	Adding missing folder feeds to USF.	2013-07-15 12:10:51 -07:00
Samuel Clay	5af6e3835a	A bit risky but this commit fixes read status issues with stories found in both blurblogs and feeds. Adds a new redis set of read stories, specific to users and blurblog subscriptions, that won't get cleared out when the story is removed from mongo.	2013-07-05 13:27:34 -07:00
Samuel Clay	32af8dc6fb	Coloring trim.	2013-07-02 12:47:49 -07:00
Samuel Clay	a09394df16	Adding feed id to logging for read storty trimmer.	2013-07-02 12:10:46 -07:00
Samuel Clay	431ca3c648	Trimming read stories on feed unread recalc.	2013-07-02 12:08:22 -07:00
Samuel Clay	69492f9a52	Adding read story trimmer.	2013-07-02 12:02:41 -07:00
Samuel Clay	051c46ff11	Expiring read story keys when switching feeds.	2013-07-01 22:39:16 -07:00
Samuel Clay	2917d0b4cf	Adding new redis3 host for dupe story read status and feed story status. Now with expiring read stories (that need an expunger, still).	2013-07-01 21:59:09 -07:00
Samuel Clay	02e17f1dd6	Adding better OAuth test to Google Reader import.	2013-07-01 19:17:10 -07:00
Samuel Clay	597cc7da68	Fixing empty folder river issue. Now loads unreads/all correctly, as well as river for all feeds when omitting feed ids. Whew.	2013-07-01 16:52:21 -07:00
Samuel Clay	3b7b5d1275	Expiring unread story keys as part of the fast river.	2013-07-01 08:22:02 -07:00
Samuel Clay	1f15613244	Further chunking river.	2013-06-28 19:25:24 -07:00
Samuel Clay	f95328a298	Chunking those mondo zadd calls.	2013-06-28 19:17:07 -07:00
Samuel Clay	e37e275d7c	Whoops, typo on groups.	2013-06-28 19:10:59 -07:00
Samuel Clay	b2f93cb75b	Chunking story hash pipeline to let others in.	2013-06-28 19:09:34 -07:00
Samuel Clay	7b84d65d95	Adding training to new fast river. Ready to ship!	2013-06-28 18:30:20 -07:00
Samuel Clay	c0c6d7b07b	Fixing river error on empty folder.	2013-06-28 15:07:05 -07:00
Samuel Clay	a5b47c4513	Properly caching and using cached river story hashes.	2013-06-28 12:01:22 -07:00
Samuel Clay	07265badf1	Fixing massive river calls by taking data in and out of redis.	2013-06-27 17:53:47 -07:00
Samuel Clay	86acc97e17	Refactoring river. Something's off about Oldest first.	2013-06-27 17:21:01 -07:00
Samuel Clay	2df28e5095	Refactoring the living crap out of unread story hashes. Now supports ordering, filtering, and timestamps.	2013-06-27 16:23:29 -07:00
Samuel Clay	67b82a3a60	Converting lua script to multi/exec block.	2013-06-27 15:21:13 -07:00
Samuel Clay	14b5a9d2dd	Fixing bug in optimized feed river.	2013-06-25 16:08:45 -07:00
Samuel Clay	dd1d89586d	Fixing bug for last page of All Site Stories.	2013-06-25 15:51:04 -07:00
Samuel Clay	e62b058638	Major optimization to both single feed loads and river loads. Both are now checking training only for trained feeds, and river makes only a single subscirption call instead of N subscription calls.	2013-06-25 15:41:42 -07:00
Samuel Clay	7be08e15e6	Cutting out some logging.	2013-06-21 14:24:34 -07:00
Samuel Clay	83179de563	Refactoring unread counting for untrained subs. Much faster now that we don't have to fetch stories and read each one.	2013-06-21 14:15:13 -07:00
Samuel Clay	cceda612f6	Better logging for unread counts to see where counts are going moving.	2013-06-21 12:30:06 -07:00
Samuel Clay	b7e3f3c306	Adding a great progress bar and story fetch order.	2013-06-16 21:39:38 -07:00
Samuel Clay	f425a1602d	Scheduling stale feeds for flat feed users, too.	2013-06-15 12:48:35 -07:00
Samuel Clay	b8fa01125d	Fixing a typo around switching story hashes.	2013-06-04 18:10:20 -07:00
Samuel Clay	a2a427f8b4	Typo	2013-06-04 15:54:36 -07:00
Samuel Clay	3a7e72795f	Refactoring story_hash methods lower on the stack into MStory.	2013-06-04 15:34:03 -07:00
Samuel Clay	b50986388a	Adding ttls to redis stats sampler.	2013-06-03 15:50:03 -07:00
Samuel Clay	418d949b07	Switching hashes on read stories correctly (wtihout making a slow Redis keys() call).	2013-05-28 10:47:24 -07:00
Samuel Clay	ca5ef47e02	Marking feeds as read when there are no neutral or positive unreads. Dropping negatives.	2013-05-16 11:21:20 -07:00
Samuel Clay	9a6e9078c3	Switching to faster unread counting for socialsubs and usersubs.	2013-05-14 17:31:08 -07:00
Samuel Clay	707798948f	Final cleanup before deploying.	2013-05-13 15:11:18 -07:00