1091 commits

Author	SHA1	Message	Date
Samuel Clay	23214e5996	Cleaning up starred story trimmer.	2013-07-11 12:24:48 -07:00
Samuel Clay	50c8d458eb	New starred story trimmer.	2013-07-11 12:08:21 -07:00
Samuel Clay	5f7ae25fc4	Normaling user agents between feed/page/icon fetchers. Adding full site permalink.	2013-07-10 14:14:55 -07:00
Samuel Clay	6751ff890e	Fixing autocomplete to only update input value on select, not focus.	2013-07-05 18:50:57 -07:00
Samuel Clay	1ea9f330e3	Upping story difference length.	2013-07-05 17:49:06 -07:00
Samuel Clay	63bbfc8f63	Removing Reader import, adding categories.	2013-07-03 22:16:01 -07:00
Phoenixsong	e25dc1bb8c	Fixing months_since_last_story logic ... Conversion from seconds to months should be division, not multiplication	2013-07-02 10:36:16 -04:00
Samuel Clay	7e27a24b88	Also expiring feeds on new stories.	2013-07-01 22:19:22 -07:00
Samuel Clay	2917d0b4cf	Adding new redis3 host for dupe story read status and feed story status. Now with expiring read stories (that need an expunger, still).	2013-07-01 21:59:09 -07:00
Samuel Clay	e6da8d034d	Showing loading bar in all views. Also being more aggressive in finding urls when adding.	2013-06-30 17:00:31 -07:00
Samuel Clay	31592710a9	Fixing fetch history bug. Ugggg, a week of fetch history lost. No big deal. Also dropping unused fetch exception history collection. Sentry handles this quite well.	2013-06-28 20:51:31 -07:00
Samuel Clay	ed7b5f1dac	Handling validation for image urls.	2013-06-26 16:26:14 -07:00
Samuel Clay	91cc5e58cf	image_url -> image_urls	2013-06-26 11:38:49 -07:00
Samuel Clay	cceda612f6	Better logging for unread counts to see where counts are going moving.	2013-06-21 12:30:06 -07:00
Samuel Clay	aeefbb645b	Fixing signle story mode.	2013-06-20 14:45:05 -07:00
Samuel Clay	97633614f8	Fixing a few bugs in image url extraction.	2013-06-20 13:46:11 -07:00
Samuel Clay	bff60f4903	Fixing a few bugs in image url extraction.	2013-06-20 13:44:10 -07:00
Samuel Clay	db7afc8abe	Adding image url extraction to the API for all stories.	2013-06-20 13:41:37 -07:00
Samuel Clay	bb0a0b612e	Clearing up logic on find_story.	2013-06-19 13:22:11 -07:00
Samuel Clay	7127962f5e	Fixing fabfile.	2013-06-18 13:22:31 -07:00
Samuel Clay	9826a6499b	Moving all pubsub to a dedicated redis box (called REDIS2).	2013-06-18 12:21:27 -07:00
Samuel Clay	3a7631c638	Boosting story ratio to 500 characters. Maybe even higher?	2013-06-17 14:38:15 -07:00
Samuel Clay	5f6b72a396	Fixing log on drained feeds.	2013-06-12 16:55:54 -07:00
Samuel Clay	f2a4b20d91	Adding some useful logging.	2013-06-12 14:36:02 -07:00
Samuel Clay	85120d3f99	Fixing Twitter sharing by upgrading to API v1.1.	2013-06-12 13:52:43 -07:00
Samuel Clay	3a7e72795f	Refactoring story_hash methods lower on the stack into MStory.	2013-06-04 15:34:03 -07:00
Samuel Clay	d0e3958ed7	Forcing calculating for last_story_date for more accurate story deletion.	2013-06-04 11:49:33 -07:00
Samuel Clay	22864da4e4	Rewriting train old stories to work much, much faster without having the db sort feeds.	2013-06-04 11:26:01 -07:00
Samuel Clay	abf91eb778	Trimming 1000 feeds at a time.	2013-06-03 19:34:09 -07:00
Samuel Clay	6933af0f48	Trimming way more expired feeds.	2013-06-03 19:31:30 -07:00
Samuel Clay	09f326f1de	Correcting trim stories offset for older feeds.	2013-06-03 18:01:29 -07:00
Samuel Clay	7b1b8f7544	Reducing the cutoff even further for older feeds.	2013-06-03 17:58:27 -07:00
Samuel Clay	36bca15464	Better logging for old story trimmer.	2013-06-03 17:48:11 -07:00
Samuel Clay	94f5b781bd	Simplifying old story trimmer.	2013-06-03 17:36:57 -07:00
Samuel Clay	edcbde615d	Adding a massive feed trimmer. Cuts feeds, those that have no active subs and haven't a new story for a month, down to 10 stories.	2013-06-03 17:20:36 -07:00
Samuel Clay	6186dd8aa5	One more read_preference switch.	2013-06-03 10:27:05 -07:00
Samuel Clay	bec457545c	Fixing read preference on feed fetch history.	2013-06-03 10:20:23 -07:00
Samuel Clay	dc3abdc839	Undoing all idomatic read preferences.	2013-05-31 23:03:58 -07:00
Samuel Clay	3dd09e4c4b	Switching read_preference to more idiomatic format.	2013-05-31 23:00:47 -07:00
Samuel Clay	f57d6d6016	Switching read_preference to more idiomatic format.	2013-05-31 22:59:27 -07:00
Samuel Clay	811eb77608	Switching read_preference to more idiomatic format.	2013-05-31 22:57:58 -07:00
Samuel Clay	6a51975293	Fixing fetch history caching.	2013-05-31 17:17:20 -07:00
Samuel Clay	04442aa890	Fixing three random exceptions in feed fetching.	2013-05-31 17:14:17 -07:00
Samuel Clay	084e61d989	Fixing first get_or_create issue with fetch histories.	2013-05-31 15:55:39 -07:00
Samuel Clay	ded52bf397	Returning object on save because mongoengine 0.8.1 no longer automatically returns the object on create.	2013-05-29 19:37:50 -07:00
Samuel Clay	e3f2677ee7	Upgrading mongoengine prep.	2013-05-29 18:00:09 -07:00
Samuel Clay	8de1d2d031	Handling dupe story share when de-duping stories.	2013-05-29 16:26:04 -07:00
Samuel Clay	6fa6a11af7	Battling Explosm and other broken feeds by only chekcing for story diffs of substantive content.	2013-05-29 16:22:31 -07:00
Samuel Clay	5dc1342e1c	If a feed has an error, save up to 50 fetches before declaring inactive. Otherwise, only keep 5 good fetches. Thanks to @bdarnell for the suggestion.	2013-05-29 16:05:56 -07:00
Samuel Clay	802a080133	Fixing text view premium callout. Also adding more logging to fix explosm feed.	2013-05-29 15:31:41 -07:00