Commit graph

852 commits

Author SHA1 Message Date
Samuel Clay
aab1f39df1 Turning off redis dupe story id writer. 2013-08-14 14:32:50 -07:00
Samuel Clay
3df44f8c39 Adding count of trimmed stories. 2013-08-12 16:48:16 -07:00
Samuel Clay
687c044b10 Adding folder search for admin only. If you're reading this commit message, don't get excited. I probably won't be launching folder search using this method. It'll be a while before I can ship it. But if for some strange reason folder search is much faster than I thought, this has a chance. 2013-08-07 15:43:25 -07:00
Samuel Clay
2394e31f89 Moving feed parsing hotspot to specific seq ratio check. 2013-08-06 13:54:06 -07:00
Samuel Clay
88f2a69a93 Fixing a dozen text and feed fetching bugs. 2013-08-06 13:18:55 -07:00
Samuel Clay
acff62b8f6 Moving feed trim to higher counts unless the feed doesn't publish very often. 2013-08-05 10:56:24 -07:00
Samuel Clay
fb710c870f Beginning of a long 16-day migration of feed's redis story ids into 30 day retention from 14 day retention. Once this migration is complete, can up the DAYS_OF_UNREAD to 30 day with no issues, except for updating scores. 2013-08-02 15:59:03 -07:00
Samuel Clay
2043829a05 Adding tag search. 2013-07-30 12:01:45 -07:00
Samuel Clay
889be221d5 Fixing broken original pages by auto-fixing the has_page field on successful page fetch. Thanks to The Verge for uncovering this one. 2013-07-23 10:43:28 -07:00
Samuel Clay
679195aadd Adding necessary exception handling to text view. 2013-07-15 11:06:56 -07:00
Samuel Clay
e52adf8989 Showing empty explainers. 2013-07-11 15:09:00 -07:00
Samuel Clay
23214e5996 Cleaning up starred story trimmer. 2013-07-11 12:24:48 -07:00
Samuel Clay
50c8d458eb New starred story trimmer. 2013-07-11 12:08:21 -07:00
Samuel Clay
5f7ae25fc4 Normaling user agents between feed/page/icon fetchers. Adding full site permalink. 2013-07-10 14:14:55 -07:00
Samuel Clay
6751ff890e Fixing autocomplete to only update input value on select, not focus. 2013-07-05 18:50:57 -07:00
Samuel Clay
1ea9f330e3 Upping story difference length. 2013-07-05 17:49:06 -07:00
Samuel Clay
63bbfc8f63 Removing Reader import, adding categories. 2013-07-03 22:16:01 -07:00
Phoenixsong
e25dc1bb8c Fixing months_since_last_story logic
Conversion from seconds to months should be division, not multiplication
2013-07-02 10:36:16 -04:00
Samuel Clay
7e27a24b88 Also expiring feeds on new stories. 2013-07-01 22:19:22 -07:00
Samuel Clay
2917d0b4cf Adding new redis3 host for dupe story read status and feed story status. Now with expiring read stories (that need an expunger, still). 2013-07-01 21:59:09 -07:00
Samuel Clay
e6da8d034d Showing loading bar in all views. Also being more aggressive in finding urls when adding. 2013-06-30 17:00:31 -07:00
Samuel Clay
31592710a9 Fixing fetch history bug. Ugggg, a week of fetch history lost. No big deal. Also dropping unused fetch exception history collection. Sentry handles this quite well. 2013-06-28 20:51:31 -07:00
Samuel Clay
ed7b5f1dac Handling validation for image urls. 2013-06-26 16:26:14 -07:00
Samuel Clay
91cc5e58cf image_url -> image_urls 2013-06-26 11:38:49 -07:00
Samuel Clay
cceda612f6 Better logging for unread counts to see where counts are going moving. 2013-06-21 12:30:06 -07:00
Samuel Clay
aeefbb645b Fixing signle story mode. 2013-06-20 14:45:05 -07:00
Samuel Clay
97633614f8 Fixing a few bugs in image url extraction. 2013-06-20 13:46:11 -07:00
Samuel Clay
bff60f4903 Fixing a few bugs in image url extraction. 2013-06-20 13:44:10 -07:00
Samuel Clay
db7afc8abe Adding image url extraction to the API for all stories. 2013-06-20 13:41:37 -07:00
Samuel Clay
bb0a0b612e Clearing up logic on find_story. 2013-06-19 13:22:11 -07:00
Samuel Clay
7127962f5e Fixing fabfile. 2013-06-18 13:22:31 -07:00
Samuel Clay
9826a6499b Moving all pubsub to a dedicated redis box (called REDIS2). 2013-06-18 12:21:27 -07:00
Samuel Clay
3a7631c638 Boosting story ratio to 500 characters. Maybe even higher? 2013-06-17 14:38:15 -07:00
Samuel Clay
5f6b72a396 Fixing log on drained feeds. 2013-06-12 16:55:54 -07:00
Samuel Clay
f2a4b20d91 Adding some useful logging. 2013-06-12 14:36:02 -07:00
Samuel Clay
85120d3f99 Fixing Twitter sharing by upgrading to API v1.1. 2013-06-12 13:52:43 -07:00
Samuel Clay
3a7e72795f Refactoring story_hash methods lower on the stack into MStory. 2013-06-04 15:34:03 -07:00
Samuel Clay
d0e3958ed7 Forcing calculating for last_story_date for more accurate story deletion. 2013-06-04 11:49:33 -07:00
Samuel Clay
22864da4e4 Rewriting train old stories to work much, much faster without having the db sort feeds. 2013-06-04 11:26:01 -07:00
Samuel Clay
abf91eb778 Trimming 1000 feeds at a time. 2013-06-03 19:34:09 -07:00
Samuel Clay
6933af0f48 Trimming way more expired feeds. 2013-06-03 19:31:30 -07:00
Samuel Clay
09f326f1de Correcting trim stories offset for older feeds. 2013-06-03 18:01:29 -07:00
Samuel Clay
7b1b8f7544 Reducing the cutoff even further for older feeds. 2013-06-03 17:58:27 -07:00
Samuel Clay
36bca15464 Better logging for old story trimmer. 2013-06-03 17:48:11 -07:00
Samuel Clay
94f5b781bd Simplifying old story trimmer. 2013-06-03 17:36:57 -07:00
Samuel Clay
edcbde615d Adding a massive feed trimmer. Cuts feeds, those that have no active subs and haven't a new story for a month, down to 10 stories. 2013-06-03 17:20:36 -07:00
Samuel Clay
6186dd8aa5 One more read_preference switch. 2013-06-03 10:27:05 -07:00
Samuel Clay
bec457545c Fixing read preference on feed fetch history. 2013-06-03 10:20:23 -07:00
Samuel Clay
dc3abdc839 Undoing all idomatic read preferences. 2013-05-31 23:03:58 -07:00
Samuel Clay
3dd09e4c4b Switching read_preference to more idiomatic format. 2013-05-31 23:00:47 -07:00