Commit graph

822 commits

Author SHA1 Message Date
Samuel Clay
7127962f5e Fixing fabfile. 2013-06-18 13:22:31 -07:00
Samuel Clay
9826a6499b Moving all pubsub to a dedicated redis box (called REDIS2). 2013-06-18 12:21:27 -07:00
Samuel Clay
3a7631c638 Boosting story ratio to 500 characters. Maybe even higher? 2013-06-17 14:38:15 -07:00
Samuel Clay
5f6b72a396 Fixing log on drained feeds. 2013-06-12 16:55:54 -07:00
Samuel Clay
f2a4b20d91 Adding some useful logging. 2013-06-12 14:36:02 -07:00
Samuel Clay
85120d3f99 Fixing Twitter sharing by upgrading to API v1.1. 2013-06-12 13:52:43 -07:00
Samuel Clay
3a7e72795f Refactoring story_hash methods lower on the stack into MStory. 2013-06-04 15:34:03 -07:00
Samuel Clay
d0e3958ed7 Forcing calculating for last_story_date for more accurate story deletion. 2013-06-04 11:49:33 -07:00
Samuel Clay
22864da4e4 Rewriting train old stories to work much, much faster without having the db sort feeds. 2013-06-04 11:26:01 -07:00
Samuel Clay
abf91eb778 Trimming 1000 feeds at a time. 2013-06-03 19:34:09 -07:00
Samuel Clay
6933af0f48 Trimming way more expired feeds. 2013-06-03 19:31:30 -07:00
Samuel Clay
09f326f1de Correcting trim stories offset for older feeds. 2013-06-03 18:01:29 -07:00
Samuel Clay
7b1b8f7544 Reducing the cutoff even further for older feeds. 2013-06-03 17:58:27 -07:00
Samuel Clay
36bca15464 Better logging for old story trimmer. 2013-06-03 17:48:11 -07:00
Samuel Clay
94f5b781bd Simplifying old story trimmer. 2013-06-03 17:36:57 -07:00
Samuel Clay
edcbde615d Adding a massive feed trimmer. Cuts feeds, those that have no active subs and haven't a new story for a month, down to 10 stories. 2013-06-03 17:20:36 -07:00
Samuel Clay
6186dd8aa5 One more read_preference switch. 2013-06-03 10:27:05 -07:00
Samuel Clay
bec457545c Fixing read preference on feed fetch history. 2013-06-03 10:20:23 -07:00
Samuel Clay
dc3abdc839 Undoing all idomatic read preferences. 2013-05-31 23:03:58 -07:00
Samuel Clay
3dd09e4c4b Switching read_preference to more idiomatic format. 2013-05-31 23:00:47 -07:00
Samuel Clay
f57d6d6016 Switching read_preference to more idiomatic format. 2013-05-31 22:59:27 -07:00
Samuel Clay
811eb77608 Switching read_preference to more idiomatic format. 2013-05-31 22:57:58 -07:00
Samuel Clay
6a51975293 Fixing fetch history caching. 2013-05-31 17:17:20 -07:00
Samuel Clay
04442aa890 Fixing three random exceptions in feed fetching. 2013-05-31 17:14:17 -07:00
Samuel Clay
084e61d989 Fixing first get_or_create issue with fetch histories. 2013-05-31 15:55:39 -07:00
Samuel Clay
ded52bf397 Returning object on save because mongoengine 0.8.1 no longer automatically returns the object on create. 2013-05-29 19:37:50 -07:00
Samuel Clay
e3f2677ee7 Upgrading mongoengine prep. 2013-05-29 18:00:09 -07:00
Samuel Clay
8de1d2d031 Handling dupe story share when de-duping stories. 2013-05-29 16:26:04 -07:00
Samuel Clay
6fa6a11af7 Battling Explosm and other broken feeds by only chekcing for story diffs of substantive content. 2013-05-29 16:22:31 -07:00
Samuel Clay
5dc1342e1c If a feed has an error, save up to 50 fetches before declaring inactive. Otherwise, only keep 5 good fetches. Thanks to @bdarnell for the suggestion. 2013-05-29 16:05:56 -07:00
Samuel Clay
802a080133 Fixing text view premium callout. Also adding more logging to fix explosm feed. 2013-05-29 15:31:41 -07:00
Samuel Clay
418d949b07 Switching hashes on read stories correctly (wtihout making a slow Redis keys() call). 2013-05-28 10:47:24 -07:00
Samuel Clay
36d042acd1 Adding story timestamp to all stories in the API, to complement localized story_date. 2013-05-26 16:32:48 -07:00
Samuel Clay
f1bfcaa1aa Little bit of future padding for new charts. 2013-05-20 17:29:28 -07:00
Samuel Clay
1e1433de06 Merge branch 'master' into circular
* master:
  Fixing fabfile.
  Fixing bug where dupe feed has no link.
2013-05-15 17:46:49 -07:00
Samuel Clay
f5eac30a5a Fixing bug where dupe feed has no link. 2013-05-15 17:21:10 -07:00
Samuel Clay
fd148e106f Merge branch 'master' into circular
* master:
  Temporarily commenting out story hash switching on read stories because of massive redis locking.
2013-05-15 17:13:11 -07:00
Samuel Clay
88d474d62b Temporarily commenting out story hash switching on read stories because of massive redis locking. 2013-05-15 17:13:06 -07:00
Samuel Clay
be3bc8d16b Merge branch 'master' into muserstory_remove
* master:
  Typo on duplicate feed saving truncation.
  Adding duplicate feed address+link truncation.
  Adding duplicate feed address+link truncation.
2013-05-15 16:06:26 -07:00
Samuel Clay
ede28f2373 Merge branch 'master' into circular
* master:
  Typo on duplicate feed saving truncation.
2013-05-15 15:43:10 -07:00
Samuel Clay
44b4559d0b Typo on duplicate feed saving truncation. 2013-05-15 15:43:07 -07:00
Samuel Clay
f21f8231bf Merge branch 'master' into circular
* master:
  Adding duplicate feed address+link truncation.
2013-05-15 15:41:43 -07:00
Samuel Clay
3a0cded0d9 Adding duplicate feed address+link truncation. 2013-05-15 15:41:39 -07:00
Samuel Clay
21ad2d400e Merge branch 'master' into circular
* master:
  Adding duplicate feed address+link truncation.
2013-05-15 15:40:43 -07:00
Samuel Clay
f6f053b285 Adding duplicate feed address+link truncation. 2013-05-15 15:40:38 -07:00
Samuel Clay
be33aba026 Merge branch 'muserstory_remove' into circular
* muserstory_remove:
  Removing story blurblog permalink, making it called explicitly.

Conflicts:
	apps/social/views.py
2013-05-14 16:38:28 -07:00
Samuel Clay
7068119208 Removing story blurblog permalink, making it called explicitly. 2013-05-14 16:36:03 -07:00
Samuel Clay
6ebaa81ea1 Merge branch 'muserstory_remove' into circular
* muserstory_remove:
  Adding node group to fabfile.
  Using popular instead of homepage user to suggest new users to follow.
  Cleaning up unused detritus. Ready to deploy.
  Final cleanup before deploying.
  Removing MUserStory entirely.
2013-05-14 16:11:44 -07:00
Samuel Clay
dd6e33ac33 Merge branch 'master' into circular
# By Samuel Clay (2) and ojiikun (2)
* master:
  Adding node group to fabfile.
  Fix crash on empty use pictures.
  Correcting for feedburner stupidity.
  Auto-sync the feed/folder list if it has been more than 10 minutes since the last refresh.
2013-05-14 16:01:34 -07:00
Samuel Clay
9a5a4f9562 Merge branch 'master' into muserstory_remove
# By Samuel Clay (1) and ojiikun (1)
* master:
  Correcting for feedburner stupidity.
  Auto-sync the feed/folder list if it has been more than 10 minutes since the last refresh.
2013-05-13 18:56:15 -07:00