Samuel Clay
7127962f5e
Fixing fabfile.
2013-06-18 13:22:31 -07:00
Samuel Clay
9826a6499b
Moving all pubsub to a dedicated redis box (called REDIS2).
2013-06-18 12:21:27 -07:00
Samuel Clay
3a7631c638
Boosting story ratio to 500 characters. Maybe even higher?
2013-06-17 14:38:15 -07:00
Samuel Clay
5f6b72a396
Fixing log on drained feeds.
2013-06-12 16:55:54 -07:00
Samuel Clay
f2a4b20d91
Adding some useful logging.
2013-06-12 14:36:02 -07:00
Samuel Clay
85120d3f99
Fixing Twitter sharing by upgrading to API v1.1.
2013-06-12 13:52:43 -07:00
Samuel Clay
3a7e72795f
Refactoring story_hash methods lower on the stack into MStory.
2013-06-04 15:34:03 -07:00
Samuel Clay
d0e3958ed7
Forcing calculating for last_story_date for more accurate story deletion.
2013-06-04 11:49:33 -07:00
Samuel Clay
22864da4e4
Rewriting train old stories to work much, much faster without having the db sort feeds.
2013-06-04 11:26:01 -07:00
Samuel Clay
abf91eb778
Trimming 1000 feeds at a time.
2013-06-03 19:34:09 -07:00
Samuel Clay
6933af0f48
Trimming way more expired feeds.
2013-06-03 19:31:30 -07:00
Samuel Clay
09f326f1de
Correcting trim stories offset for older feeds.
2013-06-03 18:01:29 -07:00
Samuel Clay
7b1b8f7544
Reducing the cutoff even further for older feeds.
2013-06-03 17:58:27 -07:00
Samuel Clay
36bca15464
Better logging for old story trimmer.
2013-06-03 17:48:11 -07:00
Samuel Clay
94f5b781bd
Simplifying old story trimmer.
2013-06-03 17:36:57 -07:00
Samuel Clay
edcbde615d
Adding a massive feed trimmer. Cuts feeds, those that have no active subs and haven't a new story for a month, down to 10 stories.
2013-06-03 17:20:36 -07:00
Samuel Clay
6186dd8aa5
One more read_preference switch.
2013-06-03 10:27:05 -07:00
Samuel Clay
bec457545c
Fixing read preference on feed fetch history.
2013-06-03 10:20:23 -07:00
Samuel Clay
dc3abdc839
Undoing all idomatic read preferences.
2013-05-31 23:03:58 -07:00
Samuel Clay
3dd09e4c4b
Switching read_preference to more idiomatic format.
2013-05-31 23:00:47 -07:00
Samuel Clay
f57d6d6016
Switching read_preference to more idiomatic format.
2013-05-31 22:59:27 -07:00
Samuel Clay
811eb77608
Switching read_preference to more idiomatic format.
2013-05-31 22:57:58 -07:00
Samuel Clay
6a51975293
Fixing fetch history caching.
2013-05-31 17:17:20 -07:00
Samuel Clay
04442aa890
Fixing three random exceptions in feed fetching.
2013-05-31 17:14:17 -07:00
Samuel Clay
084e61d989
Fixing first get_or_create issue with fetch histories.
2013-05-31 15:55:39 -07:00
Samuel Clay
ded52bf397
Returning object on save because mongoengine 0.8.1 no longer automatically returns the object on create.
2013-05-29 19:37:50 -07:00
Samuel Clay
e3f2677ee7
Upgrading mongoengine prep.
2013-05-29 18:00:09 -07:00
Samuel Clay
8de1d2d031
Handling dupe story share when de-duping stories.
2013-05-29 16:26:04 -07:00
Samuel Clay
6fa6a11af7
Battling Explosm and other broken feeds by only chekcing for story diffs of substantive content.
2013-05-29 16:22:31 -07:00
Samuel Clay
5dc1342e1c
If a feed has an error, save up to 50 fetches before declaring inactive. Otherwise, only keep 5 good fetches. Thanks to @bdarnell for the suggestion.
2013-05-29 16:05:56 -07:00
Samuel Clay
802a080133
Fixing text view premium callout. Also adding more logging to fix explosm feed.
2013-05-29 15:31:41 -07:00
Samuel Clay
418d949b07
Switching hashes on read stories correctly (wtihout making a slow Redis keys() call).
2013-05-28 10:47:24 -07:00
Samuel Clay
36d042acd1
Adding story timestamp to all stories in the API, to complement localized story_date.
2013-05-26 16:32:48 -07:00
Samuel Clay
f1bfcaa1aa
Little bit of future padding for new charts.
2013-05-20 17:29:28 -07:00
Samuel Clay
1e1433de06
Merge branch 'master' into circular
...
* master:
Fixing fabfile.
Fixing bug where dupe feed has no link.
2013-05-15 17:46:49 -07:00
Samuel Clay
f5eac30a5a
Fixing bug where dupe feed has no link.
2013-05-15 17:21:10 -07:00
Samuel Clay
fd148e106f
Merge branch 'master' into circular
...
* master:
Temporarily commenting out story hash switching on read stories because of massive redis locking.
2013-05-15 17:13:11 -07:00
Samuel Clay
88d474d62b
Temporarily commenting out story hash switching on read stories because of massive redis locking.
2013-05-15 17:13:06 -07:00
Samuel Clay
be3bc8d16b
Merge branch 'master' into muserstory_remove
...
* master:
Typo on duplicate feed saving truncation.
Adding duplicate feed address+link truncation.
Adding duplicate feed address+link truncation.
2013-05-15 16:06:26 -07:00
Samuel Clay
ede28f2373
Merge branch 'master' into circular
...
* master:
Typo on duplicate feed saving truncation.
2013-05-15 15:43:10 -07:00
Samuel Clay
44b4559d0b
Typo on duplicate feed saving truncation.
2013-05-15 15:43:07 -07:00
Samuel Clay
f21f8231bf
Merge branch 'master' into circular
...
* master:
Adding duplicate feed address+link truncation.
2013-05-15 15:41:43 -07:00
Samuel Clay
3a0cded0d9
Adding duplicate feed address+link truncation.
2013-05-15 15:41:39 -07:00
Samuel Clay
21ad2d400e
Merge branch 'master' into circular
...
* master:
Adding duplicate feed address+link truncation.
2013-05-15 15:40:43 -07:00
Samuel Clay
f6f053b285
Adding duplicate feed address+link truncation.
2013-05-15 15:40:38 -07:00
Samuel Clay
be33aba026
Merge branch 'muserstory_remove' into circular
...
* muserstory_remove:
Removing story blurblog permalink, making it called explicitly.
Conflicts:
apps/social/views.py
2013-05-14 16:38:28 -07:00
Samuel Clay
7068119208
Removing story blurblog permalink, making it called explicitly.
2013-05-14 16:36:03 -07:00
Samuel Clay
6ebaa81ea1
Merge branch 'muserstory_remove' into circular
...
* muserstory_remove:
Adding node group to fabfile.
Using popular instead of homepage user to suggest new users to follow.
Cleaning up unused detritus. Ready to deploy.
Final cleanup before deploying.
Removing MUserStory entirely.
2013-05-14 16:11:44 -07:00
Samuel Clay
dd6e33ac33
Merge branch 'master' into circular
...
# By Samuel Clay (2) and ojiikun (2)
* master:
Adding node group to fabfile.
Fix crash on empty use pictures.
Correcting for feedburner stupidity.
Auto-sync the feed/folder list if it has been more than 10 minutes since the last refresh.
2013-05-14 16:01:34 -07:00
Samuel Clay
9a5a4f9562
Merge branch 'master' into muserstory_remove
...
# By Samuel Clay (1) and ojiikun (1)
* master:
Correcting for feedburner stupidity.
Auto-sync the feed/folder list if it has been more than 10 minutes since the last refresh.
2013-05-13 18:56:15 -07:00