Commit graph

973 commits

Author SHA1 Message Date
Samuel Clay
45e137b22c Upping feed fetches. 2013-04-15 19:26:41 -07:00
Samuel Clay
f6b5262c4f Merge branch 'master' into circular
* master:
  Fixing small bug around missing feeds during update pipeline.
  Fixing race condition between primary adn secondaries when creating feed fetch histories.
  Reversing order for fetch histories.
  Moving from feed/page/push histories to capped fetch history.

Conflicts:
	apps/rss_feeds/views.py
2013-04-15 15:17:29 -07:00
Samuel Clay
2ccd7b6cfe Fixing race condition between primary adn secondaries when creating feed fetch histories. 2013-04-15 15:09:04 -07:00
Samuel Clay
abbc05660f Reversing order for fetch histories. 2013-04-15 14:38:43 -07:00
Samuel Clay
6011e4f2da Moving from feed/page/push histories to capped fetch history. 2013-04-15 14:30:31 -07:00
Samuel Clay
8c55fe2491 Merge branch 'master' into circular
* master:
  Beginning big redis migration from story objectid to story guid hash.
2013-04-13 22:31:15 -07:00
Samuel Clay
1b482a78c6 Beginning big redis migration from story objectid to story guid hash. 2013-04-13 22:31:05 -07:00
Samuel Clay
e9f7fdd4cc Merge branch 'master' into circular
* master:
  Dumb, dumb bug causing division by zero errors because the autocomplete boost was 0.
  Upping feed fetches.
2013-04-13 19:44:48 -07:00
Samuel Clay
13616665c1 Dumb, dumb bug causing division by zero errors because the autocomplete boost was 0. 2013-04-13 19:44:43 -07:00
Samuel Clay
3eaad16adf Upping feed fetches. 2013-04-12 17:41:18 -07:00
Samuel Clay
74d39a4de1 Merge branch 'master' into circular
* master:
  Further pushing up feed fetches. Let the good times roll.
2013-04-11 16:57:16 -07:00
Samuel Clay
bd2ad514ea Further pushing up feed fetches. Let the good times roll. 2013-04-11 16:57:10 -07:00
Samuel Clay
3c84e79ec6 Merge branch 'master' into circular
* master:
  Upping feed fetching (4->3, still need 3->2 and 2->1) before I crank it.
2013-04-11 13:41:54 -07:00
Samuel Clay
4ee659a1a4 Upping feed fetching (4->3, still need 3->2 and 2->1) before I crank it. 2013-04-11 13:41:44 -07:00
Samuel Clay
54a8366813 Merge branch 'master' into circular
* master:
  Adding support for automatically converting google alerts.
2013-04-10 19:15:01 -07:00
Samuel Clay
ccb6d38fa3 Adding support for automatically converting google alerts. 2013-04-10 19:14:19 -07:00
Samuel Clay
ce29e7688d Merge branch 'master' into circular
* master:
  Rejiggering autocomplete to only include > 10 subs.
  Have RegisterProgressFragment finished via noHistory Manifest option rather than hackish finish with Fragment. Improve comments
  Fix registration regression bug caused by #151
  Fix for #159 force close during add feed (auto complete) now that is is enabled again
  Remove log call from DeleteFeedFragment
  Fix #140. Delete feed now works and confirmation dialog has been added.
  Fix issue where selection within stories was hidden
2013-04-10 11:28:43 -07:00
Samuel Clay
20c089175b Rejiggering autocomplete to only include > 10 subs. 2013-04-10 11:23:03 -07:00
Samuel Clay
eddcf1eddb Merge branch 'master' into circular
* master:
  Using regular expressions for comment stripping, unless the feed has an error count, in which case switch to lxml.
2013-04-08 16:15:29 -07:00
Samuel Clay
47c2257ef7 Using regular expressions for comment stripping, unless the feed has an error count, in which case switch to lxml. 2013-04-08 16:14:48 -07:00
Samuel Clay
404969ad6a Merge branch 'master' into circular
* master:
  Switch to lxml for comment stripping.
2013-04-08 15:45:01 -07:00
Samuel Clay
33e605875e Switch to lxml for comment stripping. 2013-04-08 15:38:23 -07:00
Samuel Clay
b29fd7c8c1 Merge branch 'master' into circular
* master:
  Moving to 1 feed per task queue (from 12).
2013-04-08 14:39:15 -07:00
Samuel Clay
9565c27784 Moving to 1 feed per task queue (from 12). 2013-04-08 14:39:00 -07:00
Samuel Clay
730b37c671 Merge branch 'master' into circular
* master:
  Prioritizing autocomplete matches on title before address.
  Handling URLs in autocomplete.
  Adding new autocomplete. Let's hope this doesn't destroy performance in Redis.
  Using new Chrome extension for RSS.

Conflicts:
	apps/rss_feeds/views.py
2013-04-08 13:14:45 -07:00
Samuel Clay
83c8443ed0 Prioritizing autocomplete matches on title before address. 2013-04-08 13:12:11 -07:00
Samuel Clay
c25c4478e6 Adding new autocomplete. Let's hope this doesn't destroy performance in Redis. 2013-04-08 12:54:02 -07:00
Samuel Clay
0ec997f930 Merge branch 'master' into circular
* master:
  Using error_feeds to push broken feeds further out in the pipeline.
2013-04-08 10:51:00 -07:00
Samuel Clay
46f919f919 Using error_feeds to push broken feeds further out in the pipeline. 2013-04-08 10:50:50 -07:00
Samuel Clay
ff9bf4fad8 Merge branch 'master' into circular
* master:
  Skipping tasking of feeds when queue is too high. Use the random queue.
  Pushing out feed updates to cope with influx.
  Don't allow stories to come from more than 24 hours into the future.
  Removing force from new feeds.
  Adding in timing on feed cleanup.
  Increasing fetches for long tail feeds.
  Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories.
  Adding supervisord.conf config to include minfds (ulimit -a) support.

Conflicts:
	utils/feed_fetcher.py
2013-04-08 09:50:08 -07:00
Samuel Clay
d63556bc06 Skipping tasking of feeds when queue is too high. Use the random queue. 2013-04-08 09:49:21 -07:00
Samuel Clay
00591ee7ad Pushing out feed updates to cope with influx. 2013-04-08 08:34:12 -07:00
Samuel Clay
5c0b9de511 Increasing fetches for long tail feeds. 2013-04-07 17:31:43 -07:00
Samuel Clay
1175b306cd Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:20:17 -07:00
Samuel Clay
48c5d4d53e Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:19:59 -07:00
Samuel Clay
35158e7a8b Merge branch 'master' into circular
* master:
  Upping Android to version 1.2.
  Bumping up feed fetching for premiums.
  Refunding stripe payments.
  ActionBar is part of the repo now (vendorized).
  Make initial sync on creation of Main activity folllow recommended two-step API pattern.
  Fix feed parsing issue when user has no feeds
  Fix crash when new user registers. For some unknown reason the code was doing a feed pull and then always expecting folders when there obviously wouldn't be any if the user just registered.
  When login fails go back to login activity rather than previous view
  Handle new user registration error reply by informing user of issue with regiration attempt

Conflicts:
	apps/profile/models.py
2013-04-05 19:05:45 -07:00
Samuel Clay
d238dafba7 Bumping up feed fetching for premiums. 2013-04-05 17:59:33 -07:00
Samuel Clay
f2c65fc096 Merge branch 'master' into circular
* master:
  ActionBar is part of the repo now (vendorized).
  Better verbose logging for updating feeds.
  Checking if feed id has changed, then removing from task queue.
  Fixed the ridiculous bug with feed queuing: while checking to see if the feed id changed, self.pk changed along with the feed, resulting in the cached value changing!
  Better logging for queues.
2013-04-05 16:50:43 -07:00
Samuel Clay
9c79076aab Better verbose logging for updating feeds. 2013-04-05 12:09:42 -07:00
Samuel Clay
1ba468d27d Checking if feed id has changed, then removing from task queue. 2013-04-04 21:57:58 -07:00
Samuel Clay
d831088a46 Fixed the ridiculous bug with feed queuing: while checking to see if the feed id changed, self.pk changed along with the feed, resulting in the cached value changing! 2013-04-04 20:51:56 -07:00
Samuel Clay
341db243c3 Better logging for queues. 2013-04-04 20:47:41 -07:00
Samuel Clay
6ca3320c44 Merge branch 'master' into circular
# By ojiikun (8) and others
# Via Samuel Clay (3) and ojiikun (1)
* master:
  Handling 0 images found for shared story.
  Fixing broken JPG image sizer.
  Handling timeouts for feed link change.
  Fixing a few small feed collision errors.
  Adding feedparser trunk, in case I want more pain.
  Fixing feed address change by feed link when colliding with existing feed.
  Fixing feed address change by feed link when colliding with existing feed.
  Revert change that disabled user images for shared/commented on a story and liked comments
  Undoing whitespace changes in APIManager.
  Undo whitespace changes in APIClient.
  Fully remove redundant sync during login.
  Remove extra debug.  Add full API logging.
  Cleanup comment views.
  Prevent force close in SetupCommentSectionTask if there is no data in the reply user cursor.
  Added .gitignore so ant files aren't accidentally comiitted.
  Clarify shell HOWTO instructions.
  Added shell build HOWTO.
  Remove extra sync in login frag. Disable favicos. Better Debug.
2013-04-04 17:54:42 -07:00
Samuel Clay
681968033b Fixing broken JPG image sizer. 2013-04-04 17:49:38 -07:00
Samuel Clay
ee647be85b Handling timeouts for feed link change. 2013-04-04 17:27:31 -07:00
Samuel Clay
2645eff5ad Fixing a few small feed collision errors. 2013-04-04 17:22:52 -07:00
Samuel Clay
cf4bebcd83 Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:22:52 -07:00
Samuel Clay
179338135e Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:22:52 -07:00
Samuel Clay
3d190cc3ec Fixing a few small feed collision errors. 2013-04-04 17:18:27 -07:00
Samuel Clay
e7ad04946d Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:13:06 -07:00