Commit graph

799 commits

Author SHA1 Message Date
Samuel Clay
730b37c671 Merge branch 'master' into circular
* master:
  Prioritizing autocomplete matches on title before address.
  Handling URLs in autocomplete.
  Adding new autocomplete. Let's hope this doesn't destroy performance in Redis.
  Using new Chrome extension for RSS.

Conflicts:
	apps/rss_feeds/views.py
2013-04-08 13:14:45 -07:00
Samuel Clay
83c8443ed0 Prioritizing autocomplete matches on title before address. 2013-04-08 13:12:11 -07:00
Samuel Clay
c25c4478e6 Adding new autocomplete. Let's hope this doesn't destroy performance in Redis. 2013-04-08 12:54:02 -07:00
Samuel Clay
0ec997f930 Merge branch 'master' into circular
* master:
  Using error_feeds to push broken feeds further out in the pipeline.
2013-04-08 10:51:00 -07:00
Samuel Clay
46f919f919 Using error_feeds to push broken feeds further out in the pipeline. 2013-04-08 10:50:50 -07:00
Samuel Clay
ff9bf4fad8 Merge branch 'master' into circular
* master:
  Skipping tasking of feeds when queue is too high. Use the random queue.
  Pushing out feed updates to cope with influx.
  Don't allow stories to come from more than 24 hours into the future.
  Removing force from new feeds.
  Adding in timing on feed cleanup.
  Increasing fetches for long tail feeds.
  Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories.
  Adding supervisord.conf config to include minfds (ulimit -a) support.

Conflicts:
	utils/feed_fetcher.py
2013-04-08 09:50:08 -07:00
Samuel Clay
d63556bc06 Skipping tasking of feeds when queue is too high. Use the random queue. 2013-04-08 09:49:21 -07:00
Samuel Clay
00591ee7ad Pushing out feed updates to cope with influx. 2013-04-08 08:34:12 -07:00
Samuel Clay
5c0b9de511 Increasing fetches for long tail feeds. 2013-04-07 17:31:43 -07:00
Samuel Clay
1175b306cd Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:20:17 -07:00
Samuel Clay
48c5d4d53e Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:19:59 -07:00
Samuel Clay
35158e7a8b Merge branch 'master' into circular
* master:
  Upping Android to version 1.2.
  Bumping up feed fetching for premiums.
  Refunding stripe payments.
  ActionBar is part of the repo now (vendorized).
  Make initial sync on creation of Main activity folllow recommended two-step API pattern.
  Fix feed parsing issue when user has no feeds
  Fix crash when new user registers. For some unknown reason the code was doing a feed pull and then always expecting folders when there obviously wouldn't be any if the user just registered.
  When login fails go back to login activity rather than previous view
  Handle new user registration error reply by informing user of issue with regiration attempt

Conflicts:
	apps/profile/models.py
2013-04-05 19:05:45 -07:00
Samuel Clay
d238dafba7 Bumping up feed fetching for premiums. 2013-04-05 17:59:33 -07:00
Samuel Clay
f2c65fc096 Merge branch 'master' into circular
* master:
  ActionBar is part of the repo now (vendorized).
  Better verbose logging for updating feeds.
  Checking if feed id has changed, then removing from task queue.
  Fixed the ridiculous bug with feed queuing: while checking to see if the feed id changed, self.pk changed along with the feed, resulting in the cached value changing!
  Better logging for queues.
2013-04-05 16:50:43 -07:00
Samuel Clay
9c79076aab Better verbose logging for updating feeds. 2013-04-05 12:09:42 -07:00
Samuel Clay
1ba468d27d Checking if feed id has changed, then removing from task queue. 2013-04-04 21:57:58 -07:00
Samuel Clay
d831088a46 Fixed the ridiculous bug with feed queuing: while checking to see if the feed id changed, self.pk changed along with the feed, resulting in the cached value changing! 2013-04-04 20:51:56 -07:00
Samuel Clay
341db243c3 Better logging for queues. 2013-04-04 20:47:41 -07:00
Samuel Clay
6ca3320c44 Merge branch 'master' into circular
# By ojiikun (8) and others
# Via Samuel Clay (3) and ojiikun (1)
* master:
  Handling 0 images found for shared story.
  Fixing broken JPG image sizer.
  Handling timeouts for feed link change.
  Fixing a few small feed collision errors.
  Adding feedparser trunk, in case I want more pain.
  Fixing feed address change by feed link when colliding with existing feed.
  Fixing feed address change by feed link when colliding with existing feed.
  Revert change that disabled user images for shared/commented on a story and liked comments
  Undoing whitespace changes in APIManager.
  Undo whitespace changes in APIClient.
  Fully remove redundant sync during login.
  Remove extra debug.  Add full API logging.
  Cleanup comment views.
  Prevent force close in SetupCommentSectionTask if there is no data in the reply user cursor.
  Added .gitignore so ant files aren't accidentally comiitted.
  Clarify shell HOWTO instructions.
  Added shell build HOWTO.
  Remove extra sync in login frag. Disable favicos. Better Debug.
2013-04-04 17:54:42 -07:00
Samuel Clay
681968033b Fixing broken JPG image sizer. 2013-04-04 17:49:38 -07:00
Samuel Clay
ee647be85b Handling timeouts for feed link change. 2013-04-04 17:27:31 -07:00
Samuel Clay
2645eff5ad Fixing a few small feed collision errors. 2013-04-04 17:22:52 -07:00
Samuel Clay
cf4bebcd83 Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:22:52 -07:00
Samuel Clay
179338135e Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:22:52 -07:00
Samuel Clay
3d190cc3ec Fixing a few small feed collision errors. 2013-04-04 17:18:27 -07:00
Samuel Clay
e7ad04946d Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:13:06 -07:00
Samuel Clay
8a7ea248fd Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:09:16 -07:00
Samuel Clay
7b2855327f Adding logging. 2013-04-03 22:51:22 -07:00
Samuel Clay
e56fd22b01 Tossing deleted feeds from queue. 2013-04-03 22:51:21 -07:00
Samuel Clay
7fa1b49538 Tossing deleted feeds from queue. 2013-04-03 22:51:21 -07:00
Samuel Clay
95f97a4718 Adding logging. 2013-04-03 22:51:03 -07:00
Samuel Clay
400cad89e6 Tossing deleted feeds from queue. 2013-04-03 21:11:40 -07:00
Samuel Clay
3627221968 Tossing deleted feeds from queue. 2013-04-03 21:10:37 -07:00
Samuel Clay
c3548105f9 Merge branch 'master' into circular
* master:
  Cleaning up counts in munin and work log.
  What the f? strip_comments now eats CPU on bad stories. But why now and not a few months ago when I introduced it?
  Adding timeout to strip comments.
  Using proper hostname for task server. Adding verbosity to feed fetching.
2013-04-03 19:04:52 -07:00
Samuel Clay
4651906f08 What the f? strip_comments now eats CPU on bad stories. But why now and not a few months ago when I introduced it? 2013-04-03 18:20:42 -07:00
Samuel Clay
7a41b6a949 Using proper hostname for task server. Adding verbosity to feed fetching. 2013-04-03 18:11:23 -07:00
Samuel Clay
20698e9bc5 Merge branch 'master' into circular
* master:
  Adding tasked_feeds set to handle dropped feeds.
  Fixing missing feed bug.
  Adding new task server role: only new and push feeds.
  Fixing munin counts.
2013-04-03 17:26:10 -07:00
Samuel Clay
8f8c88ca47 Adding tasked_feeds set to handle dropped feeds. 2013-04-03 17:22:45 -07:00
Samuel Clay
c42689a99e Merge branch 'master' into circular
* master:
  Cleaning up queue migration.
  Handling decayed feeds with no more active subscribers. They don't get returned to the scheduled_updates queue until there are enough active users.
  Only need next scheduled update.
  Fixing feeds that fall through.
  Moving task queue from postgres db backed to redis backed.
2013-04-03 16:08:29 -07:00
Samuel Clay
842afe7068 Handling decayed feeds with no more active subscribers. They don't get returned to the scheduled_updates queue until there are enough active users. 2013-04-01 15:45:22 -07:00
Samuel Clay
61dde968b8 Merge branch 'master' into circular
# By Samuel Clay (12) and Lance Johnson (1)
* master:
  Updating postgres config, celery queue.
  Boosting feed fetching.
  Android: show server error message to user when add feed fails. The error message was being sent when non-premium users tried to search for feeds and was causing the App to crash.
  Removing unused feed hash index (keeping the unique constraint).
  Adding two indexes and killing one unused one from feeds.
  Returning index on active subs.
  Changing logging on feed queueing.
  Turning off autocomplete for the time being.
  Removing unused indexes.
  Upgrade to postgres 9.2.
  Culling some graphs on feed counts.
  Cleaning up week old feeds.
  Boosting feed fetching way up for the weekend.
2013-03-30 19:05:20 -07:00
Samuel Clay
ba5919d760 Moving task queue from postgres db backed to redis backed. 2013-03-30 19:05:13 -07:00
Samuel Clay
2cc5ab6202 Boosting feed fetching. 2013-03-30 11:39:49 -07:00
Samuel Clay
03c27b42e8 Removing unused feed hash index (keeping the unique constraint). 2013-03-29 22:41:16 -07:00
Samuel Clay
33bd64f2a0 Adding two indexes and killing one unused one from feeds. 2013-03-29 22:11:36 -07:00
Samuel Clay
93794aef36 Returning index on active subs. 2013-03-29 21:48:38 -07:00
Samuel Clay
22b2bd0604 Changing logging on feed queueing. 2013-03-29 21:46:04 -07:00
Samuel Clay
a47fa4db0f Removing unused indexes. 2013-03-29 20:24:06 -07:00
Samuel Clay
07ebbd63b5 Boosting feed fetching way up for the weekend. 2013-03-29 15:56:43 -07:00
Samuel Clay
0f53acdf6d Merge branch 'master' into circular
* master:
  Fixing stripe reimport
  Upping feed fetching by quite a bit.
  Fixing double counting stripe payment bug by clearing out striep purchase history when inserting.
2013-03-29 14:27:04 -07:00