Commit graph

913 commits

Author SHA1 Message Date
Samuel Clay
23a7aa84d7 Merge branch 'master' into circular
* master:
  Using story cache when calculating unreads, for those who need unread counts updating.
2013-05-03 13:17:07 -07:00
Samuel Clay
550a33d9ab Using story cache when calculating unreads, for those who need unread counts updating. 2013-05-03 09:43:21 -07:00
Samuel Clay
97041dece7 Merge branch 'master' into circular
* master:
  Fixing story hash migration to run by user.
  Adding story_hash to starred stories, user stories, and shared stories.
  Adding redis backup script.
2013-04-29 18:00:55 -07:00
Samuel Clay
4d014033b6 Adding redis backup script. 2013-04-29 14:06:42 -07:00
Samuel Clay
42b85d485a Merge branch 'schedule' into schedule_dev
* schedule:
  Adding metric for last story date, used to calculate next scheduled update.
2013-04-23 17:04:27 -07:00
Samuel Clay
1584208677 Adding metric for last story date, used to calculate next scheduled update. 2013-04-23 17:04:21 -07:00
Samuel Clay
629fb2fd52 Merge branch 'master' into circular
* master:
  Adding logging to mongo backup.
2013-04-20 15:06:36 -07:00
Samuel Clay
408fb99802 Adding logging to mongo backup. 2013-04-20 15:06:32 -07:00
Samuel Clay
c8907bbab4 Re-designed footer. Adding footer to homepage. 2013-04-18 13:49:30 -07:00
Samuel Clay
976a5f15d1 Merge branch 'master' into circular
* master:
  Upping feed fetches.
  Adding meta refresh to maintenance page.
  Adding work to fabfile. Changing deploy to deploy_code.
2013-04-15 19:26:45 -07:00
Samuel Clay
84bcb54ff2 Adding work to fabfile. Changing deploy to deploy_code. 2013-04-15 18:32:13 -07:00
Samuel Clay
41f9257d7f Merge branch 'master' into circular
* master:
  Refactoring real-time socketio clientside to fix multiple client updates.
  Unread counts only for logged in users.

Conflicts:
	media/js/newsblur/reader/reader.js
2013-04-15 18:00:00 -07:00
Samuel Clay
76cbbd8d8b Refactoring real-time socketio clientside to fix multiple client updates. 2013-04-15 17:59:06 -07:00
Samuel Clay
f6b5262c4f Merge branch 'master' into circular
* master:
  Fixing small bug around missing feeds during update pipeline.
  Fixing race condition between primary adn secondaries when creating feed fetch histories.
  Reversing order for fetch histories.
  Moving from feed/page/push histories to capped fetch history.

Conflicts:
	apps/rss_feeds/views.py
2013-04-15 15:17:29 -07:00
Samuel Clay
6011e4f2da Moving from feed/page/push histories to capped fetch history. 2013-04-15 14:30:31 -07:00
Samuel Clay
cdb936ddd0 Merge branch 'master' into circular
* master:
  Switching feed fetch counts from mongo to redis.
  Versioning postgres backup script.
  Versioning postgres backup script.
2013-04-15 12:09:46 -07:00
Samuel Clay
eb08ef5569 Versioning postgres backup script. 2013-04-14 21:07:49 -07:00
Samuel Clay
4eb49687e0 Versioning postgres backup script. 2013-04-14 21:07:07 -07:00
Samuel Clay
eddcf1eddb Merge branch 'master' into circular
* master:
  Using regular expressions for comment stripping, unless the feed has an error count, in which case switch to lxml.
2013-04-08 16:15:29 -07:00
Samuel Clay
47c2257ef7 Using regular expressions for comment stripping, unless the feed has an error count, in which case switch to lxml. 2013-04-08 16:14:48 -07:00
Samuel Clay
e2a4546eb1 Merge branch 'master' into circular
* master:
  No longer doing overly zealous read story cleanup.
  Adding error_feeds count to munin.
2013-04-08 11:47:45 -07:00
Samuel Clay
532d1a67a7 No longer doing overly zealous read story cleanup. 2013-04-08 11:47:39 -07:00
Samuel Clay
eebba16d89 Adding error_feeds count to munin. 2013-04-08 10:53:11 -07:00
Samuel Clay
ff9bf4fad8 Merge branch 'master' into circular
* master:
  Skipping tasking of feeds when queue is too high. Use the random queue.
  Pushing out feed updates to cope with influx.
  Don't allow stories to come from more than 24 hours into the future.
  Removing force from new feeds.
  Adding in timing on feed cleanup.
  Increasing fetches for long tail feeds.
  Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories.
  Adding supervisord.conf config to include minfds (ulimit -a) support.

Conflicts:
	utils/feed_fetcher.py
2013-04-08 09:50:08 -07:00
Samuel Clay
639ad60ba1 Don't allow stories to come from more than 24 hours into the future. 2013-04-07 21:07:34 -07:00
Samuel Clay
36e76759e8 Adding in timing on feed cleanup. 2013-04-07 17:49:34 -07:00
Samuel Clay
1175b306cd Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:20:17 -07:00
Samuel Clay
48c5d4d53e Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:19:59 -07:00
Samuel Clay
35158e7a8b Merge branch 'master' into circular
* master:
  Upping Android to version 1.2.
  Bumping up feed fetching for premiums.
  Refunding stripe payments.
  ActionBar is part of the repo now (vendorized).
  Make initial sync on creation of Main activity folllow recommended two-step API pattern.
  Fix feed parsing issue when user has no feeds
  Fix crash when new user registers. For some unknown reason the code was doing a feed pull and then always expecting folders when there obviously wouldn't be any if the user just registered.
  When login fails go back to login activity rather than previous view
  Handle new user registration error reply by informing user of issue with regiration attempt

Conflicts:
	apps/profile/models.py
2013-04-05 19:05:45 -07:00
Samuel Clay
f2281ec7bc Refunding stripe payments. 2013-04-05 17:54:22 -07:00
Samuel Clay
6ca3320c44 Merge branch 'master' into circular
# By ojiikun (8) and others
# Via Samuel Clay (3) and ojiikun (1)
* master:
  Handling 0 images found for shared story.
  Fixing broken JPG image sizer.
  Handling timeouts for feed link change.
  Fixing a few small feed collision errors.
  Adding feedparser trunk, in case I want more pain.
  Fixing feed address change by feed link when colliding with existing feed.
  Fixing feed address change by feed link when colliding with existing feed.
  Revert change that disabled user images for shared/commented on a story and liked comments
  Undoing whitespace changes in APIManager.
  Undo whitespace changes in APIClient.
  Fully remove redundant sync during login.
  Remove extra debug.  Add full API logging.
  Cleanup comment views.
  Prevent force close in SetupCommentSectionTask if there is no data in the reply user cursor.
  Added .gitignore so ant files aren't accidentally comiitted.
  Clarify shell HOWTO instructions.
  Added shell build HOWTO.
  Remove extra sync in login frag. Disable favicos. Better Debug.
2013-04-04 17:54:42 -07:00
Samuel Clay
681968033b Fixing broken JPG image sizer. 2013-04-04 17:49:38 -07:00
Samuel Clay
2645eff5ad Fixing a few small feed collision errors. 2013-04-04 17:22:52 -07:00
Samuel Clay
0fac7eda3b Adding feedparser trunk, in case I want more pain. 2013-04-04 17:22:52 -07:00
Samuel Clay
179338135e Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:22:52 -07:00
Samuel Clay
3d190cc3ec Fixing a few small feed collision errors. 2013-04-04 17:18:27 -07:00
Samuel Clay
c02c1c4c98 Adding feedparser trunk, in case I want more pain. 2013-04-04 17:14:15 -07:00
Samuel Clay
8a7ea248fd Fixing feed address change by feed link when colliding with existing feed. 2013-04-04 17:09:16 -07:00
Samuel Clay
941726f51d Feed may not longer exist. Toss it. 2013-04-03 22:51:21 -07:00
Samuel Clay
d18e287834 Broken nb-full-container implementation. 2013-04-03 22:33:01 -07:00
Samuel Clay
5898ea9df0 Feed may not longer exist. Toss it. 2013-04-03 21:20:19 -07:00
Samuel Clay
c3548105f9 Merge branch 'master' into circular
* master:
  Cleaning up counts in munin and work log.
  What the f? strip_comments now eats CPU on bad stories. But why now and not a few months ago when I introduced it?
  Adding timeout to strip comments.
  Using proper hostname for task server. Adding verbosity to feed fetching.
2013-04-03 19:04:52 -07:00
Samuel Clay
6b262f8557 Cleaning up counts in munin and work log. 2013-04-03 19:04:30 -07:00
Samuel Clay
4cf2085ee7 Adding timeout to strip comments. 2013-04-03 18:16:52 -07:00
Samuel Clay
20698e9bc5 Merge branch 'master' into circular
* master:
  Adding tasked_feeds set to handle dropped feeds.
  Fixing missing feed bug.
  Adding new task server role: only new and push feeds.
  Fixing munin counts.
2013-04-03 17:26:10 -07:00
Samuel Clay
702e7c8e57 Fixing munin counts. 2013-04-03 16:16:15 -07:00
Samuel Clay
c42689a99e Merge branch 'master' into circular
* master:
  Cleaning up queue migration.
  Handling decayed feeds with no more active subscribers. They don't get returned to the scheduled_updates queue until there are enough active users.
  Only need next scheduled update.
  Fixing feeds that fall through.
  Moving task queue from postgres db backed to redis backed.
2013-04-03 16:08:29 -07:00
Samuel Clay
9aafd8eab2 Adding delaying to reader import. Adding reader starred story import. 2013-04-02 15:41:50 -07:00
Samuel Clay
61dde968b8 Merge branch 'master' into circular
# By Samuel Clay (12) and Lance Johnson (1)
* master:
  Updating postgres config, celery queue.
  Boosting feed fetching.
  Android: show server error message to user when add feed fails. The error message was being sent when non-premium users tried to search for feeds and was causing the App to crash.
  Removing unused feed hash index (keeping the unique constraint).
  Adding two indexes and killing one unused one from feeds.
  Returning index on active subs.
  Changing logging on feed queueing.
  Turning off autocomplete for the time being.
  Removing unused indexes.
  Upgrade to postgres 9.2.
  Culling some graphs on feed counts.
  Cleaning up week old feeds.
  Boosting feed fetching way up for the weekend.
2013-03-30 19:05:20 -07:00
Samuel Clay
ba5919d760 Moving task queue from postgres db backed to redis backed. 2013-03-30 19:05:13 -07:00