Commit graph

588 commits

Author SHA1 Message Date
Samuel Clay
8efefc6cdb Merge branch 'master' into social
* master:
  Fixing hub url change subscription.
  Adding failed push feeds to munin.
  Showing correctly real-time status if feed is push.
  Showing correct real-time status if feed is push.
  Emergency fix to not have to reverse url in task fetchers.
  Setting up push feeds for removal.
  Adding munin graph for pushed feed queue and nginx conf.
  Logging real-time.
  Resubscribing to real-time feeds on add/remove feed.
  Adding push feeds queue. Ignoring fat ping, since it might not match URLs.
  Cleanup
  Forgive push subscription errors.
  Adding # of push feeds to munin.
  Correcting a double-encoding bug for story permalinks that was from way back when.
  Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server.
  Checking for push hub links safetly.
  Adding subscription callbacks for PuSH.
  Stubbing in PuSH support. Need to work it in with Feeds and upgrade rel='hub'.

Conflicts:
	apps/reader/models.py
	media/js/newsblur/reader/reader.js
	settings.py
	utils/feed_fetcher.py
2012-03-28 18:42:35 -07:00
Samuel Clay
d54d373c97 Fixing hub url change subscription. 2012-03-28 18:25:57 -07:00
Samuel Clay
abd1f4201a Adding failed push feeds to munin. 2012-03-28 17:35:51 -07:00
Samuel Clay
a075ec9e33 Showing correct real-time status if feed is push. 2012-03-28 17:31:29 -07:00
Samuel Clay
214e7d4c90 Setting up push feeds for removal. 2012-03-28 16:49:58 -07:00
Samuel Clay
a74be1b604 Adding push feeds queue. Ignoring fat ping, since it might not match URLs. 2012-03-28 15:49:21 -07:00
Samuel Clay
494a89f060 Merge branch 'master' into social
* master:
  Adding task04 to fabfile.
  Updating Safari helper app.
  Goodbye StatHat. Hello better logging.

Conflicts:
	utils/feed_fetcher.py
2012-03-28 12:05:51 -07:00
Samuel Clay
9ee6487f58 Correcting a double-encoding bug for story permalinks that was from way back when. 2012-03-27 18:37:04 -07:00
Samuel Clay
fd1e26a5b0 Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server. 2012-03-27 17:34:39 -07:00
Samuel Clay
abc3b20d81 Adding subscription callbacks for PuSH. 2012-03-27 16:26:07 -07:00
Samuel Clay
1788d26374 Goodbye StatHat. Hello better logging. 2012-03-27 11:19:53 -07:00
Samuel Clay
e0d6454a5f Merge branch 'master' into social
* master:
  Fixing missing status code in feed fetcher.
  Fixing missing status code in feed fetcher.
  Adding stathat stats for feed fetching and parsing.
  Small cleanup to parameters of feed update method.
  Refactoring starred stories indexes and adding hints.
  Removing hints.
  Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work.
  Refactoring refresh feed unread counts. Fixing tests.
  Adding task04 to fabfile.
  Adding django 1.4 compatibility.
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.

Conflicts:
	apps/reader/models.py
	apps/reader/views.py
	fabfile.py
	utils/feed_fetcher.py
2012-03-26 21:06:13 -07:00
Samuel Clay
5e981635d1 Small cleanup to parameters of feed update method. 2012-03-26 17:04:35 -07:00
Samuel Clay
426a5376a7 Refactoring starred stories indexes and adding hints. 2012-03-26 13:14:02 -07:00
Samuel Clay
bf00d6a501 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.
2012-03-26 12:40:24 -07:00
Samuel Clay
1321ade17a Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work. 2012-03-26 12:40:13 -07:00
Samuel Clay
7313339dbc Refactoring refresh feed unread counts. Fixing tests. 2012-03-26 11:04:05 -07:00
Samuel Clay
c8eed328d4 Adding django 1.4 compatibility. 2012-03-25 14:08:56 -07:00
Samuel Clay
a850a139e0 If feed no longer exists after update, find it, then schedule fetch. 2012-03-24 10:56:32 -07:00
Samuel Clay
3e83186254 Merge branch 'master' into social
* master:
  Missing last update date.
  Fixing major bug around stale data when updating feeds.
2012-03-21 17:12:20 -07:00
Samuel Clay
d29021fa0e Missing last update date. 2012-03-21 16:23:21 -07:00
Samuel Clay
d74139e2ed Fixing major bug around stale data when updating feeds. 2012-03-21 16:05:52 -07:00
Samuel Clay
f32dc6bd1c Merge branch 'master' into social
* master:
  Being more aggressive in determining if a URL is a feed.
  Increasing modal zindex to battle Svbtle blogs sidebar.
  Handle cases of user reading both old and new guid stories.
  Checking for a signup that is really a login when importing GR.
2012-03-21 14:42:42 -07:00
Samuel Clay
1fb6464415 Handle cases of user reading both old and new guid stories. 2012-03-21 13:54:37 -07:00
Samuel Clay
c2e5ece818 Merge branch 'master' into social
* master:
  Moving last update to post-fetch.
2012-03-20 16:52:07 -07:00
Samuel Clay
7ddfdd644e Moving last update to post-fetch. 2012-03-20 16:51:10 -07:00
Samuel Clay
67ea2452a7 Uniqifying profiles. Small cleanup. 2012-03-20 16:46:38 -07:00
Samuel Clay
5b71327531 Merge branch 'master' into social
* master:
  Error handling in orphan detection.
  Collecting orphaned feeds for users. These somehow got lost, and I'm not sure how. Eventually I'd like to run this on every user account.
  Fixing issue around feed titles that disappear. This just confirms that the new feed title is substantive.
  Uncommenting Readability sharing. This was written a loooong time ago, but their API is finally ready.
  Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header.
  Fixing missing folder issue in iOS app. Occurs when user has no feeds in top level, when the Everything psuedo-folder obscures the top folder.

Conflicts:
	apps/reader/models.py
2012-03-20 10:33:15 -07:00
Samuel Clay
396d76b5ac Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header. 2012-03-19 19:58:17 -07:00
Samuel Clay
7f73c33f6f Styling the Stay Up To Date page, and it's stunning. 2012-03-16 20:40:48 -07:00
Samuel Clay
a2ee769895 Big cleanup on duplicate feeds with alternative feed links. Also fixing the profile to show followers/followings. 2012-03-12 18:11:13 -07:00
Samuel Clay
41b68b32eb Automatically loading intro or chooser dialog based on progress of new user. 2012-03-12 12:33:54 -07:00
Samuel Clay
8b4c801995 Moving linkify and changing a bit of logging. 2012-03-10 11:41:58 -08:00
Samuel Clay
9093061bbe Merge branch 'master' into social
* master:
  Adding Mother Jones feeds for testing.
  Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read.
  Fixing errant linkify text bug that resulted in some javascript being executed and overwriting the page. Thanks to @aaronlidman for the help in identifying the bug.

Conflicts:
	assets.yml
2012-03-08 16:34:20 -08:00
Samuel Clay
d5b71c76ba Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read. 2012-03-08 11:15:17 -08:00
Samuel Clay
c9f978d8b1 Merge branch 'master' into social
* master:
  Adding tests in prep for Mother Jones duping.
  Fixing rss feed tests.
  Adding press story from Italian site Skimbu.
  Adding Cuk.ch story about NewsBlur.
2012-03-06 16:56:34 -08:00
Samuel Clay
d5926fe577 Fixing rss feed tests. 2012-03-06 16:11:27 -08:00
Samuel Clay
0e43583a6c Merge branch 'master' into social
* master:
  Fixing issue around feeds that are mistakenly declared as not having a page.
  New audio control, with Flash fallback for browsers like Firefox/IE.

Conflicts:
	assets.yml
2012-03-05 13:48:39 -08:00
Samuel Clay
33fa13cf69 Fixing issue around feeds that are mistakenly declared as not having a page. 2012-03-05 13:12:50 -08:00
Samuel Clay
603ac08faa Merge branch 'master' into social
* master:
  Allow login from signup form.
  Reducing celery prefetch to get more accurate queue sizes.
  Removing RabbitMQ dependency. Moving to redis for task queuing.
  Counting queue size for celery/redis.
  Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load.
  Skipping feed resurrection.
  Fixing last update problem that has been choking feed fetchers.
  Fixing last update problem that has been choking feed fetchers.
  Typo in feed pool drain.
  Adding ability to wind down feed queue by faking requests.
  Adding debug message about counting errors.

Conflicts:
	fabfile.py
2012-02-27 13:13:27 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
ca5438a9fb Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:05:52 -08:00
Samuel Clay
ff00e16682 Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:00:55 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00
Samuel Clay
d57c26e98e Adding debug message about counting errors. 2012-02-24 16:15:49 -08:00
Samuel Clay
96c5fe6d1f Merge branch 'master' into social
* master:
  Inverting the count for fetched feeds.
  Fixing numerous feed fetching errors.
2012-02-24 15:09:54 -08:00
Samuel Clay
96f6a3d2c7 Fixing numerous feed fetching errors. 2012-02-24 14:39:23 -08:00
Samuel Clay
408cb7e801 Merge branch 'master' into social
* master:
  Fixing starred stories from not loading past the second page due to a missing flag reset.
  Fixing user-found bug around tooltips continuing to show if the original dom element (and the reference to the tooltip) are destroyed too early, leaving a tooltip floating in the air.
  Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh.
  Fixing error codes on statistics. Also fixing simple error on invalid feed.
  Update media/js/newsblur/reader.js

Conflicts:
	media/js/newsblur/reader/reader.js
2012-02-24 13:01:48 -08:00
Samuel Clay
1ffefaa419 Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh. 2012-02-24 11:47:38 -08:00
Samuel Clay
307e36622b Merge branch 'master' into social
* master:
  Adding asset-less deployment.
  Upgrading feedparser from 5.0.1 to 5.1.
  Catching errors in page links with ill-formed urls.
  Not showing the world favicon until favicons are downloaded.
  Fixing feed exception dialog to actually reload feeds on the page.
  Geometrically decaying feed fetches on known good feeds that have gone bad.
  Fixing issue around empty original pages.

Conflicts:
	media/js/newsblur/reader/reader.js
2012-02-23 15:40:38 -08:00