Commit graph

276 commits

Author SHA1 Message Date
Samuel Clay
c1b5aef983 Fixing icon fetching error when the page is corrupted. 2012-04-24 17:40:34 -07:00
Samuel Clay
2474c987c5 Trying to fix inaccurate unread counts by forcing the dirty flag and not allowing timeouts. 2012-04-24 16:34:28 -07:00
Samuel Clay
20eeef3dc9 Removing unused cache. 2012-04-24 16:00:14 -07:00
Samuel Clay
7e5931134b Forcing a feed refresh now allows it to re-enable PuSH. 2012-04-16 14:44:39 -07:00
Samuel Clay
fa558f6157 Adding locals to feed fetch errors. 2012-04-12 15:41:19 -07:00
Samuel Clay
f4c65c23d5 Fixing Tumblr PuSH by sending the address instead of the link when subscribing. 2012-03-30 16:36:16 -07:00
Samuel Clay
d8a343b67b Adding munin graph for pushed feed queue and nginx conf. 2012-03-28 16:43:04 -07:00
Samuel Clay
4348e7f497 Resubscribing to real-time feeds on add/remove feed. 2012-03-28 16:13:17 -07:00
Samuel Clay
a74be1b604 Adding push feeds queue. Ignoring fat ping, since it might not match URLs. 2012-03-28 15:49:21 -07:00
Samuel Clay
9ee6487f58 Correcting a double-encoding bug for story permalinks that was from way back when. 2012-03-27 18:37:04 -07:00
Samuel Clay
fd1e26a5b0 Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server. 2012-03-27 17:34:39 -07:00
Samuel Clay
a745e654ba Checking for push hub links safetly. 2012-03-27 16:42:45 -07:00
Samuel Clay
abc3b20d81 Adding subscription callbacks for PuSH. 2012-03-27 16:26:07 -07:00
Samuel Clay
daef8f3841 Stubbing in PuSH support. Need to work it in with Feeds and upgrade rel='hub'. 2012-03-27 14:58:13 -07:00
Samuel Clay
1788d26374 Goodbye StatHat. Hello better logging. 2012-03-27 11:19:53 -07:00
Samuel Clay
bdaa2f7e81 Fixing missing status code in feed fetcher. 2012-03-26 17:42:04 -07:00
Samuel Clay
6cc53f42c7 Fixing missing status code in feed fetcher. 2012-03-26 17:24:57 -07:00
Samuel Clay
eec1563549 Adding stathat stats for feed fetching and parsing. 2012-03-26 17:21:49 -07:00
Samuel Clay
5e981635d1 Small cleanup to parameters of feed update method. 2012-03-26 17:04:35 -07:00
Samuel Clay
bf00d6a501 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.
2012-03-26 12:40:24 -07:00
Samuel Clay
1321ade17a Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work. 2012-03-26 12:40:13 -07:00
Samuel Clay
7313339dbc Refactoring refresh feed unread counts. Fixing tests. 2012-03-26 11:04:05 -07:00
Samuel Clay
0e767e65c3 Don't skip unfetched feeds. 2012-03-24 10:51:04 -07:00
Samuel Clay
3e6329b3e5 Don't skip unfetched feeds. 2012-03-24 10:50:23 -07:00
Samuel Clay
81ccad2942 Fixing bug around missing feed value when skipping fetch (and not updating last_update date). 2012-03-22 10:39:24 -07:00
Samuel Clay
d74139e2ed Fixing major bug around stale data when updating feeds. 2012-03-21 16:05:52 -07:00
Samuel Clay
3a87a7c418 Fixing issue around feed titles that disappear. This just confirms that the new feed title is substantive. 2012-03-19 20:47:06 -07:00
Samuel Clay
d5926fe577 Fixing rss feed tests. 2012-03-06 16:11:27 -08:00
Samuel Clay
33fa13cf69 Fixing issue around feeds that are mistakenly declared as not having a page. 2012-03-05 13:12:50 -08:00
Samuel Clay
936088f09c Allowing any password to be used on accounts with no password set. 2012-02-27 16:36:39 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
ff00e16682 Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:00:55 -08:00
Samuel Clay
bdf84cb64c Typo in feed pool drain. 2012-02-24 16:48:58 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00
Samuel Clay
1ffefaa419 Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh. 2012-02-24 11:47:38 -08:00
Samuel Clay
6c7034343b Geometrically decaying feed fetches on known good feeds that have gone bad. 2012-02-23 13:20:10 -08:00
Samuel Clay
dc986a0a3e Preserving feed fetch error histories for 2 weeks. 2012-02-02 07:46:04 -08:00
Samuel Clay
c9cb7dcbc0 Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s. 2012-02-01 17:59:46 -08:00
Samuel Clay
619f03f610 Fixing typo in aggressive feed fetching. 2012-01-23 09:12:38 -08:00
Samuel Clay
c37bcdad63 No longer being aggressive about finding a feed's correct address if it returns a 400 or 500 error code, unless it is still the first run or an exception refresh. 2012-01-23 09:08:55 -08:00
Samuel Clay
ccc8878e88 Colorizing feed fetching. 2012-01-04 18:47:40 -08:00
Samuel Clay
b0aa1764b4 Colorizing feed fetching. 2012-01-04 18:30:43 -08:00
Samuel Clay
10ef120e34 Merge branch 'master' into requests
* master:
  Abort old requests and don't cache responses. Trying to fix IE read story bug.
  Force jquery to never cache.
  Checking for exceptions earlier in order to show fixed site.
  Changing user agent to hopefully override overly-sniffy websites.
  Fixing inaccurate substitution on feed urls. Ugh, can't believe this was here this long.
  Adding the setting of a feed's view settings to Site Settings dialog. This should've been in there a loooong time ago.
2012-01-02 16:00:09 -08:00
Samuel Clay
4fd9965949 Changing user agent to hopefully override overly-sniffy websites. 2012-01-02 14:31:50 -08:00
Samuel Clay
6637c05adf Adding a little bit more leeway in page importer by falling back to urllib2 when requests fail. 2011-12-20 22:30:55 -08:00
Samuel Clay
0418538381 Adding slight bit of color to feed fetcher. 2011-12-20 22:02:52 -08:00
Samuel Clay
b5efad9142 Merge branch 'master' into requests
* master: (66 commits)
  Too many stories? Don't animate transitions when switching intelligence levels.
  Fixing typo in iphone app that preventing mark folder as read when the visible stories option was showing.
  Updating the mongo db copy util to also look for updated stories.
  Globals.is_staff on user, not profile. Make the stats referesh every minute instead of every 10 minutes for staff.
  Fixing offsets in river of news.
  Adding ciphering to usernames in log, so I can finally take screenshots of the most colorful logs of all time.
  Adding my very special mongo serialization backup utility to get around the damn unrepairable mongo database. This is taking 14 hours to run.
  Auto-refreshing feedback (1 min for staff, 10 min for everybody).
  Fixing exception around multiple feeds during Google Reader import process. Also switching rate limit to status code 429.
  Adding Nokia MeeGo client to user agents.
  Only show raw feeds in feed autocomplete.
  Handling iphone version for new users on ios app.
  FIXING THE WORST BUG OF MY LIFE -- finally figured out what was causing the story-shows-as-unread bug. Also fixed enclosures on certain types of feeds.
  Fixing menu manage open position to compensate for additional menu items.
  Reducing the amount of work done by feed fetching when there are no new stories.
  Fixing emergency bug around trimming feeds where the cursor is changing. Dammit mongo.
  Simplifying ufw ports in fabfile. Adding env.user.
  Launching the iPhone app on the front-page. Big deal.
  Minor cleanup of river stories view.
  Cleaning up mongoengine imports and settings for default MongoDB.
  ...

Conflicts:
	local_settings.py.template
2011-12-20 21:47:55 -08:00
Samuel Clay
d1b0552942 Reducing the amount of work done by feed fetching when there are no new stories. 2011-12-14 14:18:01 -08:00
Samuel Clay
1828d949d8 Killing off the old slave_db pattern. 2011-12-11 11:06:42 -08:00
Samuel Clay
85feadb3f1 Fixing the crap out of the move feed/folder dialog in iOS app. Completely done with this dialog. Yay! 2011-12-04 13:55:57 -08:00