Commit graph

604 commits

Author SHA1 Message Date
Samuel Clay
8feebca215 Disabling gatekeeper (robots.txt) check in feedfinder. This may have negative consequences. 2012-05-19 10:32:55 -07:00
Samuel Clay
96cf1e2dec Adding task servers and updating automated deploy. 2012-05-17 12:43:13 -07:00
Samuel Clay
852202899d Don't know how I feel about this change, but http://gizmodo.com/author/mat-honan.xml is failing when 'Safari/X' is in the user agent, but only with http opener. Ugh. 2012-05-07 17:16:32 -07:00
Samuel Clay
c1b5aef983 Fixing icon fetching error when the page is corrupted. 2012-04-24 17:40:34 -07:00
Samuel Clay
2474c987c5 Trying to fix inaccurate unread counts by forcing the dirty flag and not allowing timeouts. 2012-04-24 16:34:28 -07:00
Samuel Clay
20eeef3dc9 Removing unused cache. 2012-04-24 16:00:14 -07:00
Samuel Clay
34ce57ca6d Correctly handling story that lack titles but have content. Using a parsed and shucked truncation of content in place of missing titles. 2012-04-17 11:48:28 -07:00
Samuel Clay
7e5931134b Forcing a feed refresh now allows it to re-enable PuSH. 2012-04-16 14:44:39 -07:00
Samuel Clay
fa558f6157 Adding locals to feed fetch errors. 2012-04-12 15:41:19 -07:00
Samuel Clay
2ab37d20e1 Adding MongoDB logging for debug. 2012-04-06 18:28:26 -07:00
Samuel Clay
21bd9a0c3d Being far kinder during feed exception handling and showing users error text. Cannot believe this wasn't there. 2012-04-06 16:21:16 -07:00
Samuel Clay
f4c65c23d5 Fixing Tumblr PuSH by sending the address instead of the link when subscribing. 2012-03-30 16:36:16 -07:00
Samuel Clay
abd1f4201a Adding failed push feeds to munin. 2012-03-28 17:35:51 -07:00
Samuel Clay
d8a343b67b Adding munin graph for pushed feed queue and nginx conf. 2012-03-28 16:43:04 -07:00
Samuel Clay
4348e7f497 Resubscribing to real-time feeds on add/remove feed. 2012-03-28 16:13:17 -07:00
Samuel Clay
a74be1b604 Adding push feeds queue. Ignoring fat ping, since it might not match URLs. 2012-03-28 15:49:21 -07:00
Samuel Clay
b1369a06af Adding # of push feeds to munin. 2012-03-27 18:48:36 -07:00
Samuel Clay
9ee6487f58 Correcting a double-encoding bug for story permalinks that was from way back when. 2012-03-27 18:37:04 -07:00
Samuel Clay
fd1e26a5b0 Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server. 2012-03-27 17:34:39 -07:00
Samuel Clay
a745e654ba Checking for push hub links safetly. 2012-03-27 16:42:45 -07:00
Samuel Clay
abc3b20d81 Adding subscription callbacks for PuSH. 2012-03-27 16:26:07 -07:00
Samuel Clay
daef8f3841 Stubbing in PuSH support. Need to work it in with Feeds and upgrade rel='hub'. 2012-03-27 14:58:13 -07:00
Samuel Clay
1788d26374 Goodbye StatHat. Hello better logging. 2012-03-27 11:19:53 -07:00
Samuel Clay
bdaa2f7e81 Fixing missing status code in feed fetcher. 2012-03-26 17:42:04 -07:00
Samuel Clay
6cc53f42c7 Fixing missing status code in feed fetcher. 2012-03-26 17:24:57 -07:00
Samuel Clay
eec1563549 Adding stathat stats for feed fetching and parsing. 2012-03-26 17:21:49 -07:00
Samuel Clay
5e981635d1 Small cleanup to parameters of feed update method. 2012-03-26 17:04:35 -07:00
Samuel Clay
bf00d6a501 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.
2012-03-26 12:40:24 -07:00
Samuel Clay
1321ade17a Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work. 2012-03-26 12:40:13 -07:00
Samuel Clay
7313339dbc Refactoring refresh feed unread counts. Fixing tests. 2012-03-26 11:04:05 -07:00
Samuel Clay
0e767e65c3 Don't skip unfetched feeds. 2012-03-24 10:51:04 -07:00
Samuel Clay
3e6329b3e5 Don't skip unfetched feeds. 2012-03-24 10:50:23 -07:00
Samuel Clay
81ccad2942 Fixing bug around missing feed value when skipping fetch (and not updating last_update date). 2012-03-22 10:39:24 -07:00
Samuel Clay
fcebe3e262 Handling zlib/deflate issues, specifically for The Verge. 2012-03-22 09:48:44 -07:00
Samuel Clay
d74139e2ed Fixing major bug around stale data when updating feeds. 2012-03-21 16:05:52 -07:00
Samuel Clay
028b027959 Being more aggressive in determining if a URL is a feed. 2012-03-21 14:41:10 -07:00
Samuel Clay
3a87a7c418 Fixing issue around feed titles that disappear. This just confirms that the new feed title is substantive. 2012-03-19 20:47:06 -07:00
Samuel Clay
396d76b5ac Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header. 2012-03-19 19:58:17 -07:00
Samuel Clay
d5926fe577 Fixing rss feed tests. 2012-03-06 16:11:27 -08:00
Samuel Clay
33fa13cf69 Fixing issue around feeds that are mistakenly declared as not having a page. 2012-03-05 13:12:50 -08:00
Samuel Clay
154ce61a3d New audio control, with Flash fallback for browsers like Firefox/IE. 2012-03-05 12:57:47 -08:00
Samuel Clay
e2e0d1e09d Moving JS assets to bottom of the page for faster loadtimes. 2012-02-28 12:18:44 -08:00
Samuel Clay
d2925e7efe Fixing recommendation date serialization bug. 2012-02-28 11:48:23 -08:00
Samuel Clay
936088f09c Allowing any password to be used on accounts with no password set. 2012-02-27 16:36:39 -08:00
Samuel Clay
e74f89c93c Counting queue size for celery/redis. 2012-02-26 23:29:57 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
ff00e16682 Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:00:55 -08:00
Samuel Clay
bdf84cb64c Typo in feed pool drain. 2012-02-24 16:48:58 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00
Samuel Clay
96f6a3d2c7 Fixing numerous feed fetching errors. 2012-02-24 14:39:23 -08:00