Commit graph

465 commits

Author SHA1 Message Date
Samuel Clay
13b2e40c8c Adding index to feed address. This will speed up imports. 2012-04-19 12:13:35 -07:00
Samuel Clay
34ce57ca6d Correctly handling story that lack titles but have content. Using a parsed and shucked truncation of content in place of missing titles. 2012-04-17 11:48:28 -07:00
Samuel Clay
110cbd9e06 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  Fixing bug around missing feed links being checked for length.
2012-04-09 14:59:11 -07:00
Samuel Clay
ee76081cda Instrumentation to count feed pushes. 2012-04-09 14:58:53 -07:00
Samuel Clay
320ceb87fd Fixing bug around missing feed links being checked for length. 2012-04-06 21:40:18 -07:00
Samuel Clay
2ab37d20e1 Adding MongoDB logging for debug. 2012-04-06 18:28:26 -07:00
Samuel Clay
4260bf6c3a No longer unquoting (decoding) urls for stories. This shouldn't break anything, but it probably will. 2012-04-06 13:38:21 -07:00
Samuel Clay
2efb3e7160 Setting a max feed link size. 2012-04-04 22:22:24 -07:00
Samuel Clay
f30b35acd1 Fixing Cyrillic text issue by both using encoded text from server with the help of requests, and then serving it with a defined charset encoding back to the client. 2012-03-29 14:45:19 -07:00
Samuel Clay
d54d373c97 Fixing hub url change subscription. 2012-03-28 18:25:57 -07:00
Samuel Clay
abd1f4201a Adding failed push feeds to munin. 2012-03-28 17:35:51 -07:00
Samuel Clay
a075ec9e33 Showing correct real-time status if feed is push. 2012-03-28 17:31:29 -07:00
Samuel Clay
214e7d4c90 Setting up push feeds for removal. 2012-03-28 16:49:58 -07:00
Samuel Clay
a74be1b604 Adding push feeds queue. Ignoring fat ping, since it might not match URLs. 2012-03-28 15:49:21 -07:00
Samuel Clay
9ee6487f58 Correcting a double-encoding bug for story permalinks that was from way back when. 2012-03-27 18:37:04 -07:00
Samuel Clay
fd1e26a5b0 Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server. 2012-03-27 17:34:39 -07:00
Samuel Clay
abc3b20d81 Adding subscription callbacks for PuSH. 2012-03-27 16:26:07 -07:00
Samuel Clay
1788d26374 Goodbye StatHat. Hello better logging. 2012-03-27 11:19:53 -07:00
Samuel Clay
5e981635d1 Small cleanup to parameters of feed update method. 2012-03-26 17:04:35 -07:00
Samuel Clay
426a5376a7 Refactoring starred stories indexes and adding hints. 2012-03-26 13:14:02 -07:00
Samuel Clay
bf00d6a501 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.
2012-03-26 12:40:24 -07:00
Samuel Clay
1321ade17a Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work. 2012-03-26 12:40:13 -07:00
Samuel Clay
7313339dbc Refactoring refresh feed unread counts. Fixing tests. 2012-03-26 11:04:05 -07:00
Samuel Clay
c8eed328d4 Adding django 1.4 compatibility. 2012-03-25 14:08:56 -07:00
Samuel Clay
a850a139e0 If feed no longer exists after update, find it, then schedule fetch. 2012-03-24 10:56:32 -07:00
Samuel Clay
d29021fa0e Missing last update date. 2012-03-21 16:23:21 -07:00
Samuel Clay
d74139e2ed Fixing major bug around stale data when updating feeds. 2012-03-21 16:05:52 -07:00
Samuel Clay
1fb6464415 Handle cases of user reading both old and new guid stories. 2012-03-21 13:54:37 -07:00
Samuel Clay
7ddfdd644e Moving last update to post-fetch. 2012-03-20 16:51:10 -07:00
Samuel Clay
396d76b5ac Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header. 2012-03-19 19:58:17 -07:00
Samuel Clay
d5b71c76ba Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read. 2012-03-08 11:15:17 -08:00
Samuel Clay
d5926fe577 Fixing rss feed tests. 2012-03-06 16:11:27 -08:00
Samuel Clay
33fa13cf69 Fixing issue around feeds that are mistakenly declared as not having a page. 2012-03-05 13:12:50 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
ca5438a9fb Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:05:52 -08:00
Samuel Clay
ff00e16682 Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:00:55 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00
Samuel Clay
d57c26e98e Adding debug message about counting errors. 2012-02-24 16:15:49 -08:00
Samuel Clay
96f6a3d2c7 Fixing numerous feed fetching errors. 2012-02-24 14:39:23 -08:00
Samuel Clay
1ffefaa419 Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh. 2012-02-24 11:47:38 -08:00
Samuel Clay
6c7034343b Geometrically decaying feed fetches on known good feeds that have gone bad. 2012-02-23 13:20:10 -08:00
Samuel Clay
9236ecc6f6 Correcting typo in dupe feed resolution. 2012-02-09 07:50:40 -08:00
Samuel Clay
50e80c7241 Handling duplicate feed saving much more gracefully by finding the correct dupe. 2012-02-03 13:02:26 -08:00
Samuel Clay
e5f7cf7517 Turning down verbosity on feed tasking. 2012-02-01 22:42:48 -08:00
Samuel Clay
c9cb7dcbc0 Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s. 2012-02-01 17:59:46 -08:00
Samuel Clay
b17252d241 Fixing broken opml export due to missing feed icons. 2012-01-10 10:22:12 -08:00
Samuel Clay
642323fd07 Fixing slight bug in how active premiums were applied to feed update times. 2012-01-09 21:24:47 -08:00
Samuel Clay
ad007c7e61 Adding active_premium count. Setting a minimum of 1 hour fetches for feeds with any active premiums. 2012-01-09 19:08:22 -08:00
Samuel Clay
aa96e288d2 Adding error handling for insta-fetching stories. 2012-01-08 14:15:22 -08:00
Samuel Clay
4389374033 Moving to proper unicode string for feed fetching. 2012-01-04 21:49:55 -08:00