Samuel Clay
1bb442a9d0
Being much more aggressive about certain sites trying to take over the iframe. Blocking nytimes.com, twitter.com, and stackoverflow.com from even allowing an Original view.
2012-05-07 16:26:31 -07:00
Samuel Clay
c1b5aef983
Fixing icon fetching error when the page is corrupted.
2012-04-24 17:40:34 -07:00
Samuel Clay
13b2e40c8c
Adding index to feed address. This will speed up imports.
2012-04-19 12:13:35 -07:00
Samuel Clay
34ce57ca6d
Correctly handling story that lack titles but have content. Using a parsed and shucked truncation of content in place of missing titles.
2012-04-17 11:48:28 -07:00
Samuel Clay
110cbd9e06
Merge branch 'master' of github.com:samuelclay/NewsBlur
...
* 'master' of github.com:samuelclay/NewsBlur:
Fixing bug around missing feed links being checked for length.
2012-04-09 14:59:11 -07:00
Samuel Clay
ee76081cda
Instrumentation to count feed pushes.
2012-04-09 14:58:53 -07:00
Samuel Clay
320ceb87fd
Fixing bug around missing feed links being checked for length.
2012-04-06 21:40:18 -07:00
Samuel Clay
2ab37d20e1
Adding MongoDB logging for debug.
2012-04-06 18:28:26 -07:00
Samuel Clay
4260bf6c3a
No longer unquoting (decoding) urls for stories. This shouldn't break anything, but it probably will.
2012-04-06 13:38:21 -07:00
Samuel Clay
2efb3e7160
Setting a max feed link size.
2012-04-04 22:22:24 -07:00
Samuel Clay
f30b35acd1
Fixing Cyrillic text issue by both using encoded text from server with the help of requests, and then serving it with a defined charset encoding back to the client.
2012-03-29 14:45:19 -07:00
Samuel Clay
d54d373c97
Fixing hub url change subscription.
2012-03-28 18:25:57 -07:00
Samuel Clay
abd1f4201a
Adding failed push feeds to munin.
2012-03-28 17:35:51 -07:00
Samuel Clay
a075ec9e33
Showing correct real-time status if feed is push.
2012-03-28 17:31:29 -07:00
Samuel Clay
214e7d4c90
Setting up push feeds for removal.
2012-03-28 16:49:58 -07:00
Samuel Clay
a74be1b604
Adding push feeds queue. Ignoring fat ping, since it might not match URLs.
2012-03-28 15:49:21 -07:00
Samuel Clay
9ee6487f58
Correcting a double-encoding bug for story permalinks that was from way back when.
2012-03-27 18:37:04 -07:00
Samuel Clay
fd1e26a5b0
Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server.
2012-03-27 17:34:39 -07:00
Samuel Clay
abc3b20d81
Adding subscription callbacks for PuSH.
2012-03-27 16:26:07 -07:00
Samuel Clay
1788d26374
Goodbye StatHat. Hello better logging.
2012-03-27 11:19:53 -07:00
Samuel Clay
5e981635d1
Small cleanup to parameters of feed update method.
2012-03-26 17:04:35 -07:00
Samuel Clay
426a5376a7
Refactoring starred stories indexes and adding hints.
2012-03-26 13:14:02 -07:00
Samuel Clay
bf00d6a501
Merge branch 'master' of github.com:samuelclay/NewsBlur
...
* 'master' of github.com:samuelclay/NewsBlur:
If feed no longer exists after update, find it, then schedule fetch.
Don't skip unfetched feeds.
Don't skip unfetched feeds.
2012-03-26 12:40:24 -07:00
Samuel Clay
1321ade17a
Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work.
2012-03-26 12:40:13 -07:00
Samuel Clay
7313339dbc
Refactoring refresh feed unread counts. Fixing tests.
2012-03-26 11:04:05 -07:00
Samuel Clay
c8eed328d4
Adding django 1.4 compatibility.
2012-03-25 14:08:56 -07:00
Samuel Clay
a850a139e0
If feed no longer exists after update, find it, then schedule fetch.
2012-03-24 10:56:32 -07:00
Samuel Clay
d29021fa0e
Missing last update date.
2012-03-21 16:23:21 -07:00
Samuel Clay
d74139e2ed
Fixing major bug around stale data when updating feeds.
2012-03-21 16:05:52 -07:00
Samuel Clay
1fb6464415
Handle cases of user reading both old and new guid stories.
2012-03-21 13:54:37 -07:00
Samuel Clay
7ddfdd644e
Moving last update to post-fetch.
2012-03-20 16:51:10 -07:00
Samuel Clay
396d76b5ac
Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header.
2012-03-19 19:58:17 -07:00
Samuel Clay
d5b71c76ba
Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read.
2012-03-08 11:15:17 -08:00
Samuel Clay
d5926fe577
Fixing rss feed tests.
2012-03-06 16:11:27 -08:00
Samuel Clay
33fa13cf69
Fixing issue around feeds that are mistakenly declared as not having a page.
2012-03-05 13:12:50 -08:00
Samuel Clay
d901ccdae1
Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load.
2012-02-26 22:33:06 -08:00
Samuel Clay
ca5438a9fb
Fixing last update problem that has been choking feed fetchers.
2012-02-24 17:05:52 -08:00
Samuel Clay
ff00e16682
Fixing last update problem that has been choking feed fetchers.
2012-02-24 17:00:55 -08:00
Samuel Clay
ce536200f6
Adding ability to wind down feed queue by faking requests.
2012-02-24 16:43:08 -08:00
Samuel Clay
d57c26e98e
Adding debug message about counting errors.
2012-02-24 16:15:49 -08:00
Samuel Clay
96f6a3d2c7
Fixing numerous feed fetching errors.
2012-02-24 14:39:23 -08:00
Samuel Clay
1ffefaa419
Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh.
2012-02-24 11:47:38 -08:00
Samuel Clay
6c7034343b
Geometrically decaying feed fetches on known good feeds that have gone bad.
2012-02-23 13:20:10 -08:00
Samuel Clay
9236ecc6f6
Correcting typo in dupe feed resolution.
2012-02-09 07:50:40 -08:00
Samuel Clay
50e80c7241
Handling duplicate feed saving much more gracefully by finding the correct dupe.
2012-02-03 13:02:26 -08:00
Samuel Clay
e5f7cf7517
Turning down verbosity on feed tasking.
2012-02-01 22:42:48 -08:00
Samuel Clay
c9cb7dcbc0
Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s.
2012-02-01 17:59:46 -08:00
Samuel Clay
b17252d241
Fixing broken opml export due to missing feed icons.
2012-01-10 10:22:12 -08:00
Samuel Clay
642323fd07
Fixing slight bug in how active premiums were applied to feed update times.
2012-01-09 21:24:47 -08:00
Samuel Clay
ad007c7e61
Adding active_premium count. Setting a minimum of 1 hour fetches for feeds with any active premiums.
2012-01-09 19:08:22 -08:00
