Commit graph

181 commits

Author SHA1 Message Date
Samuel Clay
463d2af239 Meaningless version change. 2011-01-13 22:54:54 -05:00
Samuel Clay
4f35c2fade Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin. 2010-12-23 13:29:31 -05:00
Samuel Clay
12891aabcf Let's try using dates again in feed fetching existance checks. 2010-12-16 17:25:51 -05:00
Samuel Clay
6d8c34c752 Are story dates the problem? 2010-12-16 17:16:09 -05:00
Samuel Clay
ae4646e979 Nice middle ground between guids and dates. Now only retrieving as many guids are in the feed, but then comparing them with N stories. Very old stories shouldnt change, and they'll get thwarted by an IntegrityCheck. 2010-12-16 17:10:13 -05:00
Samuel Clay
5b3f199852 OK, a bit too aggressive on the story loading. Sticking to simple queries for now. 2010-12-16 17:00:08 -05:00
Samuel Clay
86af737159 Experimental feed difference change. More expensive, but will detect when things are actually changing. 2010-12-16 16:52:00 -05:00
Samuel Clay
144b04feb6 Minor fix to feed fetching -- retry a feed with a bad HTTP status code but an OK feed link which points to a new feed address. 2010-12-10 09:32:06 -05:00
Samuel Clay
37028cc5ed Forcing unicode string on formatted log exception. 2010-12-07 23:51:58 -05:00
Samuel Clay
c5895a7065 Forcing unicode string on formatted log exception. 2010-12-07 23:45:08 -05:00
Samuel Clay
d25c2dd65f Only calculate unread scores for active feeds and active users. 2010-11-10 18:22:33 -05:00
Samuel Clay
fa663e910a Faster feed refreshing (insta-fetching) by only computing the score for the current user and leaving the other users with dirty subscriptions. 2010-11-10 18:04:17 -05:00
Samuel Clay
e7646d7e98 Adding change password to Preferences. Also changing timing for feed updates. 2010-11-08 12:09:55 -05:00
Samuel Clay
8c373c336b Deleting old read stories. 2010-11-08 11:30:06 -05:00
Samuel Clay
afa9e53a4c Forcing refresh of feed model at opportune times in the feed fetcher. 2010-11-05 23:36:00 -04:00
Samuel Clay
7ca9b2bee5 Undoing connection close on feed fetcher. If they are being tasked, they don't need to close the connection. 2010-11-05 22:12:35 -04:00
Samuel Clay
b30752a9c1 A huge slew of bug fixes related to feed fetching, missing ids, and missing feeds. 2010-11-05 20:34:17 -04:00
Samuel Clay
80fa9aa6fd Cutting unread count timeout cutoff by a half. 2010-11-05 15:06:54 -04:00
Samuel Clay
71a32b3120 Refactoring feed unread calculation to allow for timeouts. Now counts in order of last read date for subscriptions. 2010-11-05 12:53:02 -04:00
Samuel Clay
314418558d Only recalculating feed scores for active subscriptions. 2010-11-05 12:12:14 -04:00
Samuel Clay
5d4783606b Fixing feed_fetcher to not puke on its entire queue when fixing a dupe. 2010-11-03 21:41:43 -04:00
Samuel Clay
482c752ec4 Merge branch 'master' into chooser 2010-10-18 18:57:18 -04:00
Samuel Clay
34fffc6c29 Just cleaning up the feed fetcher by removing a legacy lock. 2010-10-18 18:57:07 -04:00
Samuel Clay
9b5ec6eaa2 Merge branch 'master' into chooser
Conflicts:
	apps/reader/models.py
	apps/rss_feeds/models.py
	media/css/reader.css
	media/js/newsblur/reader.js
	utils/feed_fetcher.py
2010-10-13 09:08:42 -04:00
Samuel Clay
6859224b7d Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-10-11 22:32:24 -04:00
Samuel Clay
3a51d79657 Fixing infinite mongoengine/mongodb connections by reusing the correct mongo connection (instead of creating new ones every time). 2010-10-11 13:19:42 -04:00
Samuel Clay
4cf9b05f0c Changing all datetime.datetime.now() to datetime.datetime.utcnow(). 2010-10-10 23:55:00 -04:00
Samuel Clay
48d4e69d0d Logging typo. 2010-10-08 17:23:14 -04:00
Samuel Clay
975222ca35 Feed has gone missing due to dupe delete. Don't crash. 2010-10-08 16:33:53 -04:00
Samuel Clay
50488db7ca Close the connection for every set of tasks. 2010-10-08 16:08:41 -04:00
Samuel Clay
092b560abe Merge branch 'master' into chooser 2010-10-07 19:33:39 -04:00
Samuel Clay
833cb643b6 Merging duplicate feeds on dupe feed save. 2010-10-07 19:22:58 -04:00
Samuel Clay
c2e1e82464 Small changes that are trying to root out the un-updateable feed problem. 2010-10-07 19:07:43 -04:00
Samuel Clay
103b90fd01 Stale feeds are killing me. 2010-10-06 22:43:05 -04:00
Samuel Clay
b726a40518 Fixing 302s and 301s for some feeds. 2010-10-06 22:34:28 -04:00
Samuel Clay
93121f51d0 Merge branch 'master' of github.com:samuelclay/NewsBlur into chooser 2010-10-05 19:05:23 -04:00
Samuel Clay
59b32e6248 Further fixing feed fetching errors by retrying feeds [nearly] immediately when they can be corrected by visiting the feed's site and finding the correct RSS feed. 2010-10-03 22:38:53 -04:00
Samuel Clay
92cff79403 Finally fixed the damn feed error updating issues. Due to the way Django caches ORM models, at the very end of all the feed error checking, the old values would be saved. 2010-10-03 19:05:16 -04:00
Samuel Clay
a1bf92ed93 Refetching 301s and 302s. 2010-10-03 18:19:23 -04:00
Samuel Clay
70e6d71c1e Refetching 301s and 302s. 2010-10-03 18:16:32 -04:00
Samuel Clay
39d9e13449 Forcing refresh of feed information at every stage of feed fetch pipeline. This really needs a rewrite. Someday. 2010-10-03 18:04:40 -04:00
Samuel Clay
2fad7b512c OK, made feed fetching stateless with regardless to the feed information between processor and dispatcher. It now updates. 2010-10-03 17:53:35 -04:00
Samuel Clay
f56629363b Passing the modified feed between processor and dispatcher, to ensure they have the correct daata. Maybe make this stateless with an extra call between passes? 2010-10-03 17:50:27 -04:00
Samuel Clay
fe152e8d38 Forcing new feeds that have issues to save their issues. Some feeds were perpetually unfetched. 2010-10-03 17:48:44 -04:00
Samuel Clay
808df31f7f Forcing new feeds that have issues to save their issues. Some feeds were perpetually unfetched. 2010-10-03 17:22:58 -04:00
Samuel Clay
00875c8991 Setting last_update date even for feeds with 304s, 400s, and 500s. Still updated, just no new stories. 2010-10-02 17:06:36 -04:00
Samuel Clay
3dd5dd9d8b Merge branch 'master' of github.com:samuelclay/NewsBlur into chooser 2010-09-29 09:49:46 -04:00
Samuel Clay
6260df43e9 Only using story_guids when checking for existing copies of stories. The timezone issues make using the date a bit hairy. 2010-09-28 20:43:12 -04:00
Samuel Clay
23976bdcfd Merge branch 'master' into chooser 2010-09-27 19:18:40 -04:00
Samuel Clay
7dee2103a9 Refactoring timelimit to add feed address re-check to a limited timeout. 2010-09-27 11:44:23 -04:00