Samuel Clay
|
afa9e53a4c
|
Forcing refresh of feed model at opportune times in the feed fetcher.
|
2010-11-05 23:36:00 -04:00 |
|
Samuel Clay
|
7ca9b2bee5
|
Undoing connection close on feed fetcher. If they are being tasked, they don't need to close the connection.
|
2010-11-05 22:12:35 -04:00 |
|
Samuel Clay
|
b30752a9c1
|
A huge slew of bug fixes related to feed fetching, missing ids, and missing feeds.
|
2010-11-05 20:34:17 -04:00 |
|
Samuel Clay
|
80fa9aa6fd
|
Cutting unread count timeout cutoff by a half.
|
2010-11-05 15:06:54 -04:00 |
|
Samuel Clay
|
71a32b3120
|
Refactoring feed unread calculation to allow for timeouts. Now counts in order of last read date for subscriptions.
|
2010-11-05 12:53:02 -04:00 |
|
Samuel Clay
|
314418558d
|
Only recalculating feed scores for active subscriptions.
|
2010-11-05 12:12:14 -04:00 |
|
Samuel Clay
|
5d4783606b
|
Fixing feed_fetcher to not puke on its entire queue when fixing a dupe.
|
2010-11-03 21:41:43 -04:00 |
|
Samuel Clay
|
482c752ec4
|
Merge branch 'master' into chooser
|
2010-10-18 18:57:18 -04:00 |
|
Samuel Clay
|
34fffc6c29
|
Just cleaning up the feed fetcher by removing a legacy lock.
|
2010-10-18 18:57:07 -04:00 |
|
Samuel Clay
|
9b5ec6eaa2
|
Merge branch 'master' into chooser
Conflicts:
apps/reader/models.py
apps/rss_feeds/models.py
media/css/reader.css
media/js/newsblur/reader.js
utils/feed_fetcher.py
|
2010-10-13 09:08:42 -04:00 |
|
Samuel Clay
|
6859224b7d
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-10-11 22:32:24 -04:00 |
|
Samuel Clay
|
3a51d79657
|
Fixing infinite mongoengine/mongodb connections by reusing the correct mongo connection (instead of creating new ones every time).
|
2010-10-11 13:19:42 -04:00 |
|
Samuel Clay
|
4cf9b05f0c
|
Changing all datetime.datetime.now() to datetime.datetime.utcnow().
|
2010-10-10 23:55:00 -04:00 |
|
Samuel Clay
|
48d4e69d0d
|
Logging typo.
|
2010-10-08 17:23:14 -04:00 |
|
Samuel Clay
|
975222ca35
|
Feed has gone missing due to dupe delete. Don't crash.
|
2010-10-08 16:33:53 -04:00 |
|
Samuel Clay
|
50488db7ca
|
Close the connection for every set of tasks.
|
2010-10-08 16:08:41 -04:00 |
|
Samuel Clay
|
092b560abe
|
Merge branch 'master' into chooser
|
2010-10-07 19:33:39 -04:00 |
|
Samuel Clay
|
833cb643b6
|
Merging duplicate feeds on dupe feed save.
|
2010-10-07 19:22:58 -04:00 |
|
Samuel Clay
|
c2e1e82464
|
Small changes that are trying to root out the un-updateable feed problem.
|
2010-10-07 19:07:43 -04:00 |
|
Samuel Clay
|
103b90fd01
|
Stale feeds are killing me.
|
2010-10-06 22:43:05 -04:00 |
|
Samuel Clay
|
b726a40518
|
Fixing 302s and 301s for some feeds.
|
2010-10-06 22:34:28 -04:00 |
|
Samuel Clay
|
93121f51d0
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into chooser
|
2010-10-05 19:05:23 -04:00 |
|
Samuel Clay
|
59b32e6248
|
Further fixing feed fetching errors by retrying feeds [nearly] immediately when they can be corrected by visiting the feed's site and finding the correct RSS feed.
|
2010-10-03 22:38:53 -04:00 |
|
Samuel Clay
|
92cff79403
|
Finally fixed the damn feed error updating issues. Due to the way Django caches ORM models, at the very end of all the feed error checking, the old values would be saved.
|
2010-10-03 19:05:16 -04:00 |
|
Samuel Clay
|
a1bf92ed93
|
Refetching 301s and 302s.
|
2010-10-03 18:19:23 -04:00 |
|
Samuel Clay
|
70e6d71c1e
|
Refetching 301s and 302s.
|
2010-10-03 18:16:32 -04:00 |
|
Samuel Clay
|
39d9e13449
|
Forcing refresh of feed information at every stage of feed fetch pipeline. This really needs a rewrite. Someday.
|
2010-10-03 18:04:40 -04:00 |
|
Samuel Clay
|
2fad7b512c
|
OK, made feed fetching stateless with regardless to the feed information between processor and dispatcher. It now updates.
|
2010-10-03 17:53:35 -04:00 |
|
Samuel Clay
|
f56629363b
|
Passing the modified feed between processor and dispatcher, to ensure they have the correct daata. Maybe make this stateless with an extra call between passes?
|
2010-10-03 17:50:27 -04:00 |
|
Samuel Clay
|
fe152e8d38
|
Forcing new feeds that have issues to save their issues. Some feeds were perpetually unfetched.
|
2010-10-03 17:48:44 -04:00 |
|
Samuel Clay
|
808df31f7f
|
Forcing new feeds that have issues to save their issues. Some feeds were perpetually unfetched.
|
2010-10-03 17:22:58 -04:00 |
|
Samuel Clay
|
00875c8991
|
Setting last_update date even for feeds with 304s, 400s, and 500s. Still updated, just no new stories.
|
2010-10-02 17:06:36 -04:00 |
|
Samuel Clay
|
3dd5dd9d8b
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into chooser
|
2010-09-29 09:49:46 -04:00 |
|
Samuel Clay
|
6260df43e9
|
Only using story_guids when checking for existing copies of stories. The timezone issues make using the date a bit hairy.
|
2010-09-28 20:43:12 -04:00 |
|
Samuel Clay
|
23976bdcfd
|
Merge branch 'master' into chooser
|
2010-09-27 19:18:40 -04:00 |
|
Samuel Clay
|
7dee2103a9
|
Refactoring timelimit to add feed address re-check to a limited timeout.
|
2010-09-27 11:44:23 -04:00 |
|
Samuel Clay
|
e4c00a77a8
|
Feeds get auto-selected in feed chooser by priority. Unfortunately, it prioritizes incorrectly right now by using the minimum cutoff in a non-stable sort.
|
2010-09-24 18:22:12 -04:00 |
|
Samuel Clay
|
bc7accc593
|
Trimming feeds on every update.
|
2010-09-22 15:57:55 -04:00 |
|
Samuel Clay
|
402ef2db2e
|
Deleting old stories just for the specific feed.
|
2010-09-22 11:15:56 -04:00 |
|
Samuel Clay
|
744745b3ee
|
Hiding Delete Folder so I can get these folder actions shipped. Also improving performance of feed fetcher.
|
2010-09-21 18:58:21 -04:00 |
|
Samuel Clay
|
b9cbf6a71e
|
Deleting old read stories and speeding up computing feed scores by caching stories to search through.
|
2010-09-19 11:30:18 -04:00 |
|
Samuel Clay
|
ba3e75ba3f
|
Whoops, sometimes there is no etag.
|
2010-09-17 13:24:23 -04:00 |
|
Samuel Clay
|
b61955c7f3
|
Fixing etag max_length, whcih was too short for certain websites and their giant-ass etags.
|
2010-09-17 13:06:28 -04:00 |
|
Samuel Clay
|
9792550dcc
|
Counting only active subscribers in prep for turning off feed fetching for inactive users.
|
2010-09-17 12:42:44 -04:00 |
|
Samuel Clay
|
0d5b964b38
|
Small code cleanups before relaunching story_guids unique.
|
2010-09-10 00:51:20 -07:00 |
|
Samuel Clay
|
974d5b4a58
|
Deleting stories with invalid id's.
|
2010-09-09 07:00:08 -07:00 |
|
Samuel Clay
|
15a27e840f
|
Bootstrapping mongo to use story_guids as unqiue to feeds.
|
2010-09-08 18:30:46 -07:00 |
|
Samuel Clay
|
f880739fc8
|
Setting next scheduled date on manual update.
|
2010-09-07 15:42:22 -07:00 |
|
Samuel Clay
|
b5da6eace1
|
Refactoring feed fetching logging to get to the bottom of the fetch problems.
|
2010-09-07 14:41:11 -07:00 |
|
Samuel Clay
|
a69d812629
|
Removing slow punishment for popular feeds.
|
2010-09-07 14:02:48 -07:00 |
|