Commit graph

1095 commits

Author SHA1 Message Date
Samuel Clay
a412b4f33d Adding feed load counts to munin graph. 2010-09-29 12:52:08 -04:00
Samuel Clay
85d84220d7 Permissions on munin graph for loadtimes. 2010-09-29 12:49:15 -04:00
Samuel Clay
3dd5dd9d8b Merge branch 'master' of github.com:samuelclay/NewsBlur into chooser 2010-09-29 09:49:46 -04:00
Samuel Clay
6260df43e9 Only using story_guids when checking for existing copies of stories. The timezone issues make using the date a bit hairy. 2010-09-28 20:43:12 -04:00
Samuel Clay
23976bdcfd Merge branch 'master' into chooser 2010-09-27 19:18:40 -04:00
Samuel Clay
7dee2103a9 Refactoring timelimit to add feed address re-check to a limited timeout. 2010-09-27 11:44:23 -04:00
Samuel Clay
e4c00a77a8 Feeds get auto-selected in feed chooser by priority. Unfortunately, it prioritizes incorrectly right now by using the minimum cutoff in a non-stable sort. 2010-09-24 18:22:12 -04:00
Samuel Clay
7e5dcb188a Adding munin graphs for feed loadtimes: averages, min, and max for the past hour and day. Going to be beautiful. 2010-09-23 10:29:18 -04:00
Samuel Clay
bc7accc593 Trimming feeds on every update. 2010-09-22 15:57:55 -04:00
Samuel Clay
402ef2db2e Deleting old stories just for the specific feed. 2010-09-22 11:15:56 -04:00
Samuel Clay
744745b3ee Hiding Delete Folder so I can get these folder actions shipped. Also improving performance of feed fetcher. 2010-09-21 18:58:21 -04:00
Samuel Clay
7099107899 Merge branch 'master' into folder_actions 2010-09-20 19:32:17 -04:00
Samuel Clay
3839d862ac Obnoxious modal sizing issues, but the Classifier Trainer now loads feeds through AJAX when not already loaded. Used for folder actions. 2010-09-20 18:20:22 -04:00
Samuel Clay
b9cbf6a71e Deleting old read stories and speeding up computing feed scores by caching stories to search through. 2010-09-19 11:30:18 -04:00
Samuel Clay
ca054598b2 Handling broken dates in feeds. 2010-09-17 13:33:11 -04:00
Samuel Clay
ba3e75ba3f Whoops, sometimes there is no etag. 2010-09-17 13:24:23 -04:00
Samuel Clay
b61955c7f3 Fixing etag max_length, whcih was too short for certain websites and their giant-ass etags. 2010-09-17 13:06:28 -04:00
Samuel Clay
9792550dcc Counting only active subscribers in prep for turning off feed fetching for inactive users. 2010-09-17 12:42:44 -04:00
Samuel Clay
f14de2403b Proper timezone support by saving the correct date in stories. Everything is now UTC, which means I'll need to add timezone support to accounts, which won't be fun. 2010-09-16 15:37:11 -04:00
Samuel Clay
154ac4d3a9 Fixing delete feeds to only delete the one feed you want to delete, not all of the others. Also fixed add URL to check more aggressively for duplicate feeds. 2010-09-14 23:47:21 -04:00
Samuel Clay
57bc5ade0c Final bootstrap migration. 2010-09-10 11:25:48 -07:00
Samuel Clay
7c994d368a Sanity check on story.id->story_story_guid convert. 2010-09-10 09:13:55 -07:00
Samuel Clay
b26dfa87bb Handling feed fetch unique errors. 2010-09-10 01:01:18 -07:00
Samuel Clay
0d5b964b38 Small code cleanups before relaunching story_guids unique. 2010-09-10 00:51:20 -07:00
Samuel Clay
7b71419a59 Deleting stories with invalid id's. 2010-09-09 07:04:57 -07:00
Samuel Clay
5eb00257b6 Deleting stories with invalid id's. 2010-09-09 07:04:12 -07:00
Samuel Clay
3835eb9433 Deleting stories with invalid id's. 2010-09-09 07:02:03 -07:00
Samuel Clay
974d5b4a58 Deleting stories with invalid id's. 2010-09-09 07:00:08 -07:00
Samuel Clay
de3f86f9c9 Half-way to fixing the massive story dupe bug. Removing unqiueness so i can migrate the db. 2010-09-08 18:48:42 -07:00
Samuel Clay
04f511370d Creating ObjectID for mongo stories with the story_guid as the ID. 2010-09-08 18:36:43 -07:00
Samuel Clay
15a27e840f Bootstrapping mongo to use story_guids as unqiue to feeds. 2010-09-08 18:30:46 -07:00
Samuel Clay
132c561be5 Queue date for feeds for better metrics. 2010-09-08 13:58:05 -07:00
Samuel Clay
f1b928c972 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-09-08 10:52:39 -07:00
Samuel Clay
2b9ec596f9 Adding indexes to dates on models. 2010-09-08 10:52:04 -07:00
Samuel Clay
dd3269fbe4 Permissions on munin graph. 2010-09-08 13:38:58 -04:00
Samuel Clay
310dde80ef Whoops, .py, not .js. 2010-09-08 10:37:12 -07:00
Samuel Clay
b40f00637a Adding new feed fetch history munin graphs. 2010-09-08 10:33:00 -07:00
Samuel Clay
ae2fdee539 Rewinding classifiers iterator, since they are being refetched every time. 2010-09-07 17:55:40 -07:00
Samuel Clay
f880739fc8 Setting next scheduled date on manual update. 2010-09-07 15:42:22 -07:00
Samuel Clay
b5da6eace1 Refactoring feed fetching logging to get to the bottom of the fetch problems. 2010-09-07 14:41:11 -07:00
Samuel Clay
a69d812629 Removing slow punishment for popular feeds. 2010-09-07 14:02:48 -07:00
Samuel Clay
34a687716f Only closing postgres connection in multithreaded environment. 2010-09-01 15:29:35 -04:00
Samuel Clay
bd78133fa6 No longer checking for already fetched feeds. There is really no need for this anymore, since it is guaranteed that there is only one handler for each feed, thanks to celery. 2010-08-31 23:19:06 -04:00
Samuel Clay
0805c7fc04 Adding a timelimit to fetching the feed. 2010-08-31 20:17:27 -04:00
Samuel Clay
79ba0e695a Removing weird threading-style time limiting of feed fetching. 2010-08-31 08:33:18 -04:00
Samuel Clay
b4c0a49bfc Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-31 08:13:38 -04:00
Samuel Clay
985946e63b Removing timelimit from feed fetcher. This caused massive interrupts. 2010-08-31 08:13:20 -04:00
Samuel Clay
d5b8c7bea2 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-30 23:56:59 -04:00
Samuel Clay
e9f5fc3350 More .gitignore, and adding cron jobs to fetch feeds. These will be replaced by celery within the next day or two. 2010-08-30 23:56:53 -04:00
Samuel Clay
48b147751d Adding a timelimit to feed fetching. 20 seconds, that's all you got. 2010-08-30 23:55:24 -04:00