Commit graph

1452 commits

Author SHA1 Message Date
Samuel Clay
39d9e13449 Forcing refresh of feed information at every stage of feed fetch pipeline. This really needs a rewrite. Someday. 2010-10-03 18:04:40 -04:00
Samuel Clay
808df31f7f Forcing new feeds that have issues to save their issues. Some feeds were perpetually unfetched. 2010-10-03 17:22:58 -04:00
Samuel Clay
e849957a8f Changing default dates for feed models. 2010-10-02 17:16:01 -04:00
Samuel Clay
3dd5dd9d8b Merge branch 'master' of github.com:samuelclay/NewsBlur into chooser 2010-09-29 09:49:46 -04:00
Samuel Clay
1c734528de Merge branch 'master' into chooser 2010-09-29 09:19:47 -04:00
Samuel Clay
a75417d917 Fixing errors on existing story search in feed fetching. Turns out it was using the wrong story_date to quickly determine if the story is new or not. 2010-09-28 21:10:10 -04:00
Samuel Clay
2e3f7d415b Fixing celery queues and exchanges by adding explicit bindings for the new and update queues. 2010-09-28 19:50:29 -04:00
Samuel Clay
ae6ea613f1 Merge branch 'master' into chooser 2010-09-28 19:26:30 -04:00
Samuel Clay
a76719bb97 Fixing celery queues and routers to corrrectly route to new_feeds and update_feeds 2010-09-28 19:22:52 -04:00
Samuel Clay
6d20886529 Putting server and client sides together to choose feeds. 2010-09-28 18:53:57 -04:00
Samuel Clay
7ea19b9927 Stopping duplicate feeds from trying to save. 2010-09-28 05:29:40 -04:00
Samuel Clay
032505591d Explicit queue management. 2010-09-28 05:16:00 -04:00
Samuel Clay
c24a7ffc5f Handling null titles. 2010-09-28 04:57:24 -04:00
Samuel Clay
23976bdcfd Merge branch 'master' into chooser 2010-09-27 19:18:40 -04:00
Samuel Clay
7f1638e679 Adding index on feed histories, and cutting down how many errors/successes stored. 2010-09-27 19:12:17 -04:00
Samuel Clay
7dee2103a9 Refactoring timelimit to add feed address re-check to a limited timeout. 2010-09-27 11:44:23 -04:00
Samuel Clay
e4c00a77a8 Feeds get auto-selected in feed chooser by priority. Unfortunately, it prioritizes incorrectly right now by using the minimum cutoff in a non-stable sort. 2010-09-24 18:22:12 -04:00
Samuel Clay
7e5dcb188a Adding munin graphs for feed loadtimes: averages, min, and max for the past hour and day. Going to be beautiful. 2010-09-23 10:29:18 -04:00
Samuel Clay
b9bc00a024 Fixing last update dates so they are always accurate, even on feed loads. 2010-09-22 19:59:07 -04:00
Samuel Clay
6e17db8394 Cutoffs for trimming in feeds. 2010-09-22 16:22:52 -04:00
Samuel Clay
bc7accc593 Trimming feeds on every update. 2010-09-22 15:57:55 -04:00
Samuel Clay
e1c031e2fe Trimming only stories older than the 500th oldest story. 2010-09-22 15:36:20 -04:00
Samuel Clay
e0f84d7aaa Trimming only stories older than the 500th oldest story. 2010-09-22 15:34:47 -04:00
Samuel Clay
0ac758f230 Trimming more than 500 stories from feeds. One day these can remain, but for now, it's too much to handle. 2010-09-22 14:39:18 -04:00
Samuel Clay
e647edf025 Trimming more than 500 stories from feeds. One day these can remain, but for now, it's too much to handle. 2010-09-22 14:35:26 -04:00
Samuel Clay
ce28fa14a1 Turning off statistics again. It keeps locking the database very inefficiently. 2010-09-22 11:07:19 -04:00
Samuel Clay
b1096503a2 Turning on feed statistics. Don't make me regret this, Mongo. 2010-09-21 19:20:03 -04:00
Samuel Clay
2bd9f72acb Fetching feedids with folder delete. 2010-09-21 11:16:22 -04:00
Samuel Clay
7099107899 Merge branch 'master' into folder_actions 2010-09-20 19:32:17 -04:00
Samuel Clay
9d265e9db0 Adding a new queue that handles new feeds, so they can be prioritized over updating old feeds. 2010-09-20 19:22:19 -04:00
Samuel Clay
19e5ebe53b Increasing verbosity of feed fetching when forced. 2010-09-19 11:36:04 -04:00
Samuel Clay
788df86af9 Revert "Compressing page data when saving it."
This reverts commit a1227d8d1e.
2010-09-17 13:47:15 -04:00
Samuel Clay
a1227d8d1e Compressing page data when saving it. 2010-09-17 13:46:49 -04:00
Samuel Clay
ca054598b2 Handling broken dates in feeds. 2010-09-17 13:33:11 -04:00
Samuel Clay
b61955c7f3 Fixing etag max_length, whcih was too short for certain websites and their giant-ass etags. 2010-09-17 13:06:28 -04:00
Samuel Clay
d3e2c6ae1f Optimizing distribution of tasked feeds. 2010-09-17 12:53:05 -04:00
Samuel Clay
fa73da5bfc Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:51:25 -04:00
Samuel Clay
b7dc554801 Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:50:46 -04:00
Samuel Clay
9792550dcc Counting only active subscribers in prep for turning off feed fetching for inactive users. 2010-09-17 12:42:44 -04:00
Samuel Clay
154ac4d3a9 Fixing delete feeds to only delete the one feed you want to delete, not all of the others. Also fixed add URL to check more aggressively for duplicate feeds. 2010-09-14 23:47:21 -04:00
Samuel Clay
fb3b1fa260 Enforcing constraints on read stories, and fixing operational errors on merge_feeds. 2010-09-10 08:23:04 -07:00
Samuel Clay
29605c7c9e Story_guids can be unicode IDs. 2010-09-10 01:27:41 -07:00
Samuel Clay
4c268384be Story_guids can be unicode IDs. 2010-09-10 01:24:12 -07:00
Samuel Clay
3c9714c4b3 Merging feeds, handling null story_guids 2010-09-10 01:19:46 -07:00
Samuel Clay
613ace35bb Merging feeds, handling null story_guids 2010-09-10 01:18:31 -07:00
Samuel Clay
20a2420542 Merging feeds, handling null story_guids 2010-09-10 01:11:08 -07:00
Samuel Clay
5e780b0438 Merging feeds, handling null story_guids 2010-09-10 01:09:28 -07:00
Samuel Clay
b26dfa87bb Handling feed fetch unique errors. 2010-09-10 01:01:18 -07:00
Samuel Clay
0d5b964b38 Small code cleanups before relaunching story_guids unique. 2010-09-10 00:51:20 -07:00
Samuel Clay
974d5b4a58 Deleting stories with invalid id's. 2010-09-09 07:00:08 -07:00