Commit graph

23 commits

Author SHA1 Message Date
Samuel Clay
34ad54e1f5 Fixing feed update times for inactive feeds to never go inadctive but to instead go into geometrically longer feed fetches. 2012-08-09 13:26:52 -07:00
Samuel Clay
cbc8df2c1c Skipping feed resurrection. 2012-02-24 17:07:42 -08:00
Samuel Clay
c9cb7dcbc0 Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s. 2012-02-01 17:59:46 -08:00
Samuel Clay
8e2936fc1b Utils -> vendor 2011-04-11 21:57:45 -04:00
Samuel Clay
1254d350d6 Only tasking feeds that are active. Clears the exception pile. 2011-04-07 12:36:38 -04:00
Samuel Clay
09021ea08c Trying to fix stale feeds by checking for a last update of a day. 2011-02-22 09:37:09 -05:00
Samuel Clay
4f35c2fade Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin. 2010-12-23 13:29:31 -05:00
Samuel Clay
e039d9a1bd Queueing fallen-through-the-cracks feeds appropriately, giving a day of leniency. 2010-12-23 12:39:28 -05:00
Samuel Clay
b98c63dd14 Abstracting feed queueing so I can queue a queryset of feeds from the command line. Also adding in queueing of feeds that have not been updated in a week (for those that fall through the cracks. 2010-12-23 12:32:24 -05:00
Samuel Clay
cbb04ba6ef Adding a few keybaord shortcuts, and adding duplicate feed counts to munin. 2010-10-12 13:17:43 -04:00
Samuel Clay
4cf9b05f0c Changing all datetime.datetime.now() to datetime.datetime.utcnow(). 2010-10-10 23:55:00 -04:00
Samuel Clay
59b32e6248 Further fixing feed fetching errors by retrying feeds [nearly] immediately when they can be corrected by visiting the feed's site and finding the correct RSS feed. 2010-10-03 22:38:53 -04:00
Samuel Clay
2e3f7d415b Fixing celery queues and exchanges by adding explicit bindings for the new and update queues. 2010-09-28 19:50:29 -04:00
Samuel Clay
032505591d Explicit queue management. 2010-09-28 05:16:00 -04:00
Samuel Clay
9d265e9db0 Adding a new queue that handles new feeds, so they can be prioritized over updating old feeds. 2010-09-20 19:22:19 -04:00
Samuel Clay
d3e2c6ae1f Optimizing distribution of tasked feeds. 2010-09-17 12:53:05 -04:00
Samuel Clay
fa73da5bfc Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:51:25 -04:00
Samuel Clay
b7dc554801 Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:50:46 -04:00
Samuel Clay
132c561be5 Queue date for feeds for better metrics. 2010-09-08 13:58:05 -07:00
Samuel Clay
30e1e032c1 Task feeds in a grouped list rather than individually. Saves task creation overhead. 2010-09-01 10:44:29 -04:00
Samuel Clay
b10c223f18 Only active feeds get updated. 2010-08-31 22:17:31 -04:00
Samuel Clay
41be0abde3 Moving feeds out of the queue when they get updated. 2010-08-31 22:04:26 -04:00
Samuel Clay
852b6a5441 Adding new celery command line option to fetch feeds. Will be used to fetch feeds on a cronjob. 2010-08-31 22:00:46 -04:00