Samuel Clay
|
f0dc76b71e
|
Merging separate task feeds tasks.
|
2012-08-09 21:18:45 -07:00 |
|
Samuel Clay
|
34ad54e1f5
|
Fixing feed update times for inactive feeds to never go inadctive but to instead go into geometrically longer feed fetches.
|
2012-08-09 13:26:52 -07:00 |
|
Samuel Clay
|
cbc8df2c1c
|
Skipping feed resurrection.
|
2012-02-24 17:07:42 -08:00 |
|
Samuel Clay
|
c9cb7dcbc0
|
Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s.
|
2012-02-01 17:59:46 -08:00 |
|
Samuel Clay
|
8e2936fc1b
|
Utils -> vendor
|
2011-04-11 21:57:45 -04:00 |
|
Samuel Clay
|
1254d350d6
|
Only tasking feeds that are active. Clears the exception pile.
|
2011-04-07 12:36:38 -04:00 |
|
Samuel Clay
|
09021ea08c
|
Trying to fix stale feeds by checking for a last update of a day.
|
2011-02-22 09:37:09 -05:00 |
|
Samuel Clay
|
4f35c2fade
|
Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin.
|
2010-12-23 13:29:31 -05:00 |
|
Samuel Clay
|
e039d9a1bd
|
Queueing fallen-through-the-cracks feeds appropriately, giving a day of leniency.
|
2010-12-23 12:39:28 -05:00 |
|
Samuel Clay
|
b98c63dd14
|
Abstracting feed queueing so I can queue a queryset of feeds from the command line. Also adding in queueing of feeds that have not been updated in a week (for those that fall through the cracks.
|
2010-12-23 12:32:24 -05:00 |
|
Samuel Clay
|
cbb04ba6ef
|
Adding a few keybaord shortcuts, and adding duplicate feed counts to munin.
|
2010-10-12 13:17:43 -04:00 |
|
Samuel Clay
|
4cf9b05f0c
|
Changing all datetime.datetime.now() to datetime.datetime.utcnow().
|
2010-10-10 23:55:00 -04:00 |
|
Samuel Clay
|
59b32e6248
|
Further fixing feed fetching errors by retrying feeds [nearly] immediately when they can be corrected by visiting the feed's site and finding the correct RSS feed.
|
2010-10-03 22:38:53 -04:00 |
|
Samuel Clay
|
2e3f7d415b
|
Fixing celery queues and exchanges by adding explicit bindings for the new and update queues.
|
2010-09-28 19:50:29 -04:00 |
|
Samuel Clay
|
032505591d
|
Explicit queue management.
|
2010-09-28 05:16:00 -04:00 |
|
Samuel Clay
|
9d265e9db0
|
Adding a new queue that handles new feeds, so they can be prioritized over updating old feeds.
|
2010-09-20 19:22:19 -04:00 |
|
Samuel Clay
|
d3e2c6ae1f
|
Optimizing distribution of tasked feeds.
|
2010-09-17 12:53:05 -04:00 |
|
Samuel Clay
|
fa73da5bfc
|
Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive
|
2010-09-17 12:51:25 -04:00 |
|
Samuel Clay
|
b7dc554801
|
Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive
|
2010-09-17 12:50:46 -04:00 |
|
Samuel Clay
|
132c561be5
|
Queue date for feeds for better metrics.
|
2010-09-08 13:58:05 -07:00 |
|
Samuel Clay
|
30e1e032c1
|
Task feeds in a grouped list rather than individually. Saves task creation overhead.
|
2010-09-01 10:44:29 -04:00 |
|
Samuel Clay
|
b10c223f18
|
Only active feeds get updated.
|
2010-08-31 22:17:31 -04:00 |
|
Samuel Clay
|
41be0abde3
|
Moving feeds out of the queue when they get updated.
|
2010-08-31 22:04:26 -04:00 |
|
Samuel Clay
|
852b6a5441
|
Adding new celery command line option to fetch feeds. Will be used to fetch feeds on a cronjob.
|
2010-08-31 22:00:46 -04:00 |
|