public-mirrors/NewsBlur
1
0
Fork 0
mirror of https://github.com/samuelclay/NewsBlur.git synced 2025-08-21 05:45:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16108 commits 16 branches 13 tags 926 MiB
Commit graph

151 commits

Author SHA1 Message Date
Samuel Clay
09021ea08c Trying to fix stale feeds by checking for a last update of a day. 2011-02-22 09:37:09 -05:00
Samuel Clay
3723160155 A huge number of misc fixes: fixing potential errors on paypal return screen, mailing all feed/page parse errors, and swithcing to mapreduce item_frequencies in mongoengine. 2011-02-05 15:34:43 -05:00
Samuel Clay
e14ba054ad Fixing up trim feeds so we can trim old unused feeds. 2011-01-22 11:32:49 -05:00
Samuel Clay
443fe69156 Moving text fields from Feed to FeedData. Migration includes deletion of old fields on Feed, now unused. 2011-01-17 22:48:38 -05:00
Samuel Clay
4f35c2fade Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin. 2010-12-23 13:29:31 -05:00
Samuel Clay
e039d9a1bd Queueing fallen-through-the-cracks feeds appropriately, giving a day of leniency. 2010-12-23 12:39:28 -05:00
Samuel Clay
b98c63dd14 Abstracting feed queueing so I can queue a queryset of feeds from the command line. Also adding in queueing of feeds that have not been updated in a week (for those that fall through the cracks. 2010-12-23 12:32:24 -05:00
Samuel Clay
97ad4838f1 Fixing stories in tabs, and adding option to specify username for refresh_feeds, to assist in development. 2010-12-14 23:10:13 -05:00
Samuel Clay
fa663e910a Faster feed refreshing (insta-fetching) by only computing the score for the current user and leaving the other users with dirty subscriptions. 2010-11-10 18:04:17 -05:00
Samuel Clay
cbb04ba6ef Adding a few keybaord shortcuts, and adding duplicate feed counts to munin. 2010-10-12 13:17:43 -04:00
Samuel Clay
4cf9b05f0c Changing all datetime.datetime.now() to datetime.datetime.utcnow(). 2010-10-10 23:55:00 -04:00
Samuel Clay
50255cf928 Using UTCnow() for dates in marking read stories. Off by 4 hours right now. 2010-10-10 23:51:31 -04:00
Samuel Clay
50488db7ca Close the connection for every set of tasks. 2010-10-08 16:08:41 -04:00
Samuel Clay
59b32e6248 Further fixing feed fetching errors by retrying feeds [nearly] immediately when they can be corrected by visiting the feed's site and finding the correct RSS feed. 2010-10-03 22:38:53 -04:00
Samuel Clay
39d9e13449 Forcing refresh of feed information at every stage of feed fetch pipeline. This really needs a rewrite. Someday. 2010-10-03 18:04:40 -04:00
Samuel Clay
2e3f7d415b Fixing celery queues and exchanges by adding explicit bindings for the new and update queues. 2010-09-28 19:50:29 -04:00
Samuel Clay
032505591d Explicit queue management. 2010-09-28 05:16:00 -04:00
Samuel Clay
e647edf025 Trimming more than 500 stories from feeds. One day these can remain, but for now, it's too much to handle. 2010-09-22 14:35:26 -04:00
Samuel Clay
2bd9f72acb Fetching feedids with folder delete. 2010-09-21 11:16:22 -04:00
Samuel Clay
7099107899 Merge branch 'master' into folder_actions 2010-09-20 19:32:17 -04:00
Samuel Clay
9d265e9db0 Adding a new queue that handles new feeds, so they can be prioritized over updating old feeds. 2010-09-20 19:22:19 -04:00
Samuel Clay
d3e2c6ae1f Optimizing distribution of tasked feeds. 2010-09-17 12:53:05 -04:00
Samuel Clay
fa73da5bfc Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:51:25 -04:00
Samuel Clay
b7dc554801 Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:50:46 -04:00
Samuel Clay
154ac4d3a9 Fixing delete feeds to only delete the one feed you want to delete, not all of the others. Also fixed add URL to check more aggressively for duplicate feeds. 2010-09-14 23:47:21 -04:00
Samuel Clay
15a27e840f Bootstrapping mongo to use story_guids as unqiue to feeds. 2010-09-08 18:30:46 -07:00
Samuel Clay
44b6606b32 Finalizing merge_feeds. 2010-09-08 16:43:00 -07:00
Samuel Clay
7b28861090 MongoDB requires integers for integers. 2010-09-08 16:08:01 -07:00
Samuel Clay
a021c71286 MongoDB requires integers for integers. 2010-09-08 16:06:27 -07:00
Samuel Clay
70fcab8a40 Off by 1 in checking for similar stories. 2010-09-08 16:04:12 -07:00
Samuel Clay
3dd61cbbc6 Merge feeds, now for MongoDB. Checks feed titles, taglines, and links, and then guarantees at least 3 stories are the same. 2010-09-08 16:00:20 -07:00
Samuel Clay
132c561be5 Queue date for feeds for better metrics. 2010-09-08 13:58:05 -07:00
Samuel Clay
30e1e032c1 Task feeds in a grouped list rather than individually. Saves task creation overhead. 2010-09-01 10:44:29 -04:00
Samuel Clay
b10c223f18 Only active feeds get updated. 2010-08-31 22:17:31 -04:00
Samuel Clay
41be0abde3 Moving feeds out of the queue when they get updated. 2010-08-31 22:04:26 -04:00
Samuel Clay
852b6a5441 Adding new celery command line option to fetch feeds. Will be used to fetch feeds on a cronjob. 2010-08-31 22:00:46 -04:00
Samuel Clay
25c0450020 Commenting out map/reduce statistics because mongo keeps crashing. 2010-08-30 13:33:29 -04:00
Samuel Clay
abe73a1d0e Barring the ability to use multiprocessing for feed fetching, in the meantime we'll have to use separate processes, which means potential for fetchin gthe same feeds. 2010-08-23 08:09:58 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
aa99517511 Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything. 2010-08-17 23:40:03 -04:00
Samuel Clay
55683fc1d5 Skipping feeds with fewer than X stories_per_month. Used to catch the queue up and toss inactive feeds. 2010-08-16 13:21:32 -04:00
Samuel Clay
588207384c Logging tweaks to handle console and file handlers. 2010-08-16 12:52:39 -04:00
Samuel Clay
20096efa1f Feed de-duplicator gracefully handles users who have erased too much. 2010-08-11 17:13:39 -04:00