public-mirrors/NewsBlur
1
0
Fork 0
mirror of https://github.com/samuelclay/NewsBlur.git synced 2025-08-21 05:45:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
9853 commits 16 branches 13 tags 926 MiB
Commit graph

138 commits

Author SHA1 Message Date
Samuel Clay
59b32e6248 Further fixing feed fetching errors by retrying feeds [nearly] immediately when they can be corrected by visiting the feed's site and finding the correct RSS feed. 2010-10-03 22:38:53 -04:00
Samuel Clay
39d9e13449 Forcing refresh of feed information at every stage of feed fetch pipeline. This really needs a rewrite. Someday. 2010-10-03 18:04:40 -04:00
Samuel Clay
2e3f7d415b Fixing celery queues and exchanges by adding explicit bindings for the new and update queues. 2010-09-28 19:50:29 -04:00
Samuel Clay
032505591d Explicit queue management. 2010-09-28 05:16:00 -04:00
Samuel Clay
e647edf025 Trimming more than 500 stories from feeds. One day these can remain, but for now, it's too much to handle. 2010-09-22 14:35:26 -04:00
Samuel Clay
2bd9f72acb Fetching feedids with folder delete. 2010-09-21 11:16:22 -04:00
Samuel Clay
7099107899 Merge branch 'master' into folder_actions 2010-09-20 19:32:17 -04:00
Samuel Clay
9d265e9db0 Adding a new queue that handles new feeds, so they can be prioritized over updating old feeds. 2010-09-20 19:22:19 -04:00
Samuel Clay
d3e2c6ae1f Optimizing distribution of tasked feeds. 2010-09-17 12:53:05 -04:00
Samuel Clay
fa73da5bfc Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:51:25 -04:00
Samuel Clay
b7dc554801 Turning off feed fetching for feeds with no active subscribers. No way to turn them back on, but who cares? They're inactive 2010-09-17 12:50:46 -04:00
Samuel Clay
154ac4d3a9 Fixing delete feeds to only delete the one feed you want to delete, not all of the others. Also fixed add URL to check more aggressively for duplicate feeds. 2010-09-14 23:47:21 -04:00
Samuel Clay
15a27e840f Bootstrapping mongo to use story_guids as unqiue to feeds. 2010-09-08 18:30:46 -07:00
Samuel Clay
44b6606b32 Finalizing merge_feeds. 2010-09-08 16:43:00 -07:00
Samuel Clay
7b28861090 MongoDB requires integers for integers. 2010-09-08 16:08:01 -07:00
Samuel Clay
a021c71286 MongoDB requires integers for integers. 2010-09-08 16:06:27 -07:00
Samuel Clay
70fcab8a40 Off by 1 in checking for similar stories. 2010-09-08 16:04:12 -07:00
Samuel Clay
3dd61cbbc6 Merge feeds, now for MongoDB. Checks feed titles, taglines, and links, and then guarantees at least 3 stories are the same. 2010-09-08 16:00:20 -07:00
Samuel Clay
132c561be5 Queue date for feeds for better metrics. 2010-09-08 13:58:05 -07:00
Samuel Clay
30e1e032c1 Task feeds in a grouped list rather than individually. Saves task creation overhead. 2010-09-01 10:44:29 -04:00
Samuel Clay
b10c223f18 Only active feeds get updated. 2010-08-31 22:17:31 -04:00
Samuel Clay
41be0abde3 Moving feeds out of the queue when they get updated. 2010-08-31 22:04:26 -04:00
Samuel Clay
852b6a5441 Adding new celery command line option to fetch feeds. Will be used to fetch feeds on a cronjob. 2010-08-31 22:00:46 -04:00
Samuel Clay
25c0450020 Commenting out map/reduce statistics because mongo keeps crashing. 2010-08-30 13:33:29 -04:00
Samuel Clay
abe73a1d0e Barring the ability to use multiprocessing for feed fetching, in the meantime we'll have to use separate processes, which means potential for fetchin gthe same feeds. 2010-08-23 08:09:58 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
aa99517511 Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything. 2010-08-17 23:40:03 -04:00
Samuel Clay
55683fc1d5 Skipping feeds with fewer than X stories_per_month. Used to catch the queue up and toss inactive feeds. 2010-08-16 13:21:32 -04:00
Samuel Clay
588207384c Logging tweaks to handle console and file handlers. 2010-08-16 12:52:39 -04:00
Samuel Clay
20096efa1f Feed de-duplicator gracefully handles users who have erased too much. 2010-08-11 17:13:39 -04:00
Samuel Clay
7cc6681acd Trimming only feeds that were fetched once, to ensure they have stories used to compare duplicate feeds. 2010-08-11 16:43:56 -04:00
Samuel Clay
2fe632b4bc Closing the database connection on the parent feed fetcher so it can be re-opened by worker threads. 2010-07-30 20:04:02 -04:00
Samuel Clay
3c6fdfdea7 Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished). 2010-07-25 23:13:27 -04:00
Samuel Clay
31407a998f Handling anonymous users with more grace. They will now be told that they need to signup in order to add a feed/folder/opml. The old way was to show a loading indicator forever. Yeah. 2010-07-24 15:54:25 -04:00
Samuel Clay
7b655f4cc4 User stories might already exist on original feed if switching from duplicate feed. 2010-07-20 23:46:29 -04:00
Samuel Clay
95ba5fcbd8 Pass on deleted feeds. Everything will get deleted eventually. The SQL that gets this ID is a bit aggressive. 2010-07-20 23:40:52 -04:00
Samuel Clay
dd71b6ab20 Uncommented destructive methods/. Actually deleting duped feeds this time. 2010-07-20 23:30:31 -04:00
Samuel Clay
da0060fb43 Commenting out sql comments. This should have been handled. 2010-07-20 23:21:10 -04:00
Samuel Clay
e7b7036cd2 Deduping all analyzer models for multiple feeds. 2010-07-20 23:18:38 -04:00
Samuel Clay
06fdef9e5e Deduping feeds. Recursively switches all users and read stories and subscriptions to use the original, non-duplicate feed. 2010-07-20 22:57:18 -04:00
Samuel Clay
3e379edf3c Really deleting old feeds now. Turned off delete protection. 2010-07-05 22:22:15 -04:00
Samuel Clay
e13b41fa4c Deleting old feeds to which nobody is subscribed. 2010-07-05 22:17:13 -04:00
Samuel Clay
1c42a7088d A number of aesthetic changes that make signup and login sharper. 2010-07-05 22:15:09 -04:00