public-mirrors/NewsBlur-viq
1
0
Fork 0
mirror of https://github.com/viq/NewsBlur.git synced 2025-04-13 09:38:09 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
667 commits 2 branches 0 tags 863 MiB
Commit graph

102 commits

Author SHA1 Message Date
Samuel Clay
49d8b6d505 Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies. 2010-08-25 19:10:55 -04:00
Samuel Clay
fc16a1b8a9 Small refactor on names and amalgamated methods. 2010-08-23 09:55:21 -04:00
Samuel Clay
d03b4b8e69 Unicode bug on html rewriting. 2010-08-23 07:58:09 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
fa3be28b43 Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs. 2010-08-21 13:57:49 -04:00
Samuel Clay
a3025a2df7 Back to square 1 on optimizing the DB queries. 2010-08-19 23:18:11 -04:00
Samuel Clay
fc18a1f19c Backwards. Just use the GUIDs of stories. This may lead to dupe-stories when the GUID changes. Ugh. 2010-08-19 22:45:44 -04:00
Samuel Clay
d6dfc25e4e Drastically simplifying SQL command to find existing stories. Removed all found GUIDs and am just using the start/end dates in the feed. 2010-08-19 22:43:49 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
53c9df0fef Going back to calculating everybody's unread counts on new stories. Way more optimized, and user experience suffers having to wait on first-load. 2010-08-18 07:46:32 -04:00
Samuel Clay
aa99517511 Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything. 2010-08-17 23:40:03 -04:00
Samuel Clay
2b8f4bff95 Normalizing logging across all views and models. 2010-08-17 17:45:51 -04:00
Samuel Clay
588207384c Logging tweaks to handle console and file handlers. 2010-08-16 12:52:39 -04:00
Samuel Clay
3df0722dcc Moving from print-based logging to python-based logging. Quite the improvement. Console/Stream output in development, logfile in production. 2010-08-15 12:04:26 -04:00
Samuel Clay
aeda525b55 1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list. 2010-08-09 20:44:46 -04:00
Samuel Clay
de18f56025 Finally fixed bozo issues. Turns out I was checking for bozo errors before checking for 304s, which would short-circuit the 500s associated with the bozo error. Doh 2010-08-04 18:51:29 -04:00
Samuel Clay
5cb7d1509a Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now. 2010-08-04 18:30:51 -04:00
Samuel Clay
0bcc3ae484 Small fixes: removing height calculation from classifier modal, adding in better logging for feed address changes, iPhone story detail view bug. 2010-08-03 21:53:08 -04:00
Samuel Clay
2fe632b4bc Closing the database connection on the parent feed fetcher so it can be re-opened by worker threads. 2010-07-30 20:04:02 -04:00
Samuel Clay
246d3273dc Manage feed style enhancements. Also statistics. 2010-07-30 17:12:20 -04:00
Samuel Clay
2a41bdcb65 IntegrityError error in the feed fetcher. 2010-07-28 19:05:03 -04:00
Samuel Clay
7b7475ac70 Adding feed update stats to stats modal. 2010-07-28 01:14:25 -04:00
Samuel Clay
3c6fdfdea7 Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished). 2010-07-25 23:13:27 -04:00
Samuel Clay
cfd807fa10 Updating feed error codes. Accidentally deleted the 200 OK feed fetch history. 2010-07-23 18:56:29 -04:00
Samuel Clay
2f86bbbb24 Fixing bad page URLs to use the feed fetcher to find the correct address. 2010-07-21 12:29:09 -04:00
Samuel Clay
2c0b78a319 Adding page fetching history. Also denormaling story authors. 2010-07-08 11:37:54 -04:00
Samuel Clay
b205536ab7 Trickling down errors in feed fetching. 2010-07-08 01:26:03 -04:00
Samuel Clay
671121b29c Fixing broken Last Modified Date bug which causes all stories to be discarded. 2010-07-08 01:07:37 -04:00
Samuel Clay
fab14fae46 Refactoring feed fetching so some feeds will be correctly parsed. Also updated unit tests to include invalid XML. 2010-07-07 18:40:19 -04:00
Samuel Clay
2e15f84a0d Additional instrumentation on feed fetching, parsing, and importing. 2010-07-06 18:16:41 -04:00
Samuel Clay
08ef889e09 Feed fetch history instrumentation. 2010-07-06 13:21:12 -04:00
Samuel Clay
d3935212a4 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:19:07 -04:00
Samuel Clay
c9fd6b5c80 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:17:36 -04:00
Samuel Clay
d5cbd1ad29 Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work 2010-07-05 23:06:37 -04:00
Samuel Clay
1c42a7088d A number of aesthetic changes that make signup and login sharper. 2010-07-05 22:15:09 -04:00
Samuel Clay
013cf7ab04 I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so). 2010-07-05 14:26:35 -04:00
Samuel Clay
9867406ca2 Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds. 2010-07-02 15:49:08 -04:00
Samuel Clay
2133ee81e7 Fixing issues with feature paging. JSON was incorrectly serializing it, the page_counter was being reset when feeds were loaded, and cleaned up feed resetting. 2010-07-02 12:02:10 -04:00
Samuel Clay
aaf68f4c21 Fetching page for high-volume feeds on every fetch instead of only when new stories are in the feed. 2010-07-02 11:46:45 -04:00
Samuel Clay
5b1bb231ef Removing unnecessary cruft above the page importer. 2010-07-01 17:33:58 -04:00
Samuel Clay
4b57a32c0c Removing 2 bigger JOINs that were slowing down feed loading. 2010-07-01 15:16:33 -04:00
Samuel Clay
113a4e058c Adding a Delete This Site manage menu item, complete with cancel button. 2010-07-01 00:29:26 -04:00
Samuel Clay
80bdb79bd9 Better instrumentation through non-zero results on any successfull callback. 2010-06-28 08:06:12 -04:00
Samuel Clay
3d4cf207d3 Adding a feed punishment for slow feeds. Slow feeds get updated less often. 2010-06-24 15:27:25 -04:00
Samuel Clay
cc8beb2379 Fixing caching of feed stories so they load faster. 2010-06-24 15:10:15 -04:00
Samuel Clay
fbe1367739 Protopub -> NewsBlur 2010-06-08 11:19:07 -04:00
Samuel Clay
d39dacb592 Cleanup in prep for move from urllib to eventlets. 2010-05-20 15:13:25 -04:00