Commit graph

89 commits

Author SHA1 Message Date
Samuel Clay
aa99517511 Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything. 2010-08-17 23:40:03 -04:00
Samuel Clay
2b8f4bff95 Normalizing logging across all views and models. 2010-08-17 17:45:51 -04:00
Samuel Clay
588207384c Logging tweaks to handle console and file handlers. 2010-08-16 12:52:39 -04:00
Samuel Clay
3df0722dcc Moving from print-based logging to python-based logging. Quite the improvement. Console/Stream output in development, logfile in production. 2010-08-15 12:04:26 -04:00
Samuel Clay
aeda525b55 1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list. 2010-08-09 20:44:46 -04:00
Samuel Clay
de18f56025 Finally fixed bozo issues. Turns out I was checking for bozo errors before checking for 304s, which would short-circuit the 500s associated with the bozo error. Doh 2010-08-04 18:51:29 -04:00
Samuel Clay
5cb7d1509a Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now. 2010-08-04 18:30:51 -04:00
Samuel Clay
0bcc3ae484 Small fixes: removing height calculation from classifier modal, adding in better logging for feed address changes, iPhone story detail view bug. 2010-08-03 21:53:08 -04:00
Samuel Clay
2fe632b4bc Closing the database connection on the parent feed fetcher so it can be re-opened by worker threads. 2010-07-30 20:04:02 -04:00
Samuel Clay
246d3273dc Manage feed style enhancements. Also statistics. 2010-07-30 17:12:20 -04:00
Samuel Clay
2a41bdcb65 IntegrityError error in the feed fetcher. 2010-07-28 19:05:03 -04:00
Samuel Clay
7b7475ac70 Adding feed update stats to stats modal. 2010-07-28 01:14:25 -04:00
Samuel Clay
3c6fdfdea7 Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished). 2010-07-25 23:13:27 -04:00
Samuel Clay
cfd807fa10 Updating feed error codes. Accidentally deleted the 200 OK feed fetch history. 2010-07-23 18:56:29 -04:00
Samuel Clay
2f86bbbb24 Fixing bad page URLs to use the feed fetcher to find the correct address. 2010-07-21 12:29:09 -04:00
Samuel Clay
2c0b78a319 Adding page fetching history. Also denormaling story authors. 2010-07-08 11:37:54 -04:00
Samuel Clay
b205536ab7 Trickling down errors in feed fetching. 2010-07-08 01:26:03 -04:00
Samuel Clay
671121b29c Fixing broken Last Modified Date bug which causes all stories to be discarded. 2010-07-08 01:07:37 -04:00
Samuel Clay
fab14fae46 Refactoring feed fetching so some feeds will be correctly parsed. Also updated unit tests to include invalid XML. 2010-07-07 18:40:19 -04:00
Samuel Clay
2e15f84a0d Additional instrumentation on feed fetching, parsing, and importing. 2010-07-06 18:16:41 -04:00
Samuel Clay
08ef889e09 Feed fetch history instrumentation. 2010-07-06 13:21:12 -04:00
Samuel Clay
d3935212a4 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:19:07 -04:00
Samuel Clay
c9fd6b5c80 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:17:36 -04:00
Samuel Clay
d5cbd1ad29 Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work 2010-07-05 23:06:37 -04:00
Samuel Clay
1c42a7088d A number of aesthetic changes that make signup and login sharper. 2010-07-05 22:15:09 -04:00
Samuel Clay
013cf7ab04 I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so). 2010-07-05 14:26:35 -04:00
Samuel Clay
9867406ca2 Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds. 2010-07-02 15:49:08 -04:00
Samuel Clay
2133ee81e7 Fixing issues with feature paging. JSON was incorrectly serializing it, the page_counter was being reset when feeds were loaded, and cleaned up feed resetting. 2010-07-02 12:02:10 -04:00
Samuel Clay
aaf68f4c21 Fetching page for high-volume feeds on every fetch instead of only when new stories are in the feed. 2010-07-02 11:46:45 -04:00
Samuel Clay
5b1bb231ef Removing unnecessary cruft above the page importer. 2010-07-01 17:33:58 -04:00
Samuel Clay
4b57a32c0c Removing 2 bigger JOINs that were slowing down feed loading. 2010-07-01 15:16:33 -04:00
Samuel Clay
113a4e058c Adding a Delete This Site manage menu item, complete with cancel button. 2010-07-01 00:29:26 -04:00
Samuel Clay
80bdb79bd9 Better instrumentation through non-zero results on any successfull callback. 2010-06-28 08:06:12 -04:00
Samuel Clay
3d4cf207d3 Adding a feed punishment for slow feeds. Slow feeds get updated less often. 2010-06-24 15:27:25 -04:00
Samuel Clay
cc8beb2379 Fixing caching of feed stories so they load faster. 2010-06-24 15:10:15 -04:00
Samuel Clay
fbe1367739 Protopub -> NewsBlur 2010-06-08 11:19:07 -04:00
Samuel Clay
d39dacb592 Cleanup in prep for move from urllib to eventlets. 2010-05-20 15:13:25 -04:00
Samuel Clay
3ca7fcefca That mass renames continue! Protoread is now Protopub, and that sounds good to me. 2010-05-14 09:32:38 -04:00
Samuel Clay
b1ac2147ba Renaming News Blur to Protoread. 2010-05-13 11:11:01 -04:00
Samuel Clay
0176308858 Stylistic changes, like the name of the site: NewsBlur is now News Blur. 2010-05-11 18:38:32 -04:00
Samuel Clay
ce0495002e Adding load time to feeds to punish slow feeds. 2010-04-29 13:35:46 -04:00
Samuel Clay
8d07355bba Story guid hashing and a few small fixes for feed fetching. 2010-04-29 11:18:49 -04:00
Samuel Clay
2c6433b0de Parallelizing feed fetcher now recognizes other feed fetchers so they do not replicate work. Now multi-threaded and multi-processed aware 2010-04-27 13:44:53 -04:00
Samuel Clay
722a3f7031 Fixing BAD bug around data integrity for adding then deleting feeds. Also added a return button handler to add feeds, and disabled the manage button when necessary. 2010-04-25 18:32:02 -04:00
Samuel Clay
0a664b44a8 Adding feed update history. Gotta get some metrics on the speed of the biggest cpu/network suck. 2010-04-23 21:19:19 -04:00
Samuel Clay
37743431be What was I smoking? Way too exaggerated behavior. 2010-04-23 20:52:04 -04:00
Samuel Clay
fe7d889a12 Toning down the regularity of updating feeds by a half. 2010-04-23 10:49:17 -04:00
Samuel Clay
144bd35be4 Fixing trace errors. 2010-04-19 12:44:49 -04:00
Samuel Clay
4b828865e3 Fixing trace errors. 2010-04-19 12:43:01 -04:00
Samuel Clay
84a1c8c5b1 Fixing trace errors. 2010-04-19 12:42:32 -04:00