80 commits

Author	SHA1	Message	Date
Samuel Clay	246d3273dc	Manage feed style enhancements. Also statistics.	2010-07-30 17:12:20 -04:00
Samuel Clay	2a41bdcb65	IntegrityError error in the feed fetcher.	2010-07-28 19:05:03 -04:00
Samuel Clay	7b7475ac70	Adding feed update stats to stats modal.	2010-07-28 01:14:25 -04:00
Samuel Clay	3c6fdfdea7	Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished).	2010-07-25 23:13:27 -04:00
Samuel Clay	cfd807fa10	Updating feed error codes. Accidentally deleted the 200 OK feed fetch history.	2010-07-23 18:56:29 -04:00
Samuel Clay	2f86bbbb24	Fixing bad page URLs to use the feed fetcher to find the correct address.	2010-07-21 12:29:09 -04:00
Samuel Clay	2c0b78a319	Adding page fetching history. Also denormaling story authors.	2010-07-08 11:37:54 -04:00
Samuel Clay	b205536ab7	Trickling down errors in feed fetching.	2010-07-08 01:26:03 -04:00
Samuel Clay	671121b29c	Fixing broken Last Modified Date bug which causes all stories to be discarded.	2010-07-08 01:07:37 -04:00
Samuel Clay	fab14fae46	Refactoring feed fetching so some feeds will be correctly parsed. Also updated unit tests to include invalid XML.	2010-07-07 18:40:19 -04:00
Samuel Clay	2e15f84a0d	Additional instrumentation on feed fetching, parsing, and importing.	2010-07-06 18:16:41 -04:00
Samuel Clay	08ef889e09	Feed fetch history instrumentation.	2010-07-06 13:21:12 -04:00
Samuel Clay	d3935212a4	Preventing dud feeds to pause the whole feed refresher.	2010-07-05 23:19:07 -04:00
Samuel Clay	c9fd6b5c80	Preventing dud feeds to pause the whole feed refresher.	2010-07-05 23:17:36 -04:00
Samuel Clay	d5cbd1ad29	Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work	2010-07-05 23:06:37 -04:00
Samuel Clay	1c42a7088d	A number of aesthetic changes that make signup and login sharper.	2010-07-05 22:15:09 -04:00
Samuel Clay	013cf7ab04	I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so).	2010-07-05 14:26:35 -04:00
Samuel Clay	9867406ca2	Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds.	2010-07-02 15:49:08 -04:00
Samuel Clay	2133ee81e7	Fixing issues with feature paging. JSON was incorrectly serializing it, the page_counter was being reset when feeds were loaded, and cleaned up feed resetting.	2010-07-02 12:02:10 -04:00
Samuel Clay	aaf68f4c21	Fetching page for high-volume feeds on every fetch instead of only when new stories are in the feed.	2010-07-02 11:46:45 -04:00
Samuel Clay	5b1bb231ef	Removing unnecessary cruft above the page importer.	2010-07-01 17:33:58 -04:00
Samuel Clay	4b57a32c0c	Removing 2 bigger JOINs that were slowing down feed loading.	2010-07-01 15:16:33 -04:00
Samuel Clay	113a4e058c	Adding a Delete This Site manage menu item, complete with cancel button.	2010-07-01 00:29:26 -04:00
Samuel Clay	80bdb79bd9	Better instrumentation through non-zero results on any successfull callback.	2010-06-28 08:06:12 -04:00
Samuel Clay	3d4cf207d3	Adding a feed punishment for slow feeds. Slow feeds get updated less often.	2010-06-24 15:27:25 -04:00
Samuel Clay	cc8beb2379	Fixing caching of feed stories so they load faster.	2010-06-24 15:10:15 -04:00
Samuel Clay	fbe1367739	Protopub -> NewsBlur	2010-06-08 11:19:07 -04:00
Samuel Clay	d39dacb592	Cleanup in prep for move from urllib to eventlets.	2010-05-20 15:13:25 -04:00
Samuel Clay	3ca7fcefca	That mass renames continue! Protoread is now Protopub, and that sounds good to me.	2010-05-14 09:32:38 -04:00
Samuel Clay	b1ac2147ba	Renaming News Blur to Protoread.	2010-05-13 11:11:01 -04:00
Samuel Clay	0176308858	Stylistic changes, like the name of the site: NewsBlur is now News Blur.	2010-05-11 18:38:32 -04:00
Samuel Clay	ce0495002e	Adding load time to feeds to punish slow feeds.	2010-04-29 13:35:46 -04:00
Samuel Clay	8d07355bba	Story guid hashing and a few small fixes for feed fetching.	2010-04-29 11:18:49 -04:00
Samuel Clay	2c6433b0de	Parallelizing feed fetcher now recognizes other feed fetchers so they do not replicate work. Now multi-threaded and multi-processed aware	2010-04-27 13:44:53 -04:00
Samuel Clay	722a3f7031	Fixing BAD bug around data integrity for adding then deleting feeds. Also added a return button handler to add feeds, and disabled the manage button when necessary.	2010-04-25 18:32:02 -04:00
Samuel Clay	0a664b44a8	Adding feed update history. Gotta get some metrics on the speed of the biggest cpu/network suck.	2010-04-23 21:19:19 -04:00
Samuel Clay	37743431be	What was I smoking? Way too exaggerated behavior.	2010-04-23 20:52:04 -04:00
Samuel Clay	fe7d889a12	Toning down the regularity of updating feeds by a half.	2010-04-23 10:49:17 -04:00
Samuel Clay	144bd35be4	Fixing trace errors.	2010-04-19 12:44:49 -04:00
Samuel Clay	4b828865e3	Fixing trace errors.	2010-04-19 12:43:01 -04:00
Samuel Clay	84a1c8c5b1	Fixing trace errors.	2010-04-19 12:42:32 -04:00
Samuel Clay	fc82492cee	Fixing trace errors.	2010-04-19 12:38:55 -04:00
Samuel Clay	3621010616	Fixing trace errors.	2010-04-19 12:37:53 -04:00
Samuel Clay	330a09a645	Fixing trace errors.	2010-04-19 12:37:15 -04:00
Samuel Clay	3699ab1bd1	Fixing trace errors.	2010-04-19 12:35:59 -04:00
Samuel Clay	c1c36ad182	Moving story counter out of the feed fetcher. Will run nightly.	2010-04-19 12:18:40 -04:00
Samuel Clay	71b746a48d	Feed update cascading. Feeds update relative to how often they have new content. This should save a LOT of processing power. Whew.	2010-04-19 12:09:04 -04:00
Samuel Clay	f169569710	Adding single threaded feed updating (used for tests and debugging)	2010-04-09 16:37:19 -04:00
Samuel Clay	a2458f0973	Add feed and Add folder. Dynamically loads and refreshes, too.	2010-04-06 20:41:00 -04:00
Samuel Clay	73e269ebb1	Styling changes to logging.	2010-04-06 16:56:47 -04:00