Commit graph

799 commits

Author SHA1 Message Date
Samuel Clay
c692d7d913 Bigrams and Trigrams for collocation search. 2010-07-27 23:29:04 -04:00
Samuel Clay
273ce8d41f Collocations of phrases in feeds. Doesn't save, but can be extracted. 2010-07-27 22:53:30 -04:00
Samuel Clay
d9bdd6d2c2 Removing the feed collocations model until needed. 2010-07-27 22:37:52 -04:00
Samuel Clay
5e42e3db9c Unicode decode error in url normalization. 2010-07-27 22:27:32 -04:00
Samuel Clay
db4776f3ea Adding URL normalization on new feeds. Also adding in collocation search backend. This is a good example of poor committing. 2010-07-27 22:11:23 -04:00
Samuel Clay
65e5b0dada Rudimentary statistics modals. There's more data coming in, but I'm too excited to work on the collocation phrase filter to finish this out. It'll get done, but for now it's functional. 2010-07-26 22:21:58 -04:00
Samuel Clay
3c6fdfdea7 Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished). 2010-07-25 23:13:27 -04:00
Samuel Clay
edf58ea631 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-07-21 23:27:13 -04:00
Samuel Clay
d24fdf2388 New larger manage menu for managing feeds in the Reader. 2010-07-21 23:22:27 -04:00
Samuel Clay
06fdef9e5e Deduping feeds. Recursively switches all users and read stories and subscriptions to use the original, non-duplicate feed. 2010-07-20 22:57:18 -04:00
Samuel Clay
eb8f513d1a Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-07-20 20:27:28 -04:00
Samuel Clay
f6ff242457 Keeping track of feed opens. This will go into statistics later. 2010-07-20 20:23:49 -04:00
Samuel Clay
fab79bb082 Truncating long feed taglines. 2010-07-19 14:29:27 -04:00
Samuel Clay
2c0b78a319 Adding page fetching history. Also denormaling story authors. 2010-07-08 11:37:54 -04:00
Samuel Clay
2e15f84a0d Additional instrumentation on feed fetching, parsing, and importing. 2010-07-06 18:16:41 -04:00
Samuel Clay
08ef889e09 Feed fetch history instrumentation. 2010-07-06 13:21:12 -04:00
Samuel Clay
c9fd6b5c80 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:17:36 -04:00
Samuel Clay
d5cbd1ad29 Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work 2010-07-05 23:06:37 -04:00
Samuel Clay
013cf7ab04 I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so). 2010-07-05 14:26:35 -04:00
Samuel Clay
9867406ca2 Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds. 2010-07-02 15:49:08 -04:00
Samuel Clay
7485d1a3a0 Handling the invalid empty case on popular tags and authors. 2010-07-01 15:20:38 -04:00
Samuel Clay
4b57a32c0c Removing 2 bigger JOINs that were slowing down feed loading. 2010-07-01 15:16:33 -04:00
Samuel Clay
8052d8b1c1 Fixing tag truncation bug. Lots of tags? Truncate 'em 2010-06-29 09:01:30 -04:00
Samuel Clay
9f2b132096 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-06-28 16:57:28 -04:00
Samuel Clay
7212778d7c More tweaking to feed refresh rate: Higher volume = more fetches 2010-06-28 11:37:54 -04:00
Samuel Clay
80bdb79bd9 Better instrumentation through non-zero results on any successfull callback. 2010-06-28 08:06:12 -04:00
Samuel Clay
9a8d85dee2 Pretty printing for subscriber counts. 2010-06-27 23:16:47 -04:00
Samuel Clay
98620bebf0 Divide by zero! Fixed. 2010-06-27 23:09:43 -04:00
Samuel Clay
2116692834 Major tweaks to feed update timing. Heavily updated feeds get updated *much* more often, and more subscribers = more updates. 2010-06-27 22:58:45 -04:00
Samuel Clay
c7488752df Fixing missing page_data errors. 2010-06-27 22:40:22 -04:00
Samuel Clay
118f4ec8ec Adding a subscriber bonus. Heavily subscribed feeds get updated more often. 2010-06-27 21:44:35 -04:00
Samuel Clay
1914651425 Calculate number of feed subscribers. Will be used to calculate feed update priority. 2010-06-27 20:43:17 -04:00
Samuel Clay
3d4cf207d3 Adding a feed punishment for slow feeds. Slow feeds get updated less often. 2010-06-24 15:27:25 -04:00
Samuel Clay
cc8beb2379 Fixing caching of feed stories so they load faster. 2010-06-24 15:10:15 -04:00
Samuel Clay
fbe1367739 Protopub -> NewsBlur 2010-06-08 11:19:07 -04:00
Samuel Clay
d39dacb592 Cleanup in prep for move from urllib to eventlets. 2010-05-20 15:13:25 -04:00
Samuel Clay
3ca7fcefca That mass renames continue! Protoread is now Protopub, and that sounds good to me. 2010-05-14 09:32:38 -04:00
Samuel Clay
b1ac2147ba Renaming News Blur to Protoread. 2010-05-13 11:11:01 -04:00
Samuel Clay
50881dc8dc Fixing empty folders. 2010-05-11 22:56:37 -04:00
Samuel Clay
0176308858 Stylistic changes, like the name of the site: NewsBlur is now News Blur. 2010-05-11 18:38:32 -04:00
Samuel Clay
e4c21dd2b9 Adding intelligence classifiers now dynamically updates all stories in the feed. Looks fantastic. 2010-05-11 13:31:59 -04:00
Samuel Clay
b5edcc03d2 Fixing caching bug around new stories. New to invalidate the story cache when new stories come in. Duh. 2010-05-11 12:27:39 -04:00
Samuel Clay
e03791383a Fixing mystery bug! Safari throws a crazy bug when switching to a new feed every so often. Happens because Safari throws a scroll event when rmeoving content from an overflowed div. Ugh. 2010-04-29 19:12:18 -04:00
Samuel Clay
274312e277 Additional checks for difflib to pass. 2010-04-29 13:52:24 -04:00
Samuel Clay
ce0495002e Adding load time to feeds to punish slow feeds. 2010-04-29 13:35:46 -04:00
Samuel Clay
8d07355bba Story guid hashing and a few small fixes for feed fetching. 2010-04-29 11:18:49 -04:00
Samuel Clay
722a3f7031 Fixing BAD bug around data integrity for adding then deleting feeds. Also added a return button handler to add feeds, and disabled the manage button when necessary. 2010-04-25 18:32:02 -04:00
Samuel Clay
9790ee13a8 Calculating average time taken per feed. 2010-04-25 16:11:04 -04:00
Samuel Clay
0a664b44a8 Adding feed update history. Gotta get some metrics on the speed of the biggest cpu/network suck. 2010-04-23 21:19:19 -04:00
Samuel Clay
71b746a48d Feed update cascading. Feeds update relative to how often they have new content. This should save a LOT of processing power. Whew. 2010-04-19 12:09:04 -04:00