Commit graph

216 commits

Author SHA1 Message Date
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
fa3be28b43 Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs. 2010-08-21 13:57:49 -04:00
Samuel Clay
03fc6aa2ad Single threaded feed fetch on adding feeds. 2010-08-19 20:06:20 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
5e438ac439 Coercing errors into integers. Doh. 2010-08-18 22:06:56 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
f7574e6d11 Tweaks to fetching times. This will buy me about 3 days to figure out how to scale. 2010-08-16 17:51:15 -04:00
Samuel Clay
bbc15f4fbd Story count histories. +migrations 2010-08-13 11:03:07 -04:00
Samuel Clay
d4f30d8236 Finishing up statistics graphs. Using Flot instead of Raphael. Added a migration to change how stories are counted. 2010-08-13 10:43:48 -04:00
Samuel Clay
aeda525b55 1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list. 2010-08-09 20:44:46 -04:00
Samuel Clay
4fe631788e Handling overly long story titles. 2010-08-04 18:55:52 -04:00
Samuel Clay
5cb7d1509a Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now. 2010-08-04 18:30:51 -04:00
Samuel Clay
da1bb81cd2 Updated Trainer. Now comes with a full tutorial and resized modals. 2010-08-01 23:47:45 -04:00
Samuel Clay
c692d7d913 Bigrams and Trigrams for collocation search. 2010-07-27 23:29:04 -04:00
Samuel Clay
273ce8d41f Collocations of phrases in feeds. Doesn't save, but can be extracted. 2010-07-27 22:53:30 -04:00
Samuel Clay
d9bdd6d2c2 Removing the feed collocations model until needed. 2010-07-27 22:37:52 -04:00
Samuel Clay
5e42e3db9c Unicode decode error in url normalization. 2010-07-27 22:27:32 -04:00
Samuel Clay
db4776f3ea Adding URL normalization on new feeds. Also adding in collocation search backend. This is a good example of poor committing. 2010-07-27 22:11:23 -04:00
Samuel Clay
65e5b0dada Rudimentary statistics modals. There's more data coming in, but I'm too excited to work on the collocation phrase filter to finish this out. It'll get done, but for now it's functional. 2010-07-26 22:21:58 -04:00
Samuel Clay
3c6fdfdea7 Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished). 2010-07-25 23:13:27 -04:00
Samuel Clay
edf58ea631 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-07-21 23:27:13 -04:00
Samuel Clay
d24fdf2388 New larger manage menu for managing feeds in the Reader. 2010-07-21 23:22:27 -04:00
Samuel Clay
06fdef9e5e Deduping feeds. Recursively switches all users and read stories and subscriptions to use the original, non-duplicate feed. 2010-07-20 22:57:18 -04:00
Samuel Clay
eb8f513d1a Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-07-20 20:27:28 -04:00
Samuel Clay
f6ff242457 Keeping track of feed opens. This will go into statistics later. 2010-07-20 20:23:49 -04:00
Samuel Clay
fab79bb082 Truncating long feed taglines. 2010-07-19 14:29:27 -04:00
Samuel Clay
2c0b78a319 Adding page fetching history. Also denormaling story authors. 2010-07-08 11:37:54 -04:00
Samuel Clay
2e15f84a0d Additional instrumentation on feed fetching, parsing, and importing. 2010-07-06 18:16:41 -04:00
Samuel Clay
08ef889e09 Feed fetch history instrumentation. 2010-07-06 13:21:12 -04:00
Samuel Clay
c9fd6b5c80 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:17:36 -04:00
Samuel Clay
d5cbd1ad29 Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work 2010-07-05 23:06:37 -04:00
Samuel Clay
013cf7ab04 I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so). 2010-07-05 14:26:35 -04:00
Samuel Clay
9867406ca2 Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds. 2010-07-02 15:49:08 -04:00
Samuel Clay
7485d1a3a0 Handling the invalid empty case on popular tags and authors. 2010-07-01 15:20:38 -04:00
Samuel Clay
4b57a32c0c Removing 2 bigger JOINs that were slowing down feed loading. 2010-07-01 15:16:33 -04:00
Samuel Clay
8052d8b1c1 Fixing tag truncation bug. Lots of tags? Truncate 'em 2010-06-29 09:01:30 -04:00
Samuel Clay
9f2b132096 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-06-28 16:57:28 -04:00
Samuel Clay
7212778d7c More tweaking to feed refresh rate: Higher volume = more fetches 2010-06-28 11:37:54 -04:00
Samuel Clay
80bdb79bd9 Better instrumentation through non-zero results on any successfull callback. 2010-06-28 08:06:12 -04:00
Samuel Clay
9a8d85dee2 Pretty printing for subscriber counts. 2010-06-27 23:16:47 -04:00
Samuel Clay
98620bebf0 Divide by zero! Fixed. 2010-06-27 23:09:43 -04:00
Samuel Clay
2116692834 Major tweaks to feed update timing. Heavily updated feeds get updated *much* more often, and more subscribers = more updates. 2010-06-27 22:58:45 -04:00
Samuel Clay
c7488752df Fixing missing page_data errors. 2010-06-27 22:40:22 -04:00
Samuel Clay
118f4ec8ec Adding a subscriber bonus. Heavily subscribed feeds get updated more often. 2010-06-27 21:44:35 -04:00
Samuel Clay
1914651425 Calculate number of feed subscribers. Will be used to calculate feed update priority. 2010-06-27 20:43:17 -04:00
Samuel Clay
3d4cf207d3 Adding a feed punishment for slow feeds. Slow feeds get updated less often. 2010-06-24 15:27:25 -04:00