Commit graph

525 commits

Author SHA1 Message Date
Samuel Clay
f879985946 Merge branch 'master' of github.com:samuelclay/NewsBlur into exceptions 2010-08-25 19:37:00 -04:00
Samuel Clay
49d8b6d505 Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies. 2010-08-25 19:10:55 -04:00
Samuel Clay
bfa01bede2 New informational message. 2010-08-25 14:54:28 -04:00
Samuel Clay
389157e2f0 Fixing invalid feed tags. 2010-08-24 16:22:12 -04:00
Samuel Clay
0deb0aff2f Fixing invalid feed tags. 2010-08-24 16:19:09 -04:00
Samuel Clay
538854f8e4 Fixing invalid feed tags. 2010-08-24 16:14:56 -04:00
Samuel Clay
d90f1791e1 Refactored a bit here and there. The real changes are coming tonight. 2010-08-23 21:04:51 -04:00
Samuel Clay
fc16a1b8a9 Small refactor on names and amalgamated methods. 2010-08-23 09:55:21 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
fa3be28b43 Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs. 2010-08-21 13:57:49 -04:00
Samuel Clay
03fc6aa2ad Single threaded feed fetch on adding feeds. 2010-08-19 20:06:20 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
5e438ac439 Coercing errors into integers. Doh. 2010-08-18 22:06:56 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
f7574e6d11 Tweaks to fetching times. This will buy me about 3 days to figure out how to scale. 2010-08-16 17:51:15 -04:00
Samuel Clay
bbc15f4fbd Story count histories. +migrations 2010-08-13 11:03:07 -04:00
Samuel Clay
d4f30d8236 Finishing up statistics graphs. Using Flot instead of Raphael. Added a migration to change how stories are counted. 2010-08-13 10:43:48 -04:00
Samuel Clay
aeda525b55 1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list. 2010-08-09 20:44:46 -04:00
Samuel Clay
4fe631788e Handling overly long story titles. 2010-08-04 18:55:52 -04:00
Samuel Clay
5cb7d1509a Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now. 2010-08-04 18:30:51 -04:00
Samuel Clay
da1bb81cd2 Updated Trainer. Now comes with a full tutorial and resized modals. 2010-08-01 23:47:45 -04:00
Samuel Clay
c692d7d913 Bigrams and Trigrams for collocation search. 2010-07-27 23:29:04 -04:00
Samuel Clay
273ce8d41f Collocations of phrases in feeds. Doesn't save, but can be extracted. 2010-07-27 22:53:30 -04:00
Samuel Clay
d9bdd6d2c2 Removing the feed collocations model until needed. 2010-07-27 22:37:52 -04:00
Samuel Clay
5e42e3db9c Unicode decode error in url normalization. 2010-07-27 22:27:32 -04:00
Samuel Clay
db4776f3ea Adding URL normalization on new feeds. Also adding in collocation search backend. This is a good example of poor committing. 2010-07-27 22:11:23 -04:00
Samuel Clay
65e5b0dada Rudimentary statistics modals. There's more data coming in, but I'm too excited to work on the collocation phrase filter to finish this out. It'll get done, but for now it's functional. 2010-07-26 22:21:58 -04:00
Samuel Clay
3c6fdfdea7 Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished). 2010-07-25 23:13:27 -04:00
Samuel Clay
edf58ea631 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-07-21 23:27:13 -04:00
Samuel Clay
d24fdf2388 New larger manage menu for managing feeds in the Reader. 2010-07-21 23:22:27 -04:00
Samuel Clay
06fdef9e5e Deduping feeds. Recursively switches all users and read stories and subscriptions to use the original, non-duplicate feed. 2010-07-20 22:57:18 -04:00
Samuel Clay
eb8f513d1a Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-07-20 20:27:28 -04:00
Samuel Clay
f6ff242457 Keeping track of feed opens. This will go into statistics later. 2010-07-20 20:23:49 -04:00
Samuel Clay
fab79bb082 Truncating long feed taglines. 2010-07-19 14:29:27 -04:00
Samuel Clay
2c0b78a319 Adding page fetching history. Also denormaling story authors. 2010-07-08 11:37:54 -04:00
Samuel Clay
2e15f84a0d Additional instrumentation on feed fetching, parsing, and importing. 2010-07-06 18:16:41 -04:00
Samuel Clay
08ef889e09 Feed fetch history instrumentation. 2010-07-06 13:21:12 -04:00
Samuel Clay
c9fd6b5c80 Preventing dud feeds to pause the whole feed refresher. 2010-07-05 23:17:36 -04:00
Samuel Clay
d5cbd1ad29 Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work 2010-07-05 23:06:37 -04:00
Samuel Clay
013cf7ab04 I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so). 2010-07-05 14:26:35 -04:00
Samuel Clay
9867406ca2 Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds. 2010-07-02 15:49:08 -04:00
Samuel Clay
7485d1a3a0 Handling the invalid empty case on popular tags and authors. 2010-07-01 15:20:38 -04:00
Samuel Clay
4b57a32c0c Removing 2 bigger JOINs that were slowing down feed loading. 2010-07-01 15:16:33 -04:00
Samuel Clay
8052d8b1c1 Fixing tag truncation bug. Lots of tags? Truncate 'em 2010-06-29 09:01:30 -04:00
Samuel Clay
9f2b132096 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-06-28 16:57:28 -04:00