Samuel Clay
|
25c0450020
|
Commenting out map/reduce statistics because mongo keeps crashing.
|
2010-08-30 13:33:29 -04:00 |
|
Samuel Clay
|
ba578804b2
|
Fixing error sin new mongo models.
|
2010-08-29 20:11:36 -04:00 |
|
Samuel Clay
|
d85194c165
|
Moving feed/page fetch histories to mongodb.
|
2010-08-29 14:32:54 -04:00 |
|
Samuel Clay
|
c9d06f9358
|
Compressing stories. Also fixing compression of feed_pages bootstrap.
|
2010-08-29 13:23:50 -04:00 |
|
Samuel Clay
|
e26ee9dbcc
|
Moving feed_pages from PostgreSQL to Mongo. Adding compression.
|
2010-08-29 12:35:09 -04:00 |
|
Samuel Clay
|
6881cf94f5
|
Map reduce for counting stories per month and saving both a per-month breakdown, preserving history of old months, and counting the average stories per month.
|
2010-08-27 19:09:47 -04:00 |
|
Samuel Clay
|
060f63f8a0
|
Myriad number of bug fixes to reduce the number of exception e-mails I get. Forbidden JSON requests now send 403s. Adding a URl no longer uses a partial URL saearch on feed_link (which would link usetoday.com -> usatoday.com/sports.xml). Also adding the model for FeedPage for mongo.
|
2010-08-27 18:35:33 -04:00 |
|
Samuel Clay
|
9ca080138e
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-26 10:04:43 -04:00 |
|
Samuel Clay
|
1444ba9a24
|
Adding granular recommendations to feed/page exceptions.
|
2010-08-26 10:04:32 -04:00 |
|
Samuel Clay
|
077fdea638
|
Fixing a common error for feeds: too many feed authors causing an error. Now correctly reducing the author list to an acceptable amount.
|
2010-08-25 21:55:22 -04:00 |
|
Samuel Clay
|
cbbe8afd58
|
Upping limits on stories.
|
2010-08-25 20:48:48 -04:00 |
|
Samuel Clay
|
04a50dcfa8
|
Adding all exception handling fields. Also using exception status in the dialog.
|
2010-08-25 20:43:35 -04:00 |
|
Samuel Clay
|
f879985946
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into exceptions
|
2010-08-25 19:37:00 -04:00 |
|
Samuel Clay
|
49d8b6d505
|
Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies.
|
2010-08-25 19:10:55 -04:00 |
|
Samuel Clay
|
bfa01bede2
|
New informational message.
|
2010-08-25 14:54:28 -04:00 |
|
Samuel Clay
|
389157e2f0
|
Fixing invalid feed tags.
|
2010-08-24 16:22:12 -04:00 |
|
Samuel Clay
|
0deb0aff2f
|
Fixing invalid feed tags.
|
2010-08-24 16:19:09 -04:00 |
|
Samuel Clay
|
538854f8e4
|
Fixing invalid feed tags.
|
2010-08-24 16:14:56 -04:00 |
|
Samuel Clay
|
d90f1791e1
|
Refactored a bit here and there. The real changes are coming tonight.
|
2010-08-23 21:04:51 -04:00 |
|
Samuel Clay
|
fc16a1b8a9
|
Small refactor on names and amalgamated methods.
|
2010-08-23 09:55:21 -04:00 |
|
Samuel Clay
|
79d1ffd5db
|
Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts.
|
2010-08-21 23:49:36 -04:00 |
|
Samuel Clay
|
b1dfdb1239
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo
|
2010-08-21 20:42:51 -04:00 |
|
Samuel Clay
|
ac53f33788
|
Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories.
|
2010-08-21 20:42:38 -04:00 |
|
Samuel Clay
|
fa3be28b43
|
Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs.
|
2010-08-21 13:57:49 -04:00 |
|
Samuel Clay
|
03fc6aa2ad
|
Single threaded feed fetch on adding feeds.
|
2010-08-19 20:06:20 -04:00 |
|
Samuel Clay
|
22071da997
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-19 19:54:47 -04:00 |
|
Samuel Clay
|
4288283c95
|
Small tweaks to feed fetching locks.
|
2010-08-19 19:54:44 -04:00 |
|
Samuel Clay
|
7e40103a4c
|
Adding a duplicate feed table so future duplicates will be caught and corrected.
|
2010-08-19 10:43:07 -04:00 |
|
Samuel Clay
|
5e438ac439
|
Coercing errors into integers. Doh.
|
2010-08-18 22:06:56 -04:00 |
|
Samuel Clay
|
8b9c28e8f8
|
Cleaning up exception handling of feeds to show to users during import.
|
2010-08-18 21:56:30 -04:00 |
|
Samuel Clay
|
68b0ae7254
|
Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement.
|
2010-08-18 20:35:45 -04:00 |
|
Samuel Clay
|
f7574e6d11
|
Tweaks to fetching times. This will buy me about 3 days to figure out how to scale.
|
2010-08-16 17:51:15 -04:00 |
|
Samuel Clay
|
bbc15f4fbd
|
Story count histories. +migrations
|
2010-08-13 11:03:07 -04:00 |
|
Samuel Clay
|
d4f30d8236
|
Finishing up statistics graphs. Using Flot instead of Raphael. Added a migration to change how stories are counted.
|
2010-08-13 10:43:48 -04:00 |
|
Samuel Clay
|
aeda525b55
|
1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list.
|
2010-08-09 20:44:46 -04:00 |
|
Samuel Clay
|
4fe631788e
|
Handling overly long story titles.
|
2010-08-04 18:55:52 -04:00 |
|
Samuel Clay
|
5cb7d1509a
|
Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now.
|
2010-08-04 18:30:51 -04:00 |
|
Samuel Clay
|
da1bb81cd2
|
Updated Trainer. Now comes with a full tutorial and resized modals.
|
2010-08-01 23:47:45 -04:00 |
|
Samuel Clay
|
c692d7d913
|
Bigrams and Trigrams for collocation search.
|
2010-07-27 23:29:04 -04:00 |
|
Samuel Clay
|
273ce8d41f
|
Collocations of phrases in feeds. Doesn't save, but can be extracted.
|
2010-07-27 22:53:30 -04:00 |
|
Samuel Clay
|
d9bdd6d2c2
|
Removing the feed collocations model until needed.
|
2010-07-27 22:37:52 -04:00 |
|
Samuel Clay
|
5e42e3db9c
|
Unicode decode error in url normalization.
|
2010-07-27 22:27:32 -04:00 |
|
Samuel Clay
|
db4776f3ea
|
Adding URL normalization on new feeds. Also adding in collocation search backend. This is a good example of poor committing.
|
2010-07-27 22:11:23 -04:00 |
|
Samuel Clay
|
65e5b0dada
|
Rudimentary statistics modals. There's more data coming in, but I'm too excited to work on the collocation phrase filter to finish this out. It'll get done, but for now it's functional.
|
2010-07-26 22:21:58 -04:00 |
|
Samuel Clay
|
3c6fdfdea7
|
Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished).
|
2010-07-25 23:13:27 -04:00 |
|
Samuel Clay
|
edf58ea631
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-07-21 23:27:13 -04:00 |
|
Samuel Clay
|
d24fdf2388
|
New larger manage menu for managing feeds in the Reader.
|
2010-07-21 23:22:27 -04:00 |
|
Samuel Clay
|
06fdef9e5e
|
Deduping feeds. Recursively switches all users and read stories and subscriptions to use the original, non-duplicate feed.
|
2010-07-20 22:57:18 -04:00 |
|
Samuel Clay
|
eb8f513d1a
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-07-20 20:27:28 -04:00 |
|
Samuel Clay
|
f6ff242457
|
Keeping track of feed opens. This will go into statistics later.
|
2010-07-20 20:23:49 -04:00 |
|