Samuel Clay
|
20a2420542
|
Merging feeds, handling null story_guids
|
2010-09-10 01:11:08 -07:00 |
|
Samuel Clay
|
5e780b0438
|
Merging feeds, handling null story_guids
|
2010-09-10 01:09:28 -07:00 |
|
Samuel Clay
|
b26dfa87bb
|
Handling feed fetch unique errors.
|
2010-09-10 01:01:18 -07:00 |
|
Samuel Clay
|
0d5b964b38
|
Small code cleanups before relaunching story_guids unique.
|
2010-09-10 00:51:20 -07:00 |
|
Samuel Clay
|
974d5b4a58
|
Deleting stories with invalid id's.
|
2010-09-09 07:00:08 -07:00 |
|
Samuel Clay
|
de3f86f9c9
|
Half-way to fixing the massive story dupe bug. Removing unqiueness so i can migrate the db.
|
2010-09-08 18:48:42 -07:00 |
|
Samuel Clay
|
15a27e840f
|
Bootstrapping mongo to use story_guids as unqiue to feeds.
|
2010-09-08 18:30:46 -07:00 |
|
Samuel Clay
|
ce55dd19a8
|
Handling weird exception on bad models in merging feeds.
|
2010-09-08 17:01:17 -07:00 |
|
Samuel Clay
|
132c561be5
|
Queue date for feeds for better metrics.
|
2010-09-08 13:58:05 -07:00 |
|
Samuel Clay
|
2b9ec596f9
|
Adding indexes to dates on models.
|
2010-09-08 10:52:04 -07:00 |
|
Samuel Clay
|
f880739fc8
|
Setting next scheduled date on manual update.
|
2010-09-07 15:42:22 -07:00 |
|
Samuel Clay
|
b5da6eace1
|
Refactoring feed fetching logging to get to the bottom of the fetch problems.
|
2010-09-07 14:41:11 -07:00 |
|
Samuel Clay
|
a69d812629
|
Removing slow punishment for popular feeds.
|
2010-09-07 14:02:48 -07:00 |
|
Samuel Clay
|
c3921b859e
|
Last_update is now last fetch, not last modification. More accurate last updated dates in Reader.
|
2010-09-07 13:53:37 -07:00 |
|
Samuel Clay
|
5e1fa36a33
|
Removing Tag relationships.
|
2010-09-01 18:19:15 -04:00 |
|
Samuel Clay
|
976e6c2c86
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-09-01 10:38:00 -04:00 |
|
Samuel Clay
|
c755c9f130
|
Checking for story_content before comparing origin.
|
2010-09-01 10:37:33 -04:00 |
|
Samuel Clay
|
c42cabcae2
|
Celery options for performance.
|
2010-09-01 08:19:58 -04:00 |
|
Samuel Clay
|
10b1455ba3
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-31 16:34:51 -04:00 |
|
Samuel Clay
|
e2f419cb13
|
Fixing invalid string error on feed error histories.
|
2010-08-31 16:34:34 -04:00 |
|
Samuel Clay
|
1ac8402807
|
Adding indexes to feed/page fetch histories.
|
2010-08-31 08:45:35 -04:00 |
|
Samuel Clay
|
25c0450020
|
Commenting out map/reduce statistics because mongo keeps crashing.
|
2010-08-30 13:33:29 -04:00 |
|
Samuel Clay
|
ba578804b2
|
Fixing error sin new mongo models.
|
2010-08-29 20:11:36 -04:00 |
|
Samuel Clay
|
d85194c165
|
Moving feed/page fetch histories to mongodb.
|
2010-08-29 14:32:54 -04:00 |
|
Samuel Clay
|
c9d06f9358
|
Compressing stories. Also fixing compression of feed_pages bootstrap.
|
2010-08-29 13:23:50 -04:00 |
|
Samuel Clay
|
e26ee9dbcc
|
Moving feed_pages from PostgreSQL to Mongo. Adding compression.
|
2010-08-29 12:35:09 -04:00 |
|
Samuel Clay
|
6881cf94f5
|
Map reduce for counting stories per month and saving both a per-month breakdown, preserving history of old months, and counting the average stories per month.
|
2010-08-27 19:09:47 -04:00 |
|
Samuel Clay
|
060f63f8a0
|
Myriad number of bug fixes to reduce the number of exception e-mails I get. Forbidden JSON requests now send 403s. Adding a URl no longer uses a partial URL saearch on feed_link (which would link usetoday.com -> usatoday.com/sports.xml). Also adding the model for FeedPage for mongo.
|
2010-08-27 18:35:33 -04:00 |
|
Samuel Clay
|
9ca080138e
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-26 10:04:43 -04:00 |
|
Samuel Clay
|
1444ba9a24
|
Adding granular recommendations to feed/page exceptions.
|
2010-08-26 10:04:32 -04:00 |
|
Samuel Clay
|
077fdea638
|
Fixing a common error for feeds: too many feed authors causing an error. Now correctly reducing the author list to an acceptable amount.
|
2010-08-25 21:55:22 -04:00 |
|
Samuel Clay
|
cbbe8afd58
|
Upping limits on stories.
|
2010-08-25 20:48:48 -04:00 |
|
Samuel Clay
|
04a50dcfa8
|
Adding all exception handling fields. Also using exception status in the dialog.
|
2010-08-25 20:43:35 -04:00 |
|
Samuel Clay
|
f879985946
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into exceptions
|
2010-08-25 19:37:00 -04:00 |
|
Samuel Clay
|
49d8b6d505
|
Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies.
|
2010-08-25 19:10:55 -04:00 |
|
Samuel Clay
|
bfa01bede2
|
New informational message.
|
2010-08-25 14:54:28 -04:00 |
|
Samuel Clay
|
389157e2f0
|
Fixing invalid feed tags.
|
2010-08-24 16:22:12 -04:00 |
|
Samuel Clay
|
0deb0aff2f
|
Fixing invalid feed tags.
|
2010-08-24 16:19:09 -04:00 |
|
Samuel Clay
|
538854f8e4
|
Fixing invalid feed tags.
|
2010-08-24 16:14:56 -04:00 |
|
Samuel Clay
|
d90f1791e1
|
Refactored a bit here and there. The real changes are coming tonight.
|
2010-08-23 21:04:51 -04:00 |
|
Samuel Clay
|
fc16a1b8a9
|
Small refactor on names and amalgamated methods.
|
2010-08-23 09:55:21 -04:00 |
|
Samuel Clay
|
79d1ffd5db
|
Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts.
|
2010-08-21 23:49:36 -04:00 |
|
Samuel Clay
|
b1dfdb1239
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo
|
2010-08-21 20:42:51 -04:00 |
|
Samuel Clay
|
ac53f33788
|
Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories.
|
2010-08-21 20:42:38 -04:00 |
|
Samuel Clay
|
fa3be28b43
|
Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs.
|
2010-08-21 13:57:49 -04:00 |
|
Samuel Clay
|
03fc6aa2ad
|
Single threaded feed fetch on adding feeds.
|
2010-08-19 20:06:20 -04:00 |
|
Samuel Clay
|
22071da997
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-19 19:54:47 -04:00 |
|
Samuel Clay
|
4288283c95
|
Small tweaks to feed fetching locks.
|
2010-08-19 19:54:44 -04:00 |
|
Samuel Clay
|
7e40103a4c
|
Adding a duplicate feed table so future duplicates will be caught and corrected.
|
2010-08-19 10:43:07 -04:00 |
|
Samuel Clay
|
5e438ac439
|
Coercing errors into integers. Doh.
|
2010-08-18 22:06:56 -04:00 |
|