Samuel Clay
|
de3f86f9c9
|
Half-way to fixing the massive story dupe bug. Removing unqiueness so i can migrate the db.
|
2010-09-08 18:48:42 -07:00 |
|
Samuel Clay
|
15a27e840f
|
Bootstrapping mongo to use story_guids as unqiue to feeds.
|
2010-09-08 18:30:46 -07:00 |
|
Samuel Clay
|
ce55dd19a8
|
Handling weird exception on bad models in merging feeds.
|
2010-09-08 17:01:17 -07:00 |
|
Samuel Clay
|
44b6606b32
|
Finalizing merge_feeds.
|
2010-09-08 16:43:00 -07:00 |
|
Samuel Clay
|
7b28861090
|
MongoDB requires integers for integers.
|
2010-09-08 16:08:01 -07:00 |
|
Samuel Clay
|
a021c71286
|
MongoDB requires integers for integers.
|
2010-09-08 16:06:27 -07:00 |
|
Samuel Clay
|
70fcab8a40
|
Off by 1 in checking for similar stories.
|
2010-09-08 16:04:12 -07:00 |
|
Samuel Clay
|
3dd61cbbc6
|
Merge feeds, now for MongoDB. Checks feed titles, taglines, and links, and then guarantees at least 3 stories are the same.
|
2010-09-08 16:00:20 -07:00 |
|
Samuel Clay
|
132c561be5
|
Queue date for feeds for better metrics.
|
2010-09-08 13:58:05 -07:00 |
|
Samuel Clay
|
2b9ec596f9
|
Adding indexes to dates on models.
|
2010-09-08 10:52:04 -07:00 |
|
Samuel Clay
|
f880739fc8
|
Setting next scheduled date on manual update.
|
2010-09-07 15:42:22 -07:00 |
|
Samuel Clay
|
b5da6eace1
|
Refactoring feed fetching logging to get to the bottom of the fetch problems.
|
2010-09-07 14:41:11 -07:00 |
|
Samuel Clay
|
a69d812629
|
Removing slow punishment for popular feeds.
|
2010-09-07 14:02:48 -07:00 |
|
Samuel Clay
|
c3921b859e
|
Last_update is now last fetch, not last modification. More accurate last updated dates in Reader.
|
2010-09-07 13:53:37 -07:00 |
|
Samuel Clay
|
5e1fa36a33
|
Removing Tag relationships.
|
2010-09-01 18:19:15 -04:00 |
|
Samuel Clay
|
30e1e032c1
|
Task feeds in a grouped list rather than individually. Saves task creation overhead.
|
2010-09-01 10:44:29 -04:00 |
|
Samuel Clay
|
976e6c2c86
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-09-01 10:38:00 -04:00 |
|
Samuel Clay
|
ab3d052065
|
Using a list of feed_pks instead of one. Less task overhead.
|
2010-09-01 10:37:58 -04:00 |
|
Samuel Clay
|
c755c9f130
|
Checking for story_content before comparing origin.
|
2010-09-01 10:37:33 -04:00 |
|
Samuel Clay
|
c42cabcae2
|
Celery options for performance.
|
2010-09-01 08:19:58 -04:00 |
|
Samuel Clay
|
b10c223f18
|
Only active feeds get updated.
|
2010-08-31 22:17:31 -04:00 |
|
Samuel Clay
|
41be0abde3
|
Moving feeds out of the queue when they get updated.
|
2010-08-31 22:04:26 -04:00 |
|
Samuel Clay
|
852b6a5441
|
Adding new celery command line option to fetch feeds. Will be used to fetch feeds on a cronjob.
|
2010-08-31 22:00:46 -04:00 |
|
Samuel Clay
|
27209c3164
|
Defining the run task for celery's refresh feeds.
|
2010-08-31 18:18:40 -04:00 |
|
Samuel Clay
|
f906513657
|
Adding celery tasks, config, and djcelery app.
|
2010-08-31 18:07:47 -04:00 |
|
Samuel Clay
|
10b1455ba3
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-31 16:34:51 -04:00 |
|
Samuel Clay
|
e2f419cb13
|
Fixing invalid string error on feed error histories.
|
2010-08-31 16:34:34 -04:00 |
|
Samuel Clay
|
1ac8402807
|
Adding indexes to feed/page fetch histories.
|
2010-08-31 08:45:35 -04:00 |
|
Samuel Clay
|
468f12e9ff
|
Adding automatic updating of feed counts even on current feeds. Also updating feeds in real-time when refresh is forced.
|
2010-08-30 22:42:44 -04:00 |
|
Samuel Clay
|
cea3bda090
|
Minor bug fixes around error catching in feed exceptions, drag-and-drop on top-level feeds, and styling of feed title buttons.
|
2010-08-30 19:57:27 -04:00 |
|
Samuel Clay
|
1cd91544c6
|
Improvements to front-end modals on exception handling, managing intelligence, and feed titles.
|
2010-08-30 18:41:53 -04:00 |
|
Samuel Clay
|
25c0450020
|
Commenting out map/reduce statistics because mongo keeps crashing.
|
2010-08-30 13:33:29 -04:00 |
|
Samuel Clay
|
ba578804b2
|
Fixing error sin new mongo models.
|
2010-08-29 20:11:36 -04:00 |
|
Samuel Clay
|
d85194c165
|
Moving feed/page fetch histories to mongodb.
|
2010-08-29 14:32:54 -04:00 |
|
Samuel Clay
|
c9d06f9358
|
Compressing stories. Also fixing compression of feed_pages bootstrap.
|
2010-08-29 13:23:50 -04:00 |
|
Samuel Clay
|
e26ee9dbcc
|
Moving feed_pages from PostgreSQL to Mongo. Adding compression.
|
2010-08-29 12:35:09 -04:00 |
|
Samuel Clay
|
6881cf94f5
|
Map reduce for counting stories per month and saving both a per-month breakdown, preserving history of old months, and counting the average stories per month.
|
2010-08-27 19:09:47 -04:00 |
|
Samuel Clay
|
060f63f8a0
|
Myriad number of bug fixes to reduce the number of exception e-mails I get. Forbidden JSON requests now send 403s. Adding a URl no longer uses a partial URL saearch on feed_link (which would link usetoday.com -> usatoday.com/sports.xml). Also adding the model for FeedPage for mongo.
|
2010-08-27 18:35:33 -04:00 |
|
Samuel Clay
|
4c52c5efb9
|
Fixing a small bug on feed exception handling where the user tries to fetch the feed_link.
|
2010-08-26 12:37:03 -04:00 |
|
Samuel Clay
|
9ca080138e
|
Merge branch 'master' of github.com:samuelclay/NewsBlur
|
2010-08-26 10:04:43 -04:00 |
|
Samuel Clay
|
1444ba9a24
|
Adding granular recommendations to feed/page exceptions.
|
2010-08-26 10:04:32 -04:00 |
|
Samuel Clay
|
077fdea638
|
Fixing a common error for feeds: too many feed authors causing an error. Now correctly reducing the author list to an acceptable amount.
|
2010-08-25 21:55:22 -04:00 |
|
Samuel Clay
|
1d077bb325
|
Merge feeds that are found to be dupes during the exception handling manual process.
|
2010-08-25 21:02:21 -04:00 |
|
Samuel Clay
|
cbbe8afd58
|
Upping limits on stories.
|
2010-08-25 20:48:48 -04:00 |
|
Samuel Clay
|
04a50dcfa8
|
Adding all exception handling fields. Also using exception status in the dialog.
|
2010-08-25 20:43:35 -04:00 |
|
Samuel Clay
|
f879985946
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into exceptions
|
2010-08-25 19:37:00 -04:00 |
|
Samuel Clay
|
49d8b6d505
|
Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies.
|
2010-08-25 19:10:55 -04:00 |
|
Samuel Clay
|
bfa01bede2
|
New informational message.
|
2010-08-25 14:54:28 -04:00 |
|
Samuel Clay
|
e01bb9eb74
|
Exception modal now has delete and retry options that work. Change feed link/address are still in the works, but they show up. (Buttons don't do anything yet.)
|
2010-08-25 10:18:08 -04:00 |
|
Samuel Clay
|
389157e2f0
|
Fixing invalid feed tags.
|
2010-08-24 16:22:12 -04:00 |
|