public-mirrors/NewsBlur
1
0
Fork 0
mirror of https://github.com/samuelclay/NewsBlur.git synced 2025-08-05 16:58:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
785 commits 16 branches 12 tags 925 MiB
Commit graph

165 commits

Author SHA1 Message Date
Samuel Clay
b61955c7f3 Fixing etag max_length, whcih was too short for certain websites and their giant-ass etags. 2010-09-17 13:06:28 -04:00
Samuel Clay
9792550dcc Counting only active subscribers in prep for turning off feed fetching for inactive users. 2010-09-17 12:42:44 -04:00
Samuel Clay
fb3b1fa260 Enforcing constraints on read stories, and fixing operational errors on merge_feeds. 2010-09-10 08:23:04 -07:00
Samuel Clay
29605c7c9e Story_guids can be unicode IDs. 2010-09-10 01:27:41 -07:00
Samuel Clay
4c268384be Story_guids can be unicode IDs. 2010-09-10 01:24:12 -07:00
Samuel Clay
3c9714c4b3 Merging feeds, handling null story_guids 2010-09-10 01:19:46 -07:00
Samuel Clay
613ace35bb Merging feeds, handling null story_guids 2010-09-10 01:18:31 -07:00
Samuel Clay
20a2420542 Merging feeds, handling null story_guids 2010-09-10 01:11:08 -07:00
Samuel Clay
5e780b0438 Merging feeds, handling null story_guids 2010-09-10 01:09:28 -07:00
Samuel Clay
b26dfa87bb Handling feed fetch unique errors. 2010-09-10 01:01:18 -07:00
Samuel Clay
0d5b964b38 Small code cleanups before relaunching story_guids unique. 2010-09-10 00:51:20 -07:00
Samuel Clay
974d5b4a58 Deleting stories with invalid id's. 2010-09-09 07:00:08 -07:00
Samuel Clay
de3f86f9c9 Half-way to fixing the massive story dupe bug. Removing unqiueness so i can migrate the db. 2010-09-08 18:48:42 -07:00
Samuel Clay
15a27e840f Bootstrapping mongo to use story_guids as unqiue to feeds. 2010-09-08 18:30:46 -07:00
Samuel Clay
ce55dd19a8 Handling weird exception on bad models in merging feeds. 2010-09-08 17:01:17 -07:00
Samuel Clay
132c561be5 Queue date for feeds for better metrics. 2010-09-08 13:58:05 -07:00
Samuel Clay
2b9ec596f9 Adding indexes to dates on models. 2010-09-08 10:52:04 -07:00
Samuel Clay
f880739fc8 Setting next scheduled date on manual update. 2010-09-07 15:42:22 -07:00
Samuel Clay
b5da6eace1 Refactoring feed fetching logging to get to the bottom of the fetch problems. 2010-09-07 14:41:11 -07:00
Samuel Clay
a69d812629 Removing slow punishment for popular feeds. 2010-09-07 14:02:48 -07:00
Samuel Clay
c3921b859e Last_update is now last fetch, not last modification. More accurate last updated dates in Reader. 2010-09-07 13:53:37 -07:00
Samuel Clay
5e1fa36a33 Removing Tag relationships. 2010-09-01 18:19:15 -04:00
Samuel Clay
976e6c2c86 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-09-01 10:38:00 -04:00
Samuel Clay
c755c9f130 Checking for story_content before comparing origin. 2010-09-01 10:37:33 -04:00
Samuel Clay
c42cabcae2 Celery options for performance. 2010-09-01 08:19:58 -04:00
Samuel Clay
10b1455ba3 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-31 16:34:51 -04:00
Samuel Clay
e2f419cb13 Fixing invalid string error on feed error histories. 2010-08-31 16:34:34 -04:00
Samuel Clay
1ac8402807 Adding indexes to feed/page fetch histories. 2010-08-31 08:45:35 -04:00
Samuel Clay
25c0450020 Commenting out map/reduce statistics because mongo keeps crashing. 2010-08-30 13:33:29 -04:00
Samuel Clay
ba578804b2 Fixing error sin new mongo models. 2010-08-29 20:11:36 -04:00
Samuel Clay
d85194c165 Moving feed/page fetch histories to mongodb. 2010-08-29 14:32:54 -04:00
Samuel Clay
c9d06f9358 Compressing stories. Also fixing compression of feed_pages bootstrap. 2010-08-29 13:23:50 -04:00
Samuel Clay
e26ee9dbcc Moving feed_pages from PostgreSQL to Mongo. Adding compression. 2010-08-29 12:35:09 -04:00
Samuel Clay
6881cf94f5 Map reduce for counting stories per month and saving both a per-month breakdown, preserving history of old months, and counting the average stories per month. 2010-08-27 19:09:47 -04:00
Samuel Clay
060f63f8a0 Myriad number of bug fixes to reduce the number of exception e-mails I get. Forbidden JSON requests now send 403s. Adding a URl no longer uses a partial URL saearch on feed_link (which would link usetoday.com -> usatoday.com/sports.xml). Also adding the model for FeedPage for mongo. 2010-08-27 18:35:33 -04:00
Samuel Clay
9ca080138e Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-26 10:04:43 -04:00
Samuel Clay
1444ba9a24 Adding granular recommendations to feed/page exceptions. 2010-08-26 10:04:32 -04:00
Samuel Clay
077fdea638 Fixing a common error for feeds: too many feed authors causing an error. Now correctly reducing the author list to an acceptable amount. 2010-08-25 21:55:22 -04:00
Samuel Clay
cbbe8afd58 Upping limits on stories. 2010-08-25 20:48:48 -04:00
Samuel Clay
04a50dcfa8 Adding all exception handling fields. Also using exception status in the dialog. 2010-08-25 20:43:35 -04:00
Samuel Clay
f879985946 Merge branch 'master' of github.com:samuelclay/NewsBlur into exceptions 2010-08-25 19:37:00 -04:00
Samuel Clay
49d8b6d505 Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies. 2010-08-25 19:10:55 -04:00
Samuel Clay
bfa01bede2 New informational message. 2010-08-25 14:54:28 -04:00
Samuel Clay
389157e2f0 Fixing invalid feed tags. 2010-08-24 16:22:12 -04:00
Samuel Clay
0deb0aff2f Fixing invalid feed tags. 2010-08-24 16:19:09 -04:00
Samuel Clay
538854f8e4 Fixing invalid feed tags. 2010-08-24 16:14:56 -04:00
Samuel Clay
d90f1791e1 Refactored a bit here and there. The real changes are coming tonight. 2010-08-23 21:04:51 -04:00
Samuel Clay
fc16a1b8a9 Small refactor on names and amalgamated methods. 2010-08-23 09:55:21 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00