public-mirrors/NewsBlur-viq
1
0
Fork 0
mirror of https://github.com/viq/NewsBlur.git synced 2025-04-13 09:38:09 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
733 commits 2 branches 0 tags 863 MiB
Commit graph

147 commits

Author SHA1 Message Date
Samuel Clay
b5da6eace1 Refactoring feed fetching logging to get to the bottom of the fetch problems. 2010-09-07 14:41:11 -07:00
Samuel Clay
a69d812629 Removing slow punishment for popular feeds. 2010-09-07 14:02:48 -07:00
Samuel Clay
c3921b859e Last_update is now last fetch, not last modification. More accurate last updated dates in Reader. 2010-09-07 13:53:37 -07:00
Samuel Clay
5e1fa36a33 Removing Tag relationships. 2010-09-01 18:19:15 -04:00
Samuel Clay
976e6c2c86 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-09-01 10:38:00 -04:00
Samuel Clay
c755c9f130 Checking for story_content before comparing origin. 2010-09-01 10:37:33 -04:00
Samuel Clay
c42cabcae2 Celery options for performance. 2010-09-01 08:19:58 -04:00
Samuel Clay
10b1455ba3 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-31 16:34:51 -04:00
Samuel Clay
e2f419cb13 Fixing invalid string error on feed error histories. 2010-08-31 16:34:34 -04:00
Samuel Clay
1ac8402807 Adding indexes to feed/page fetch histories. 2010-08-31 08:45:35 -04:00
Samuel Clay
25c0450020 Commenting out map/reduce statistics because mongo keeps crashing. 2010-08-30 13:33:29 -04:00
Samuel Clay
ba578804b2 Fixing error sin new mongo models. 2010-08-29 20:11:36 -04:00
Samuel Clay
d85194c165 Moving feed/page fetch histories to mongodb. 2010-08-29 14:32:54 -04:00
Samuel Clay
c9d06f9358 Compressing stories. Also fixing compression of feed_pages bootstrap. 2010-08-29 13:23:50 -04:00
Samuel Clay
e26ee9dbcc Moving feed_pages from PostgreSQL to Mongo. Adding compression. 2010-08-29 12:35:09 -04:00
Samuel Clay
6881cf94f5 Map reduce for counting stories per month and saving both a per-month breakdown, preserving history of old months, and counting the average stories per month. 2010-08-27 19:09:47 -04:00
Samuel Clay
060f63f8a0 Myriad number of bug fixes to reduce the number of exception e-mails I get. Forbidden JSON requests now send 403s. Adding a URl no longer uses a partial URL saearch on feed_link (which would link usetoday.com -> usatoday.com/sports.xml). Also adding the model for FeedPage for mongo. 2010-08-27 18:35:33 -04:00
Samuel Clay
9ca080138e Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-26 10:04:43 -04:00
Samuel Clay
1444ba9a24 Adding granular recommendations to feed/page exceptions. 2010-08-26 10:04:32 -04:00
Samuel Clay
077fdea638 Fixing a common error for feeds: too many feed authors causing an error. Now correctly reducing the author list to an acceptable amount. 2010-08-25 21:55:22 -04:00
Samuel Clay
cbbe8afd58 Upping limits on stories. 2010-08-25 20:48:48 -04:00
Samuel Clay
04a50dcfa8 Adding all exception handling fields. Also using exception status in the dialog. 2010-08-25 20:43:35 -04:00
Samuel Clay
f879985946 Merge branch 'master' of github.com:samuelclay/NewsBlur into exceptions 2010-08-25 19:37:00 -04:00
Samuel Clay
49d8b6d505 Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies. 2010-08-25 19:10:55 -04:00
Samuel Clay
bfa01bede2 New informational message. 2010-08-25 14:54:28 -04:00
Samuel Clay
389157e2f0 Fixing invalid feed tags. 2010-08-24 16:22:12 -04:00
Samuel Clay
0deb0aff2f Fixing invalid feed tags. 2010-08-24 16:19:09 -04:00
Samuel Clay
538854f8e4 Fixing invalid feed tags. 2010-08-24 16:14:56 -04:00
Samuel Clay
d90f1791e1 Refactored a bit here and there. The real changes are coming tonight. 2010-08-23 21:04:51 -04:00
Samuel Clay
fc16a1b8a9 Small refactor on names and amalgamated methods. 2010-08-23 09:55:21 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
fa3be28b43 Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs. 2010-08-21 13:57:49 -04:00
Samuel Clay
03fc6aa2ad Single threaded feed fetch on adding feeds. 2010-08-19 20:06:20 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
5e438ac439 Coercing errors into integers. Doh. 2010-08-18 22:06:56 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
f7574e6d11 Tweaks to fetching times. This will buy me about 3 days to figure out how to scale. 2010-08-16 17:51:15 -04:00
Samuel Clay
bbc15f4fbd Story count histories. +migrations 2010-08-13 11:03:07 -04:00
Samuel Clay
d4f30d8236 Finishing up statistics graphs. Using Flot instead of Raphael. Added a migration to change how stories are counted. 2010-08-13 10:43:48 -04:00
Samuel Clay
aeda525b55 1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list. 2010-08-09 20:44:46 -04:00
Samuel Clay
4fe631788e Handling overly long story titles. 2010-08-04 18:55:52 -04:00
Samuel Clay
5cb7d1509a Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now. 2010-08-04 18:30:51 -04:00
Samuel Clay
da1bb81cd2 Updated Trainer. Now comes with a full tutorial and resized modals. 2010-08-01 23:47:45 -04:00
Samuel Clay
c692d7d913 Bigrams and Trigrams for collocation search. 2010-07-27 23:29:04 -04:00
Samuel Clay
273ce8d41f Collocations of phrases in feeds. Doesn't save, but can be extracted. 2010-07-27 22:53:30 -04:00