Commit graph

350 commits

Author SHA1 Message Date
Samuel Clay
49d8b6d505 Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies. 2010-08-25 19:10:55 -04:00
Samuel Clay
e01bb9eb74 Exception modal now has delete and retry options that work. Change feed link/address are still in the works, but they show up. (Buttons don't do anything yet.) 2010-08-25 10:18:08 -04:00
Samuel Clay
389157e2f0 Fixing invalid feed tags. 2010-08-24 16:22:12 -04:00
Samuel Clay
0deb0aff2f Fixing invalid feed tags. 2010-08-24 16:19:09 -04:00
Samuel Clay
538854f8e4 Fixing invalid feed tags. 2010-08-24 16:14:56 -04:00
Samuel Clay
44969c7eee Upgrading feedparser. 2010-08-24 15:35:05 -04:00
Samuel Clay
547d7efd9f Deferring the loading of the iframe + feed to decrease latency before it all loads. 2010-08-23 23:29:43 -04:00
Samuel Clay
d90f1791e1 Refactored a bit here and there. The real changes are coming tonight. 2010-08-23 21:04:51 -04:00
Samuel Clay
7f7fcdcbcd Fixing the j/k password problem. (WTF, you type a j/k in a password field and it doesn't register. Now have to handle all users who have a j/k in their password.) Also fixing mark_story_as_read when multiple stories come in at once. 2010-08-23 18:37:59 -04:00
Samuel Clay
36abf00267 Code refactors. Just changing styles. 2010-08-23 16:23:16 -04:00
Samuel Clay
e4f8f09f32 Merge branch 'mongo'
Conflicts:
	apps/reader/views.py
2010-08-23 09:55:51 -04:00
Samuel Clay
fc16a1b8a9 Small refactor on names and amalgamated methods. 2010-08-23 09:55:21 -04:00
Samuel Clay
8cfb6a0be9 Now that we're using correct story_guids, we need to parse POSTed guids correctly. No more commas. 2010-08-23 08:22:10 -04:00
Samuel Clay
abe73a1d0e Barring the ability to use multiprocessing for feed fetching, in the meantime we'll have to use separate processes, which means potential for fetchin gthe same feeds. 2010-08-23 08:09:58 -04:00
Samuel Clay
d03bd58a27 Unicode bug on html rewriting. 2010-08-23 08:04:42 -04:00
Samuel Clay
d03b4b8e69 Unicode bug on html rewriting. 2010-08-23 07:58:09 -04:00
Samuel Clay
3cd4ab9774 Fixing issues with bootstrapping read stories. 2010-08-23 01:06:04 -04:00
Samuel Clay
e0282efb80 Rescuing story bootstrapping. Halfway through it crashes, so restarted at a savepoint. 2010-08-22 21:39:45 -04:00
Samuel Clay
496c590016 Rescuing story bootstrapping. Halfway through it crashes, so restarted at a savepoint. 2010-08-22 21:36:12 -04:00
Samuel Clay
def2f5a418 Rescuing story bootstrapping. 2010-08-22 20:05:33 -04:00
Samuel Clay
a7d5ff3cfe Rescuing story bootstrapping. 2010-08-22 20:03:25 -04:00
Samuel Clay
f90029eed1 Whew. Finished entire mongo conversion. Classifiers, Stories, and UserStories. Includes bootstrapping each from Postgres. 2010-08-22 18:34:40 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
fa3be28b43 Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs. 2010-08-21 13:57:49 -04:00
Samuel Clay
e208f6885c Erasing unused functions. Feels good, every time. 2010-08-20 18:09:43 -04:00
Samuel Clay
a3025a2df7 Back to square 1 on optimizing the DB queries. 2010-08-19 23:18:11 -04:00
Samuel Clay
03fc6aa2ad Single threaded feed fetch on adding feeds. 2010-08-19 20:06:20 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
5e438ac439 Coercing errors into integers. Doh. 2010-08-18 22:06:56 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
53c9df0fef Going back to calculating everybody's unread counts on new stories. Way more optimized, and user experience suffers having to wait on first-load. 2010-08-18 07:46:32 -04:00
Samuel Clay
aa99517511 Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything. 2010-08-17 23:40:03 -04:00
Samuel Clay
db3bdbc0d5 First half of the new Google Reader importer progress bar. 2010-08-17 20:59:47 -04:00
Samuel Clay
2b8f4bff95 Normalizing logging across all views and models. 2010-08-17 17:45:51 -04:00
Samuel Clay
f7574e6d11 Tweaks to fetching times. This will buy me about 3 days to figure out how to scale. 2010-08-16 17:51:15 -04:00
Samuel Clay
f3522cf0ec Adding logging in many other places. 2010-08-16 15:45:35 -04:00
Samuel Clay
55683fc1d5 Skipping feeds with fewer than X stories_per_month. Used to catch the queue up and toss inactive feeds. 2010-08-16 13:21:32 -04:00
Samuel Clay
2e1c3b4db3 Adding stats and training to logging. 2010-08-16 12:55:45 -04:00
Samuel Clay
588207384c Logging tweaks to handle console and file handlers. 2010-08-16 12:52:39 -04:00
Samuel Clay
fcca02717f Silencing logs from the backgorund importer. 2010-08-15 12:09:40 -04:00
Samuel Clay
602d54504a Silencing logs in background processes. 2010-08-15 12:07:19 -04:00
Samuel Clay
3df0722dcc Moving from print-based logging to python-based logging. Quite the improvement. Console/Stream output in development, logfile in production. 2010-08-15 12:04:26 -04:00
Samuel Clay
88161e64c2 Upgrading layout, fixing resize bug, and preparing iframe buster buster (which is currently disabled). 2010-08-13 19:21:29 -04:00
Samuel Clay
1c6e69d396 Fixing issues with statistics. Also adding a button to open statistics from feed's story titles. 2010-08-13 18:18:46 -04:00
Samuel Clay
841abe22db Cracking the OAuth bug with print statements. 2010-08-13 16:55:05 -04:00