Commit graph

10101 commits

Author SHA1 Message Date
Samuel Clay
abe73a1d0e Barring the ability to use multiprocessing for feed fetching, in the meantime we'll have to use separate processes, which means potential for fetchin gthe same feeds. 2010-08-23 08:09:58 -04:00
Samuel Clay
d03bd58a27 Unicode bug on html rewriting. 2010-08-23 08:04:42 -04:00
Samuel Clay
d03b4b8e69 Unicode bug on html rewriting. 2010-08-23 07:58:09 -04:00
Samuel Clay
3cd4ab9774 Fixing issues with bootstrapping read stories. 2010-08-23 01:06:04 -04:00
Samuel Clay
e0282efb80 Rescuing story bootstrapping. Halfway through it crashes, so restarted at a savepoint. 2010-08-22 21:39:45 -04:00
Samuel Clay
496c590016 Rescuing story bootstrapping. Halfway through it crashes, so restarted at a savepoint. 2010-08-22 21:36:12 -04:00
Samuel Clay
def2f5a418 Rescuing story bootstrapping. 2010-08-22 20:05:33 -04:00
Samuel Clay
a7d5ff3cfe Rescuing story bootstrapping. 2010-08-22 20:03:25 -04:00
Samuel Clay
37a5476cd5 Adding production log settings. 2010-08-22 18:49:01 -04:00
Samuel Clay
f90029eed1 Whew. Finished entire mongo conversion. Classifiers, Stories, and UserStories. Includes bootstrapping each from Postgres. 2010-08-22 18:34:40 -04:00
Samuel Clay
79d1ffd5db Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts. 2010-08-21 23:49:36 -04:00
Samuel Clay
b1dfdb1239 Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo 2010-08-21 20:42:51 -04:00
Samuel Clay
ac53f33788 Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories. 2010-08-21 20:42:38 -04:00
Samuel Clay
a3cb4648bb .gitignore MongoDB data directory 2010-08-21 14:03:30 -04:00
Samuel Clay
fa3be28b43 Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs. 2010-08-21 13:57:49 -04:00
Samuel Clay
e208f6885c Erasing unused functions. Feels good, every time. 2010-08-20 18:09:43 -04:00
Samuel Clay
a3025a2df7 Back to square 1 on optimizing the DB queries. 2010-08-19 23:18:11 -04:00
Samuel Clay
fc18a1f19c Backwards. Just use the GUIDs of stories. This may lead to dupe-stories when the GUID changes. Ugh. 2010-08-19 22:45:44 -04:00
Samuel Clay
d6dfc25e4e Drastically simplifying SQL command to find existing stories. Removed all found GUIDs and am just using the start/end dates in the feed. 2010-08-19 22:43:49 -04:00
Samuel Clay
03fc6aa2ad Single threaded feed fetch on adding feeds. 2010-08-19 20:06:20 -04:00
Samuel Clay
22071da997 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-19 19:54:47 -04:00
Samuel Clay
4288283c95 Small tweaks to feed fetching locks. 2010-08-19 19:54:44 -04:00
Samuel Clay
7e40103a4c Adding a duplicate feed table so future duplicates will be caught and corrected. 2010-08-19 10:43:07 -04:00
Samuel Clay
5e438ac439 Coercing errors into integers. Doh. 2010-08-18 22:06:56 -04:00
Samuel Clay
8b9c28e8f8 Cleaning up exception handling of feeds to show to users during import. 2010-08-18 21:56:30 -04:00
Samuel Clay
68b0ae7254 Adding exception handling UI. Also disabled feeds that are just chock full of exceptions. No need to continually fetch buggy feeds. Still need to figure out a way to let users fix problematic feeds, but letting them know is an improvement. 2010-08-18 20:35:45 -04:00
Samuel Clay
20c4d4d916 Allowing unread recount to happen when marking all feeds as read. 2010-08-18 08:10:24 -04:00
Samuel Clay
9174df9503 Dramatically sped up Mark All as Read by deferring to the new count progress bar. 2010-08-18 08:05:59 -04:00
Samuel Clay
53c9df0fef Going back to calculating everybody's unread counts on new stories. Way more optimized, and user experience suffers having to wait on first-load. 2010-08-18 07:46:32 -04:00
Samuel Clay
aa99517511 Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything. 2010-08-17 23:40:03 -04:00
Samuel Clay
db3bdbc0d5 First half of the new Google Reader importer progress bar. 2010-08-17 20:59:47 -04:00
Samuel Clay
2b8f4bff95 Normalizing logging across all views and models. 2010-08-17 17:45:51 -04:00
Samuel Clay
f7574e6d11 Tweaks to fetching times. This will buy me about 3 days to figure out how to scale. 2010-08-16 17:51:15 -04:00
Samuel Clay
e253ad9603 Fixing bug with missing feeds. 2010-08-16 16:30:04 -04:00
Samuel Clay
f3522cf0ec Adding logging in many other places. 2010-08-16 15:45:35 -04:00
Samuel Clay
55683fc1d5 Skipping feeds with fewer than X stories_per_month. Used to catch the queue up and toss inactive feeds. 2010-08-16 13:21:32 -04:00
Samuel Clay
2e1c3b4db3 Adding stats and training to logging. 2010-08-16 12:55:45 -04:00
Samuel Clay
588207384c Logging tweaks to handle console and file handlers. 2010-08-16 12:52:39 -04:00
Samuel Clay
fcca02717f Silencing logs from the backgorund importer. 2010-08-15 12:09:40 -04:00
Samuel Clay
602d54504a Silencing logs in background processes. 2010-08-15 12:07:19 -04:00
Samuel Clay
3df0722dcc Moving from print-based logging to python-based logging. Quite the improvement. Console/Stream output in development, logfile in production. 2010-08-15 12:04:26 -04:00
Samuel Clay
1afddf5a22 About time: Pane sizes are now persisted as preferences. 2010-08-13 19:50:56 -04:00
Samuel Clay
6fdd4949ca Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-13 19:21:41 -04:00
Samuel Clay
88161e64c2 Upgrading layout, fixing resize bug, and preparing iframe buster buster (which is currently disabled). 2010-08-13 19:21:29 -04:00
Samuel Clay
c1ac17c942 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-13 18:19:44 -04:00
Samuel Clay
550c822663 Gunicorn worker settings. 2010-08-13 18:19:40 -04:00
Samuel Clay
1c6e69d396 Fixing issues with statistics. Also adding a button to open statistics from feed's story titles. 2010-08-13 18:18:46 -04:00
Samuel Clay
1c6f1a8810 Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-08-13 16:55:28 -04:00
Samuel Clay
841abe22db Cracking the OAuth bug with print statements. 2010-08-13 16:55:05 -04:00
Samuel Clay
d7898bdfe7 Merge branch 'master' of github.com:samuelclay/NewsBlur
Conflicts:
	gunicorn.py
2010-08-13 12:16:09 -04:00