Samuel Clay
|
b1dfdb1239
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo
|
2010-08-21 20:42:51 -04:00 |
|
Samuel Clay
|
ac53f33788
|
Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories.
|
2010-08-21 20:42:38 -04:00 |
|
Samuel Clay
|
fa3be28b43
|
Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs.
|
2010-08-21 13:57:49 -04:00 |
|
Samuel Clay
|
a3025a2df7
|
Back to square 1 on optimizing the DB queries.
|
2010-08-19 23:18:11 -04:00 |
|
Samuel Clay
|
fc18a1f19c
|
Backwards. Just use the GUIDs of stories. This may lead to dupe-stories when the GUID changes. Ugh.
|
2010-08-19 22:45:44 -04:00 |
|
Samuel Clay
|
d6dfc25e4e
|
Drastically simplifying SQL command to find existing stories. Removed all found GUIDs and am just using the start/end dates in the feed.
|
2010-08-19 22:43:49 -04:00 |
|
Samuel Clay
|
4288283c95
|
Small tweaks to feed fetching locks.
|
2010-08-19 19:54:44 -04:00 |
|
Samuel Clay
|
8b9c28e8f8
|
Cleaning up exception handling of feeds to show to users during import.
|
2010-08-18 21:56:30 -04:00 |
|
Samuel Clay
|
53c9df0fef
|
Going back to calculating everybody's unread counts on new stories. Way more optimized, and user experience suffers having to wait on first-load.
|
2010-08-18 07:46:32 -04:00 |
|
Samuel Clay
|
aa99517511
|
Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything.
|
2010-08-17 23:40:03 -04:00 |
|
Samuel Clay
|
2b8f4bff95
|
Normalizing logging across all views and models.
|
2010-08-17 17:45:51 -04:00 |
|
Samuel Clay
|
588207384c
|
Logging tweaks to handle console and file handlers.
|
2010-08-16 12:52:39 -04:00 |
|
Samuel Clay
|
3df0722dcc
|
Moving from print-based logging to python-based logging. Quite the improvement. Console/Stream output in development, logfile in production.
|
2010-08-15 12:04:26 -04:00 |
|
Samuel Clay
|
aeda525b55
|
1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list.
|
2010-08-09 20:44:46 -04:00 |
|
Samuel Clay
|
de18f56025
|
Finally fixed bozo issues. Turns out I was checking for bozo errors before checking for 304s, which would short-circuit the 500s associated with the bozo error. Doh
|
2010-08-04 18:51:29 -04:00 |
|
Samuel Clay
|
5cb7d1509a
|
Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now.
|
2010-08-04 18:30:51 -04:00 |
|
Samuel Clay
|
0bcc3ae484
|
Small fixes: removing height calculation from classifier modal, adding in better logging for feed address changes, iPhone story detail view bug.
|
2010-08-03 21:53:08 -04:00 |
|
Samuel Clay
|
2fe632b4bc
|
Closing the database connection on the parent feed fetcher so it can be re-opened by worker threads.
|
2010-07-30 20:04:02 -04:00 |
|
Samuel Clay
|
246d3273dc
|
Manage feed style enhancements. Also statistics.
|
2010-07-30 17:12:20 -04:00 |
|
Samuel Clay
|
2a41bdcb65
|
IntegrityError error in the feed fetcher.
|
2010-07-28 19:05:03 -04:00 |
|
Samuel Clay
|
7b7475ac70
|
Adding feed update stats to stats modal.
|
2010-07-28 01:14:25 -04:00 |
|
Samuel Clay
|
3c6fdfdea7
|
Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished).
|
2010-07-25 23:13:27 -04:00 |
|
Samuel Clay
|
cfd807fa10
|
Updating feed error codes. Accidentally deleted the 200 OK feed fetch history.
|
2010-07-23 18:56:29 -04:00 |
|
Samuel Clay
|
2f86bbbb24
|
Fixing bad page URLs to use the feed fetcher to find the correct address.
|
2010-07-21 12:29:09 -04:00 |
|
Samuel Clay
|
2c0b78a319
|
Adding page fetching history. Also denormaling story authors.
|
2010-07-08 11:37:54 -04:00 |
|
Samuel Clay
|
b205536ab7
|
Trickling down errors in feed fetching.
|
2010-07-08 01:26:03 -04:00 |
|
Samuel Clay
|
671121b29c
|
Fixing broken Last Modified Date bug which causes all stories to be discarded.
|
2010-07-08 01:07:37 -04:00 |
|
Samuel Clay
|
fab14fae46
|
Refactoring feed fetching so some feeds will be correctly parsed. Also updated unit tests to include invalid XML.
|
2010-07-07 18:40:19 -04:00 |
|
Samuel Clay
|
2e15f84a0d
|
Additional instrumentation on feed fetching, parsing, and importing.
|
2010-07-06 18:16:41 -04:00 |
|
Samuel Clay
|
08ef889e09
|
Feed fetch history instrumentation.
|
2010-07-06 13:21:12 -04:00 |
|
Samuel Clay
|
d3935212a4
|
Preventing dud feeds to pause the whole feed refresher.
|
2010-07-05 23:19:07 -04:00 |
|
Samuel Clay
|
c9fd6b5c80
|
Preventing dud feeds to pause the whole feed refresher.
|
2010-07-05 23:17:36 -04:00 |
|
Samuel Clay
|
d5cbd1ad29
|
Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work
|
2010-07-05 23:06:37 -04:00 |
|
Samuel Clay
|
1c42a7088d
|
A number of aesthetic changes that make signup and login sharper.
|
2010-07-05 22:15:09 -04:00 |
|
Samuel Clay
|
013cf7ab04
|
I wrote all this code but have no idea why I didn't commit it. Anyway, let's deploy it. (It looks like I'm slowing down feed refreshing, which is bound to not matter in ~10 users or so).
|
2010-07-05 14:26:35 -04:00 |
|
Samuel Clay
|
9867406ca2
|
Refactoring feed counts, subscriber counts, story counts, and tightening up refreshes for high-volume, high-subscriber feeds. Less decay on somewhat popular feeds.
|
2010-07-02 15:49:08 -04:00 |
|
Samuel Clay
|
2133ee81e7
|
Fixing issues with feature paging. JSON was incorrectly serializing it, the page_counter was being reset when feeds were loaded, and cleaned up feed resetting.
|
2010-07-02 12:02:10 -04:00 |
|
Samuel Clay
|
aaf68f4c21
|
Fetching page for high-volume feeds on every fetch instead of only when new stories are in the feed.
|
2010-07-02 11:46:45 -04:00 |
|
Samuel Clay
|
5b1bb231ef
|
Removing unnecessary cruft above the page importer.
|
2010-07-01 17:33:58 -04:00 |
|
Samuel Clay
|
4b57a32c0c
|
Removing 2 bigger JOINs that were slowing down feed loading.
|
2010-07-01 15:16:33 -04:00 |
|
Samuel Clay
|
113a4e058c
|
Adding a Delete This Site manage menu item, complete with cancel button.
|
2010-07-01 00:29:26 -04:00 |
|
Samuel Clay
|
80bdb79bd9
|
Better instrumentation through non-zero results on any successfull callback.
|
2010-06-28 08:06:12 -04:00 |
|
Samuel Clay
|
3d4cf207d3
|
Adding a feed punishment for slow feeds. Slow feeds get updated less often.
|
2010-06-24 15:27:25 -04:00 |
|
Samuel Clay
|
cc8beb2379
|
Fixing caching of feed stories so they load faster.
|
2010-06-24 15:10:15 -04:00 |
|
Samuel Clay
|
fbe1367739
|
Protopub -> NewsBlur
|
2010-06-08 11:19:07 -04:00 |
|
Samuel Clay
|
d39dacb592
|
Cleanup in prep for move from urllib to eventlets.
|
2010-05-20 15:13:25 -04:00 |
|
Samuel Clay
|
3ca7fcefca
|
That mass renames continue! Protoread is now Protopub, and that sounds good to me.
|
2010-05-14 09:32:38 -04:00 |
|
Samuel Clay
|
b1ac2147ba
|
Renaming News Blur to Protoread.
|
2010-05-13 11:11:01 -04:00 |
|
Samuel Clay
|
0176308858
|
Stylistic changes, like the name of the site: NewsBlur is now News Blur.
|
2010-05-11 18:38:32 -04:00 |
|
Samuel Clay
|
ce0495002e
|
Adding load time to feeds to punish slow feeds.
|
2010-04-29 13:35:46 -04:00 |
|