Samuel Clay
|
79ba0e695a
|
Removing weird threading-style time limiting of feed fetching.
|
2010-08-31 08:33:18 -04:00 |
|
Samuel Clay
|
985946e63b
|
Removing timelimit from feed fetcher. This caused massive interrupts.
|
2010-08-31 08:13:20 -04:00 |
|
Samuel Clay
|
48b147751d
|
Adding a timelimit to feed fetching. 20 seconds, that's all you got.
|
2010-08-30 23:55:24 -04:00 |
|
Samuel Clay
|
cb59861098
|
Correcting bug where next_update would be set in the future too quickly.
|
2010-08-30 23:37:39 -04:00 |
|
Samuel Clay
|
468f12e9ff
|
Adding automatic updating of feed counts even on current feeds. Also updating feeds in real-time when refresh is forced.
|
2010-08-30 22:42:44 -04:00 |
|
Samuel Clay
|
cea3bda090
|
Minor bug fixes around error catching in feed exceptions, drag-and-drop on top-level feeds, and styling of feed title buttons.
|
2010-08-30 19:57:27 -04:00 |
|
Samuel Clay
|
25c0450020
|
Commenting out map/reduce statistics because mongo keeps crashing.
|
2010-08-30 13:33:29 -04:00 |
|
Samuel Clay
|
c9d06f9358
|
Compressing stories. Also fixing compression of feed_pages bootstrap.
|
2010-08-29 13:23:50 -04:00 |
|
Samuel Clay
|
060f63f8a0
|
Myriad number of bug fixes to reduce the number of exception e-mails I get. Forbidden JSON requests now send 403s. Adding a URl no longer uses a partial URL saearch on feed_link (which would link usetoday.com -> usatoday.com/sports.xml). Also adding the model for FeedPage for mongo.
|
2010-08-27 18:35:33 -04:00 |
|
Samuel Clay
|
16cea3e174
|
Merging master
|
2010-08-25 19:37:07 -04:00 |
|
Samuel Clay
|
5c48d0fa94
|
Feeds that fetch successfully no longer have an exception.
|
2010-08-25 19:22:53 -04:00 |
|
Samuel Clay
|
98489a0057
|
Also fixing feeds that suffer from non-xml-ity.
|
2010-08-25 19:13:28 -04:00 |
|
Samuel Clay
|
49d8b6d505
|
Huge fix for exception feeds. Now tries to fetch the correct URL from the feed_link or the feed_address (if the rss URL is actually HTML), and uses that to figure out the right feed. Also merges feeds if a duplicate is found during this process. Really nifty. Let's hope nobody dies.
|
2010-08-25 19:10:55 -04:00 |
|
Samuel Clay
|
fc16a1b8a9
|
Small refactor on names and amalgamated methods.
|
2010-08-23 09:55:21 -04:00 |
|
Samuel Clay
|
d03b4b8e69
|
Unicode bug on html rewriting.
|
2010-08-23 07:58:09 -04:00 |
|
Samuel Clay
|
79d1ffd5db
|
Holy hell, the Mongo transition is nearly complete. All that's left is classifiers. This includes stories, user_stories, and calculating unread counts.
|
2010-08-21 23:49:36 -04:00 |
|
Samuel Clay
|
b1dfdb1239
|
Merge branch 'master' of github.com:samuelclay/NewsBlur into mongo
|
2010-08-21 20:42:51 -04:00 |
|
Samuel Clay
|
ac53f33788
|
Further Mongo work. Stories are now saved correctly, with tags + authors. Still need to do UserStories.
|
2010-08-21 20:42:38 -04:00 |
|
Samuel Clay
|
fa3be28b43
|
Initial stab at MongoDB in feed fetching and feed viewing. Still need to fix authors, tags, counts, aggregations, and any remaining bugs.
|
2010-08-21 13:57:49 -04:00 |
|
Samuel Clay
|
a3025a2df7
|
Back to square 1 on optimizing the DB queries.
|
2010-08-19 23:18:11 -04:00 |
|
Samuel Clay
|
fc18a1f19c
|
Backwards. Just use the GUIDs of stories. This may lead to dupe-stories when the GUID changes. Ugh.
|
2010-08-19 22:45:44 -04:00 |
|
Samuel Clay
|
d6dfc25e4e
|
Drastically simplifying SQL command to find existing stories. Removed all found GUIDs and am just using the start/end dates in the feed.
|
2010-08-19 22:43:49 -04:00 |
|
Samuel Clay
|
4288283c95
|
Small tweaks to feed fetching locks.
|
2010-08-19 19:54:44 -04:00 |
|
Samuel Clay
|
8b9c28e8f8
|
Cleaning up exception handling of feeds to show to users during import.
|
2010-08-18 21:56:30 -04:00 |
|
Samuel Clay
|
53c9df0fef
|
Going back to calculating everybody's unread counts on new stories. Way more optimized, and user experience suffers having to wait on first-load.
|
2010-08-18 07:46:32 -04:00 |
|
Samuel Clay
|
aa99517511
|
Completely changing how subscriptions are counted. Now happens after page load. Also retooled Google Reader import to load, count, and fetch after page load so the user is not kept waiting. Progress bars for everything.
|
2010-08-17 23:40:03 -04:00 |
|
Samuel Clay
|
2b8f4bff95
|
Normalizing logging across all views and models.
|
2010-08-17 17:45:51 -04:00 |
|
Samuel Clay
|
588207384c
|
Logging tweaks to handle console and file handlers.
|
2010-08-16 12:52:39 -04:00 |
|
Samuel Clay
|
3df0722dcc
|
Moving from print-based logging to python-based logging. Quite the improvement. Console/Stream output in development, logfile in production.
|
2010-08-15 12:04:26 -04:00 |
|
Samuel Clay
|
aeda525b55
|
1) Adding new feed story counter. 2) Adding feed fethed initially status. Useful for displaying percentages of fetched feeds for new users. 3) Fade in with loader on feed list.
|
2010-08-09 20:44:46 -04:00 |
|
Samuel Clay
|
de18f56025
|
Finally fixed bozo issues. Turns out I was checking for bozo errors before checking for 304s, which would short-circuit the 500s associated with the bozo error. Doh
|
2010-08-04 18:51:29 -04:00 |
|
Samuel Clay
|
5cb7d1509a
|
Feeds that don't parse are no longer auto-corrected. This should be handled by an automated scrubber, not the fetcher itself. Ignoring them for now.
|
2010-08-04 18:30:51 -04:00 |
|
Samuel Clay
|
0bcc3ae484
|
Small fixes: removing height calculation from classifier modal, adding in better logging for feed address changes, iPhone story detail view bug.
|
2010-08-03 21:53:08 -04:00 |
|
Samuel Clay
|
2fe632b4bc
|
Closing the database connection on the parent feed fetcher so it can be re-opened by worker threads.
|
2010-07-30 20:04:02 -04:00 |
|
Samuel Clay
|
246d3273dc
|
Manage feed style enhancements. Also statistics.
|
2010-07-30 17:12:20 -04:00 |
|
Samuel Clay
|
2a41bdcb65
|
IntegrityError error in the feed fetcher.
|
2010-07-28 19:05:03 -04:00 |
|
Samuel Clay
|
7b7475ac70
|
Adding feed update stats to stats modal.
|
2010-07-28 01:14:25 -04:00 |
|
Samuel Clay
|
3c6fdfdea7
|
Statistics on all feeds, stories, averages. Shown in the new statistics modal (not yet finished).
|
2010-07-25 23:13:27 -04:00 |
|
Samuel Clay
|
cfd807fa10
|
Updating feed error codes. Accidentally deleted the 200 OK feed fetch history.
|
2010-07-23 18:56:29 -04:00 |
|
Samuel Clay
|
2f86bbbb24
|
Fixing bad page URLs to use the feed fetcher to find the correct address.
|
2010-07-21 12:29:09 -04:00 |
|
Samuel Clay
|
2c0b78a319
|
Adding page fetching history. Also denormaling story authors.
|
2010-07-08 11:37:54 -04:00 |
|
Samuel Clay
|
b205536ab7
|
Trickling down errors in feed fetching.
|
2010-07-08 01:26:03 -04:00 |
|
Samuel Clay
|
671121b29c
|
Fixing broken Last Modified Date bug which causes all stories to be discarded.
|
2010-07-08 01:07:37 -04:00 |
|
Samuel Clay
|
fab14fae46
|
Refactoring feed fetching so some feeds will be correctly parsed. Also updated unit tests to include invalid XML.
|
2010-07-07 18:40:19 -04:00 |
|
Samuel Clay
|
2e15f84a0d
|
Additional instrumentation on feed fetching, parsing, and importing.
|
2010-07-06 18:16:41 -04:00 |
|
Samuel Clay
|
08ef889e09
|
Feed fetch history instrumentation.
|
2010-07-06 13:21:12 -04:00 |
|
Samuel Clay
|
d3935212a4
|
Preventing dud feeds to pause the whole feed refresher.
|
2010-07-05 23:19:07 -04:00 |
|
Samuel Clay
|
c9fd6b5c80
|
Preventing dud feeds to pause the whole feed refresher.
|
2010-07-05 23:17:36 -04:00 |
|
Samuel Clay
|
d5cbd1ad29
|
Tweaks to refreshing algorithm. More subscribers = faster service. Fewer subscribers = way less ervice for less active feeds. Active feeds still get more work
|
2010-07-05 23:06:37 -04:00 |
|
Samuel Clay
|
1c42a7088d
|
A number of aesthetic changes that make signup and login sharper.
|
2010-07-05 22:15:09 -04:00 |
|