Commit graph

442 commits

Author SHA1 Message Date
Samuel Clay
7313339dbc Refactoring refresh feed unread counts. Fixing tests. 2012-03-26 11:04:05 -07:00
Samuel Clay
c8eed328d4 Adding django 1.4 compatibility. 2012-03-25 14:08:56 -07:00
Samuel Clay
d29021fa0e Missing last update date. 2012-03-21 16:23:21 -07:00
Samuel Clay
d74139e2ed Fixing major bug around stale data when updating feeds. 2012-03-21 16:05:52 -07:00
Samuel Clay
1fb6464415 Handle cases of user reading both old and new guid stories. 2012-03-21 13:54:37 -07:00
Samuel Clay
7ddfdd644e Moving last update to post-fetch. 2012-03-20 16:51:10 -07:00
Samuel Clay
396d76b5ac Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header. 2012-03-19 19:58:17 -07:00
Samuel Clay
d5b71c76ba Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read. 2012-03-08 11:15:17 -08:00
Samuel Clay
d5926fe577 Fixing rss feed tests. 2012-03-06 16:11:27 -08:00
Samuel Clay
33fa13cf69 Fixing issue around feeds that are mistakenly declared as not having a page. 2012-03-05 13:12:50 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
ca5438a9fb Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:05:52 -08:00
Samuel Clay
ff00e16682 Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:00:55 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00
Samuel Clay
d57c26e98e Adding debug message about counting errors. 2012-02-24 16:15:49 -08:00
Samuel Clay
96f6a3d2c7 Fixing numerous feed fetching errors. 2012-02-24 14:39:23 -08:00
Samuel Clay
1ffefaa419 Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh. 2012-02-24 11:47:38 -08:00
Samuel Clay
6c7034343b Geometrically decaying feed fetches on known good feeds that have gone bad. 2012-02-23 13:20:10 -08:00
Samuel Clay
9236ecc6f6 Correcting typo in dupe feed resolution. 2012-02-09 07:50:40 -08:00
Samuel Clay
50e80c7241 Handling duplicate feed saving much more gracefully by finding the correct dupe. 2012-02-03 13:02:26 -08:00
Samuel Clay
e5f7cf7517 Turning down verbosity on feed tasking. 2012-02-01 22:42:48 -08:00
Samuel Clay
c9cb7dcbc0 Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s. 2012-02-01 17:59:46 -08:00
Samuel Clay
b17252d241 Fixing broken opml export due to missing feed icons. 2012-01-10 10:22:12 -08:00
Samuel Clay
642323fd07 Fixing slight bug in how active premiums were applied to feed update times. 2012-01-09 21:24:47 -08:00
Samuel Clay
ad007c7e61 Adding active_premium count. Setting a minimum of 1 hour fetches for feeds with any active premiums. 2012-01-09 19:08:22 -08:00
Samuel Clay
aa96e288d2 Adding error handling for insta-fetching stories. 2012-01-08 14:15:22 -08:00
Samuel Clay
4389374033 Moving to proper unicode string for feed fetching. 2012-01-04 21:49:55 -08:00
Samuel Clay
b0aa1764b4 Colorizing feed fetching. 2012-01-04 18:30:43 -08:00
Samuel Clay
10ef120e34 Merge branch 'master' into requests
* master:
  Abort old requests and don't cache responses. Trying to fix IE read story bug.
  Force jquery to never cache.
  Checking for exceptions earlier in order to show fixed site.
  Changing user agent to hopefully override overly-sniffy websites.
  Fixing inaccurate substitution on feed urls. Ugh, can't believe this was here this long.
  Adding the setting of a feed's view settings to Site Settings dialog. This should've been in there a loooong time ago.
2012-01-02 16:00:09 -08:00
Samuel Clay
055500cbf1 Fixing inaccurate substitution on feed urls. Ugh, can't believe this was here this long. 2012-01-02 14:14:53 -08:00
Samuel Clay
d3d241d77e Merge branch 'master' into requests
* master:
  Fixing feed loads only once for those with skipping stories.
  Adding handler to to_json calls on all serialized models.
  Fixing two major bugs: auto filling stories now works far better nad doesn't lock you in. Also fixing the infernal unicode json parsing bug that's been effecting a bunch of sites.
  Adding WP7 as user agent.
  Adding necessary import when not running from the REPL.
2011-12-27 21:39:19 -08:00
Samuel Clay
bd87f3484b Adding handler to to_json calls on all serialized models. 2011-12-25 12:45:07 -08:00
Samuel Clay
6e1ebce64a Fixing two major bugs: auto filling stories now works far better nad doesn't lock you in. Also fixing the infernal unicode json parsing bug that's been effecting a bunch of sites. 2011-12-24 14:45:19 -08:00
Samuel Clay
0418538381 Adding slight bit of color to feed fetcher. 2011-12-20 22:02:52 -08:00
Samuel Clay
9d0ce2011a FIXING THE WORST BUG OF MY LIFE -- finally figured out what was causing the story-shows-as-unread bug. Also fixed enclosures on certain types of feeds. 2011-12-14 23:26:07 -08:00
Samuel Clay
d1b0552942 Reducing the amount of work done by feed fetching when there are no new stories. 2011-12-14 14:18:01 -08:00
Samuel Clay
999b12e00b Fixing emergency bug around trimming feeds where the cursor is changing. Dammit mongo. 2011-12-14 10:49:00 -08:00
Samuel Clay
f3d2f8e5b5 Moving from slave_db to ReplicaSetConnection in pymongo 2.1. 2011-12-11 10:54:07 -08:00
Samuel Clay
8f69864b5a The @jashkenas treatment -- cleaning up the iphone app page. 2011-12-08 14:51:52 -08:00
Samuel Clay
04cb3308bd Using the correct story permalink (if it is not correctly in the link key of the feed). 2011-12-08 11:19:08 -08:00
Samuel Clay
4dee2e57cb Quick fix for duplicate feeds to be more specific. Also renaming screenshots of iOS app in anticipation for tomorrow's v1.2. 2011-12-01 22:03:30 -08:00
Samuel Clay
b64007b454 Fixing the bug around favicon's not being found, since they were checking for the wrong property. 2011-11-30 21:27:55 -08:00
Samuel Clay
4926105346 Fixing mark folder as read in iphone app. Also shortcutting mark site as read, so no action sheet needed. 2011-11-29 17:57:20 -08:00
Samuel Clay
6920b92dd6 Correctly updating feed exceptions by refreshing the feed on page. Also transferring over classifiers and read stories. 2011-11-29 09:43:16 -08:00
Samuel Clay
50e960e412 Adding unique index on MStory. 2011-11-28 16:32:19 -08:00
Samuel Clay
36105bf851 Merge branch 'master' into feed_settings
* master:
  Revert "Switching to requests from urllib2/httplib. Bring on the page errors."
  Fixing #41: Adding REDIS to local_settings.py.template.
  Revert "Revert "Switching to requests from urllib2/httplib. Bring on the page errors.""
  Revert "Switching to requests from urllib2/httplib. Bring on the page errors."
  Switching to requests from urllib2/httplib. Bring on the page errors.
  Adding a bunch fo keyboard shortcuts.
  Adding elapsed time field to river and feed view.
  Fixing autolinking of text links to no longer indiscriminately replace text, causing double encoding of html entities.
  Fixing the space bar key to not queue, so it's actually useful now!
  Refining media enclosures by adding all types and linking to their source.
  Refining media enclosure detection.
2011-11-27 02:41:40 -05:00
Samuel Clay
221b356494 Refining media enclosures by adding all types and linking to their source. 2011-11-25 10:38:39 -05:00
Samuel Clay
3e68aff667 Merge branch 'master' into feed_settings
* master:
  Correcting for feeds that have incorrect media content.
  Adding media enclosures in an audio tag.
  Using story date when there is no guid.
  Using story date when there is no guid.
  Adding verbose flag to feed updates to diagnose errors.
  Fixing issue with stories that have no permalink.

Conflicts:
	apps/rss_feeds/models.py
2011-11-25 00:18:32 -05:00
Samuel Clay
bd38351b8d Adding media enclosures in an audio tag. 2011-11-24 15:58:04 -05:00
Samuel Clay
c29db26fa6 Using story date when there is no guid. 2011-11-24 15:34:12 -05:00