Commit graph

628 commits

Author SHA1 Message Date
Samuel Clay
1788d26374 Goodbye StatHat. Hello better logging. 2012-03-27 11:19:53 -07:00
Samuel Clay
e0d6454a5f Merge branch 'master' into social
* master:
  Fixing missing status code in feed fetcher.
  Fixing missing status code in feed fetcher.
  Adding stathat stats for feed fetching and parsing.
  Small cleanup to parameters of feed update method.
  Refactoring starred stories indexes and adding hints.
  Removing hints.
  Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work.
  Refactoring refresh feed unread counts. Fixing tests.
  Adding task04 to fabfile.
  Adding django 1.4 compatibility.
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.

Conflicts:
	apps/reader/models.py
	apps/reader/views.py
	fabfile.py
	utils/feed_fetcher.py
2012-03-26 21:06:13 -07:00
Samuel Clay
5e981635d1 Small cleanup to parameters of feed update method. 2012-03-26 17:04:35 -07:00
Samuel Clay
426a5376a7 Refactoring starred stories indexes and adding hints. 2012-03-26 13:14:02 -07:00
Samuel Clay
bf00d6a501 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.
2012-03-26 12:40:24 -07:00
Samuel Clay
1321ade17a Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work. 2012-03-26 12:40:13 -07:00
Samuel Clay
7313339dbc Refactoring refresh feed unread counts. Fixing tests. 2012-03-26 11:04:05 -07:00
Samuel Clay
c8eed328d4 Adding django 1.4 compatibility. 2012-03-25 14:08:56 -07:00
Samuel Clay
a850a139e0 If feed no longer exists after update, find it, then schedule fetch. 2012-03-24 10:56:32 -07:00
Samuel Clay
3e83186254 Merge branch 'master' into social
* master:
  Missing last update date.
  Fixing major bug around stale data when updating feeds.
2012-03-21 17:12:20 -07:00
Samuel Clay
d29021fa0e Missing last update date. 2012-03-21 16:23:21 -07:00
Samuel Clay
d74139e2ed Fixing major bug around stale data when updating feeds. 2012-03-21 16:05:52 -07:00
Samuel Clay
f32dc6bd1c Merge branch 'master' into social
* master:
  Being more aggressive in determining if a URL is a feed.
  Increasing modal zindex to battle Svbtle blogs sidebar.
  Handle cases of user reading both old and new guid stories.
  Checking for a signup that is really a login when importing GR.
2012-03-21 14:42:42 -07:00
Samuel Clay
1fb6464415 Handle cases of user reading both old and new guid stories. 2012-03-21 13:54:37 -07:00
Samuel Clay
c2e5ece818 Merge branch 'master' into social
* master:
  Moving last update to post-fetch.
2012-03-20 16:52:07 -07:00
Samuel Clay
7ddfdd644e Moving last update to post-fetch. 2012-03-20 16:51:10 -07:00
Samuel Clay
67ea2452a7 Uniqifying profiles. Small cleanup. 2012-03-20 16:46:38 -07:00
Samuel Clay
5b71327531 Merge branch 'master' into social
* master:
  Error handling in orphan detection.
  Collecting orphaned feeds for users. These somehow got lost, and I'm not sure how. Eventually I'd like to run this on every user account.
  Fixing issue around feed titles that disappear. This just confirms that the new feed title is substantive.
  Uncommenting Readability sharing. This was written a loooong time ago, but their API is finally ready.
  Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header.
  Fixing missing folder issue in iOS app. Occurs when user has no feeds in top level, when the Everything psuedo-folder obscures the top folder.

Conflicts:
	apps/reader/models.py
2012-03-20 10:33:15 -07:00
Samuel Clay
396d76b5ac Fixing an issue around mal-formed requests aginst WordPress's Bad Behavior plugin, which checks for the 'Accept: *' header. 2012-03-19 19:58:17 -07:00
Samuel Clay
7f73c33f6f Styling the Stay Up To Date page, and it's stunning. 2012-03-16 20:40:48 -07:00
Samuel Clay
a2ee769895 Big cleanup on duplicate feeds with alternative feed links. Also fixing the profile to show followers/followings. 2012-03-12 18:11:13 -07:00
Samuel Clay
41b68b32eb Automatically loading intro or chooser dialog based on progress of new user. 2012-03-12 12:33:54 -07:00
Samuel Clay
8b4c801995 Moving linkify and changing a bit of logging. 2012-03-10 11:41:58 -08:00
Samuel Clay
9093061bbe Merge branch 'master' into social
* master:
  Adding Mother Jones feeds for testing.
  Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read.
  Fixing errant linkify text bug that resulted in some javascript being executed and overwriting the page. Thanks to @aaronlidman for the help in identifying the bug.

Conflicts:
	assets.yml
2012-03-08 16:34:20 -08:00
Samuel Clay
d5b71c76ba Fixing the ghost story unread count bug. Turns out it is a weird condition where a story changes its date after being published, but a user's mark_feed_as_read date is inbetween the new date and the original date, leading to a ghost unread story that can't be read. 2012-03-08 11:15:17 -08:00
Samuel Clay
c9f978d8b1 Merge branch 'master' into social
* master:
  Adding tests in prep for Mother Jones duping.
  Fixing rss feed tests.
  Adding press story from Italian site Skimbu.
  Adding Cuk.ch story about NewsBlur.
2012-03-06 16:56:34 -08:00
Samuel Clay
d5926fe577 Fixing rss feed tests. 2012-03-06 16:11:27 -08:00
Samuel Clay
0e43583a6c Merge branch 'master' into social
* master:
  Fixing issue around feeds that are mistakenly declared as not having a page.
  New audio control, with Flash fallback for browsers like Firefox/IE.

Conflicts:
	assets.yml
2012-03-05 13:48:39 -08:00
Samuel Clay
33fa13cf69 Fixing issue around feeds that are mistakenly declared as not having a page. 2012-03-05 13:12:50 -08:00
Samuel Clay
603ac08faa Merge branch 'master' into social
* master:
  Allow login from signup form.
  Reducing celery prefetch to get more accurate queue sizes.
  Removing RabbitMQ dependency. Moving to redis for task queuing.
  Counting queue size for celery/redis.
  Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load.
  Skipping feed resurrection.
  Fixing last update problem that has been choking feed fetchers.
  Fixing last update problem that has been choking feed fetchers.
  Typo in feed pool drain.
  Adding ability to wind down feed queue by faking requests.
  Adding debug message about counting errors.

Conflicts:
	fabfile.py
2012-02-27 13:13:27 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
ca5438a9fb Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:05:52 -08:00
Samuel Clay
ff00e16682 Fixing last update problem that has been choking feed fetchers. 2012-02-24 17:00:55 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00
Samuel Clay
d57c26e98e Adding debug message about counting errors. 2012-02-24 16:15:49 -08:00
Samuel Clay
96c5fe6d1f Merge branch 'master' into social
* master:
  Inverting the count for fetched feeds.
  Fixing numerous feed fetching errors.
2012-02-24 15:09:54 -08:00
Samuel Clay
96f6a3d2c7 Fixing numerous feed fetching errors. 2012-02-24 14:39:23 -08:00
Samuel Clay
408cb7e801 Merge branch 'master' into social
* master:
  Fixing starred stories from not loading past the second page due to a missing flag reset.
  Fixing user-found bug around tooltips continuing to show if the original dom element (and the reference to the tooltip) are destroyed too early, leaving a tooltip floating in the air.
  Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh.
  Fixing error codes on statistics. Also fixing simple error on invalid feed.
  Update media/js/newsblur/reader.js

Conflicts:
	media/js/newsblur/reader/reader.js
2012-02-24 13:01:48 -08:00
Samuel Clay
1ffefaa419 Geometrically delaying the fetching of bad feeds, while they're still somewhat fresh. 2012-02-24 11:47:38 -08:00
Samuel Clay
307e36622b Merge branch 'master' into social
* master:
  Adding asset-less deployment.
  Upgrading feedparser from 5.0.1 to 5.1.
  Catching errors in page links with ill-formed urls.
  Not showing the world favicon until favicons are downloaded.
  Fixing feed exception dialog to actually reload feeds on the page.
  Geometrically decaying feed fetches on known good feeds that have gone bad.
  Fixing issue around empty original pages.

Conflicts:
	media/js/newsblur/reader/reader.js
2012-02-23 15:40:38 -08:00
Samuel Clay
6c7034343b Geometrically decaying feed fetches on known good feeds that have gone bad. 2012-02-23 13:20:10 -08:00
Samuel Clay
581c52ff9a Front-end of intelligence training for social feeds. Still needs backend changes to accomodate string feed ids. 2012-02-13 11:07:32 -08:00
Samuel Clay
8ef2bf31b1 Merge branch 'master' into social
* master:
  Re-styling the crap out of all taskbar buttons. Much more streamlined now.
  Tweaking the living crap out of the intelligence control's colors. Lightened.
  User feedback: hiding positive and negative unread counts in title if there are no unread stories outside of neutral.
  Correcting typo in dupe feed resolution.
  Local settings in fabfile.
  Fixing up a minor detail in the new intelligence control.
  Rewriting intelligence slider to be an intelligence control (segmented control). Should make a ton more intuitive sense.
  Trying to fix IE troubles by forcing single requests per read story.
  Fixing nginx conf to support ssl.
  Adding PID files to gitignore.
  Ignoring files.
  Adding certificates to ignore.
  Adding https to nginx.

Conflicts:
	media/css/reader.css
	media/js/newsblur/common/assetmodel.js
2012-02-10 09:24:48 -08:00
Samuel Clay
9236ecc6f6 Correcting typo in dupe feed resolution. 2012-02-09 07:50:40 -08:00
Samuel Clay
e75281b4e4 Merge branch 'master' into social
* master:
  Handling duplicate feed saving much more gracefully by finding the correct dupe.

Conflicts:
	media/js/newsblur/common/assetmodel.js
2012-02-03 16:42:17 -08:00
Samuel Clay
50e80c7241 Handling duplicate feed saving much more gracefully by finding the correct dupe. 2012-02-03 13:02:26 -08:00
Samuel Clay
b3fffab05a Merge branch 'master' into social
* master:
  Adding build/ back to .gitignore.
  Updating .gitignore.
  Using dsa pem for retrieving rabbit update counts.
  Preserving feed fetch error histories for 2 weeks.
  Adding munin graph for known good feeds.
  Turning down verbosity on feed tasking.
  Adding known good feeds to munin to chart their progress.
  Fixing headers overflow in Chrome.
  Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s.
  Adding blogging OT press story.
2012-02-02 17:22:32 -08:00
Samuel Clay
e5f7cf7517 Turning down verbosity on feed tasking. 2012-02-01 22:42:48 -08:00
Samuel Clay
c9cb7dcbc0 Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s. 2012-02-01 17:59:46 -08:00
Samuel Clay
14d7849878 Adding Original page for social shared feeds. 2012-01-31 10:15:11 -08:00