Commit graph

398 commits

Author SHA1 Message Date
Samuel Clay
8efefc6cdb Merge branch 'master' into social
* master:
  Fixing hub url change subscription.
  Adding failed push feeds to munin.
  Showing correctly real-time status if feed is push.
  Showing correct real-time status if feed is push.
  Emergency fix to not have to reverse url in task fetchers.
  Setting up push feeds for removal.
  Adding munin graph for pushed feed queue and nginx conf.
  Logging real-time.
  Resubscribing to real-time feeds on add/remove feed.
  Adding push feeds queue. Ignoring fat ping, since it might not match URLs.
  Cleanup
  Forgive push subscription errors.
  Adding # of push feeds to munin.
  Correcting a double-encoding bug for story permalinks that was from way back when.
  Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server.
  Checking for push hub links safetly.
  Adding subscription callbacks for PuSH.
  Stubbing in PuSH support. Need to work it in with Feeds and upgrade rel='hub'.

Conflicts:
	apps/reader/models.py
	media/js/newsblur/reader/reader.js
	settings.py
	utils/feed_fetcher.py
2012-03-28 18:42:35 -07:00
Samuel Clay
a74be1b604 Adding push feeds queue. Ignoring fat ping, since it might not match URLs. 2012-03-28 15:49:21 -07:00
Samuel Clay
abc3b20d81 Adding subscription callbacks for PuSH. 2012-03-27 16:26:07 -07:00
Samuel Clay
e0d6454a5f Merge branch 'master' into social
* master:
  Fixing missing status code in feed fetcher.
  Fixing missing status code in feed fetcher.
  Adding stathat stats for feed fetching and parsing.
  Small cleanup to parameters of feed update method.
  Refactoring starred stories indexes and adding hints.
  Removing hints.
  Adding hints, revising indexes on user stories, and trying to quicken feed fetching meta work.
  Refactoring refresh feed unread counts. Fixing tests.
  Adding task04 to fabfile.
  Adding django 1.4 compatibility.
  If feed no longer exists after update, find it, then schedule fetch.
  Don't skip unfetched feeds.
  Don't skip unfetched feeds.

Conflicts:
	apps/reader/models.py
	apps/reader/views.py
	fabfile.py
	utils/feed_fetcher.py
2012-03-26 21:06:13 -07:00
Samuel Clay
5e981635d1 Small cleanup to parameters of feed update method. 2012-03-26 17:04:35 -07:00
Samuel Clay
c8eed328d4 Adding django 1.4 compatibility. 2012-03-25 14:08:56 -07:00
Samuel Clay
0d9a8be334 Refactoring OAuth out of social app. Following twitter user (faked for now) from intro dialog. 2012-03-19 11:15:26 -07:00
Samuel Clay
c1461359c7 Adding Search app and object, used to index stories and then search them. Needs views, ui, and support for saved stories. 2012-03-11 16:13:05 -07:00
Samuel Clay
aaa5aa1cd6 Merge branch 'master' into social
* master:
  Changing copy on premium/feedchooser dialog.
  Styling errors on stripe payment form.
  Final stripe.js tweaks before launch.
  Adding Pay by Credit Card as an option to feed chooser dialog. Thus concludes Stripe.js integration. Time to launch!
  Styling the stripe.js background.
  Using correct kwargs for stripe signal.
  Wrapping up stripe.js form. Has validation, styling, and does the right thing for new subscriptions. Needs a link to the form, though.
  Setting up correct customer model for stripe webhook.
  Moving JS assets to bottom of the page for faster loadtimes.
  Fixing exception on missing param in feed address searching.
  Fixing recommendation date serialization bug.
  Fixing bugs around login with blank password using full password. Also fixing bug in signups with no username.
  Stripe.js payments using zebra. Adding zebra as a vendored dependency. Webhooks and views all in. Needs styling, custom username and email fields, and loads of testing.
  Adding error checking on requests in page fetching.
  Using a probability from redis to determine whether or not to skip a fetch.
  Allowing any password to be used on accounts with no password set.
  Adding paypal logo.

Conflicts:
	assets.yml
	media/js/newsblur/reader/reader_feedchooser.js
	settings.py
	templates/base.html
2012-02-29 16:22:47 -08:00
Samuel Clay
7f6d1a3fae Styling errors on stripe payment form. 2012-02-29 12:57:46 -08:00
Samuel Clay
e2e0d1e09d Moving JS assets to bottom of the page for faster loadtimes. 2012-02-28 12:18:44 -08:00
Samuel Clay
29234a8bac Stripe.js payments using zebra. Adding zebra as a vendored dependency. Webhooks and views all in. Needs styling, custom username and email fields, and loads of testing. 2012-02-27 21:46:34 -08:00
Samuel Clay
603ac08faa Merge branch 'master' into social
* master:
  Allow login from signup form.
  Reducing celery prefetch to get more accurate queue sizes.
  Removing RabbitMQ dependency. Moving to redis for task queuing.
  Counting queue size for celery/redis.
  Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load.
  Skipping feed resurrection.
  Fixing last update problem that has been choking feed fetchers.
  Fixing last update problem that has been choking feed fetchers.
  Typo in feed pool drain.
  Adding ability to wind down feed queue by faking requests.
  Adding debug message about counting errors.

Conflicts:
	fabfile.py
2012-02-27 13:13:27 -08:00
Samuel Clay
de71c414c5 Reducing celery prefetch to get more accurate queue sizes. 2012-02-27 12:35:07 -08:00
Samuel Clay
d901ccdae1 Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load. 2012-02-26 22:33:06 -08:00
Samuel Clay
8ef2bf31b1 Merge branch 'master' into social
* master:
  Re-styling the crap out of all taskbar buttons. Much more streamlined now.
  Tweaking the living crap out of the intelligence control's colors. Lightened.
  User feedback: hiding positive and negative unread counts in title if there are no unread stories outside of neutral.
  Correcting typo in dupe feed resolution.
  Local settings in fabfile.
  Fixing up a minor detail in the new intelligence control.
  Rewriting intelligence slider to be an intelligence control (segmented control). Should make a ton more intuitive sense.
  Trying to fix IE troubles by forcing single requests per read story.
  Fixing nginx conf to support ssl.
  Adding PID files to gitignore.
  Ignoring files.
  Adding certificates to ignore.
  Adding https to nginx.

Conflicts:
	media/css/reader.css
	media/js/newsblur/common/assetmodel.js
2012-02-10 09:24:48 -08:00
Samuel Clay
1c4a5c975e Local settings in fabfile. 2012-02-08 20:33:20 -08:00
Samuel Clay
d679b5ad4f Merge branch 'master' into social
* master:
  Fixing #42: a long-time bug of drag-and-drop not respecting order.
  Removing application media types from enclosures. Nobody needs that.
  Forcing Jammit asset path to be absolute, relative to configured directory.

Conflicts:
	media/js/newsblur/reader/reader.js
	utils/story_functions.py
2012-01-15 19:16:41 -08:00
Samuel Clay
fc438d9efe Forcing Jammit asset path to be absolute, relative to configured directory. 2012-01-14 10:59:10 -08:00
Samuel Clay
8f4dd6566c Merge branch 'jammit' into social
* jammit:
  Adding new iphone mask image.
  Moving to proper unicode string for feed fetching.
  Colorizing feed fetching.
  Colorizing feed fetching.
  Adding two error classes to requests exception handling.
  Adding two error classes to requests exception handling.
  Adding two error classes to requests exception handling.
  jQuery 1.6.1 -> 1.7.1. Fixes massive Chrome issues.
  Adding shift+u as a shortcut for marking a story unread.
  Adding more advanced exception handling for new requests module, with fallback to urllib2.
  Adding urllib fallback to requests in page fetching.
  Adding a little bit more leeway in page importer by falling back to urllib2 when requests fail.
  Adding slight bit of color to feed fetcher.
  Revert "Revert "Switching to requests from urllib2/httplib. Bring on the page errors.""

Conflicts:
	assets.yml
	local_settings.py.template
	media/js/jquery-1.7.1.js
	media/js/jquery-1.7.js
	media/js/vendor/jquery-1.7.js
2012-01-05 08:38:08 -08:00
Samuel Clay
329e09d954 Merge branch 'master' into jammit
* master:
  Moving to proper unicode string for feed fetching.
  Colorizing feed fetching.
  Colorizing feed fetching.
  Adding two error classes to requests exception handling.
  Adding two error classes to requests exception handling.
  Adding two error classes to requests exception handling.
  jQuery 1.6.1 -> 1.7.1. Fixes massive Chrome issues.
  Adding shift+u as a shortcut for marking a story unread.
  Adding more advanced exception handling for new requests module, with fallback to urllib2.
  Adding urllib fallback to requests in page fetching.
  Adding a little bit more leeway in page importer by falling back to urllib2 when requests fail.
  Adding slight bit of color to feed fetcher.
  Revert "Revert "Switching to requests from urllib2/httplib. Bring on the page errors.""

Conflicts:
	media/js/jquery-1.6.1.js
	media/js/jquery-1.7.1.js
	node/node_modules/socket.io-client/support/test-runner/public/javascript/jquery.js
2012-01-05 08:35:17 -08:00
Samuel Clay
fdaa25c2fc Merge branch 'master' of github.com:samuelclay/NewsBlur into requests
* 'master' of github.com:samuelclay/NewsBlur:
  jQuery 1.6.1 -> 1.7.1. Fixes massive Chrome issues.
  Adding shift+u as a shortcut for marking a story unread.
  Boosting fillout pages.
  Small cleanup in ajax manager.
2012-01-04 21:50:06 -08:00
Samuel Clay
63d7cc1fa5 jQuery 1.6.1 -> 1.7.1. Fixes massive Chrome issues. 2012-01-04 16:40:22 -08:00
Samuel Clay
3567922ae2 Merge branch 'jammit' into social
* jammit:
  Adding node's 8888 to app ufw. Also adding redis's 6379 to express server.
  Adding socket.io-client
  Adding node modules.
  Retooling fabfile's deploy code to support serial asset packaging with parallel code deploys.
  Upgrading nginx version.
  Fixing public_root in assets.yml to be readbale by old yml.
  Adding static/ to gitignore.
  Moving images and theme assets around.
  Relative to absolute urls for all embedded images.
  Fixing up jammit branch for launch by adding socket.io, bookmarklet, and compressed static assets. Still needs icons.
  Fixing css conflicts in jammit. Adding code rendering to jammit for bookmarklet.
  Adding /static to nginx conf.
  Adding jQuery 1.7 and new static directory.
  JS is now complete. Need to fix css embeds.
  Initial stub of Jammit assets.

Conflicts:
	media/css/reader.css
2012-01-03 09:30:28 -08:00
Samuel Clay
7601bb7b3d Adding follow/unfollow buttons. Preparing to modelize with Backbone. 2012-01-03 09:29:21 -08:00
Samuel Clay
962b763bb6 Merge branch 'master' into jammit
* master: (30 commits)
  Boosting fillout pages.
  Small cleanup in ajax manager.
  Abort old requests and don't cache responses. Trying to fix IE read story bug.
  Force jquery to never cache.
  Checking for exceptions earlier in order to show fixed site.
  Changing user agent to hopefully override overly-sniffy websites.
  Fixing inaccurate substitution on feed urls. Ugh, can't believe this was here this long.
  Adding the setting of a feed's view settings to Site Settings dialog. This should've been in there a loooong time ago.
  Fixing feed loads only once for those with skipping stories.
  Adding handler to to_json calls on all serialized models.
  Fixing two major bugs: auto filling stories now works far better nad doesn't lock you in. Also fixing the infernal unicode json parsing bug that's been effecting a bunch of sites.
  Adding WP7 as user agent.
  Adding necessary import when not running from the REPL.
  Too many stories? Don't animate transitions when switching intelligence levels.
  Fixing typo in iphone app that preventing mark folder as read when the visible stories option was showing.
  Updating the mongo db copy util to also look for updated stories.
  Globals.is_staff on user, not profile. Make the stats referesh every minute instead of every 10 minutes for staff.
  Fixing offsets in river of news.
  Adding ciphering to usernames in log, so I can finally take screenshots of the most colorful logs of all time.
  Adding my very special mongo serialization backup utility to get around the damn unrepairable mongo database. This is taking 14 hours to run.
  ...

Conflicts:
	templates/base.html
2012-01-02 16:48:54 -08:00
Samuel Clay
5f723b28cf Adding Find Friends dialog, complete with tabs (Find friends, i'm following, following me). Doesn't do squat yet. 2011-12-21 18:23:53 -08:00
Samuel Clay
bfbba21711 Adding Twitter OAuth. Syncing friends for both twitter and facebook. Needs disconnect and resync. 2011-12-21 09:43:17 -08:00
Samuel Clay
b5efad9142 Merge branch 'master' into requests
* master: (66 commits)
  Too many stories? Don't animate transitions when switching intelligence levels.
  Fixing typo in iphone app that preventing mark folder as read when the visible stories option was showing.
  Updating the mongo db copy util to also look for updated stories.
  Globals.is_staff on user, not profile. Make the stats referesh every minute instead of every 10 minutes for staff.
  Fixing offsets in river of news.
  Adding ciphering to usernames in log, so I can finally take screenshots of the most colorful logs of all time.
  Adding my very special mongo serialization backup utility to get around the damn unrepairable mongo database. This is taking 14 hours to run.
  Auto-refreshing feedback (1 min for staff, 10 min for everybody).
  Fixing exception around multiple feeds during Google Reader import process. Also switching rate limit to status code 429.
  Adding Nokia MeeGo client to user agents.
  Only show raw feeds in feed autocomplete.
  Handling iphone version for new users on ios app.
  FIXING THE WORST BUG OF MY LIFE -- finally figured out what was causing the story-shows-as-unread bug. Also fixed enclosures on certain types of feeds.
  Fixing menu manage open position to compensate for additional menu items.
  Reducing the amount of work done by feed fetching when there are no new stories.
  Fixing emergency bug around trimming feeds where the cursor is changing. Dammit mongo.
  Simplifying ufw ports in fabfile. Adding env.user.
  Launching the iPhone app on the front-page. Big deal.
  Minor cleanup of river stories view.
  Cleaning up mongoengine imports and settings for default MongoDB.
  ...

Conflicts:
	local_settings.py.template
2011-12-20 21:47:55 -08:00
Samuel Clay
52e49fec9f Merge branch 'master' of github.com:samuelclay/NewsBlur into social
* 'master' of github.com:samuelclay/NewsBlur:
  Fixing offsets in river of news.
  Adding ciphering to usernames in log, so I can finally take screenshots of the most colorful logs of all time.
2011-12-20 11:50:02 -08:00
Samuel Clay
cbea833e05 Adding Facebook OAuth and friend list saving. 2011-12-20 11:49:49 -08:00
Samuel Clay
befa6eb26f Adding ciphering to usernames in log, so I can finally take screenshots of the most colorful logs of all time. 2011-12-18 23:49:10 -08:00
Samuel Clay
b94d48b793 Adding shared stories model, saving shared stories (with comments), and loading shared stories in feed pages. Now just need to make a share feed, follow a share feed, and find friends to follow. 2011-12-15 09:10:37 -08:00
Samuel Clay
a493d9f240 Merge branch 'master' into jammit
* master: (45 commits)
  Launching the iPhone app on the front-page. Big deal.
  Minor cleanup of river stories view.
  Cleaning up mongoengine imports and settings for default MongoDB.
  Killing off the old slave_db pattern.
  Moving from slave_db to ReplicaSetConnection in pymongo 2.1.
  Adding title and subtitle. (Big thanks to @ericflo for the inspiration.)
  Adding title and subtitle. (Big thanks to @ericflo for the inspiration.)
  Fitting the iphone web page on smaller screens.
  The @jashkenas treatment -- cleaning up the iphone app page.
  Adding rotation to iphone website.
  Using the correct story permalink (if it is not correctly in the link key of the feed).
  Finishign up interaction of iphone app trailer page. Need auto switching.
  iPhone screenshots, iPhone page, complete with animations.
  Adding current version to iPhone app so it can update from the server.
  Removing unnecessary return to selected story on paging of story titles.
  Scrolling the story titles view to the feedbar when a page is loading. Experimental, but may help a bunch of users know what's happening.
  Stubbing in iphone page.
  Solving the Read button dilemma for Everything vs. folders vs. feeds.
  Disabling feed settings button on Everything river view.
  Building folder delete into iOS app.
  ...
2011-12-11 16:48:50 -08:00
Samuel Clay
6d0b8baa83 Cleaning up mongoengine imports and settings for default MongoDB. 2011-12-11 11:41:12 -08:00
Samuel Clay
f3d2f8e5b5 Moving from slave_db to ReplicaSetConnection in pymongo 2.1. 2011-12-11 10:54:07 -08:00
Samuel Clay
b112717d95 Revert "Revert "Switching to requests from urllib2/httplib. Bring on the page errors.""
This reverts commit a827b2c864.
2011-11-27 02:41:12 -05:00
Samuel Clay
a827b2c864 Revert "Switching to requests from urllib2/httplib. Bring on the page errors."
This reverts commit 617dc3bb56.

Conflicts:

	local_settings.py.template
2011-11-27 02:40:44 -05:00
Samuel Clay
d07b03a7a4 Revert "Revert "Switching to requests from urllib2/httplib. Bring on the page errors.""
This reverts commit 7972d0bb5c.
2011-11-26 11:15:01 -05:00
Samuel Clay
7972d0bb5c Revert "Switching to requests from urllib2/httplib. Bring on the page errors."
This reverts commit 617dc3bb56.
2011-11-26 02:16:14 -05:00
Samuel Clay
617dc3bb56 Switching to requests from urllib2/httplib. Bring on the page errors. 2011-11-26 02:07:31 -05:00
Samuel Clay
957dc7ca7c Fixing up jammit branch for launch by adding socket.io, bookmarklet, and compressed static assets. Still needs icons. 2011-11-24 14:58:04 -05:00
Samuel Clay
b41704339d Merge branch 'master' into jammit
* master: (48 commits)
  Updating copy on homepage.
  Marking all as read on Everything view should clear folder unread counts.
  Fixing error on committing to cache for rate limits when the dummy cache backend is used.
  Adding linux.com story to press page.
  Uniqifying stories when read.
  Moving from sha module to hashlib.
  Syncing time to account for time drift on VPS.
  Fixing issue around showing too many Oh Nos on abort.
  Save hash for address+link migration. necessary for a unique index.
  Deprecating db02, moving redis and rabbitmq over to db01.
  Updating nginx conf to support better amintenance pages giving a 503 status code.
  Moving NewsBlur counts to beginning of title.
  Fixing that crummy missing existing story issue.
  Updating feedparser.
  Fixing broken hashlib issue with feeds and no link.
  Adding MongoDB slave to local_settings template.
  Adding two new columns, necessary for the feed_settings branch: hash of address+link, and locking address.
  Marking read stories in Feed view as very much read. Gradientizing, too.
  Fixing /m/ for no good reason.
  File under "fucking finally": Adding client-side error handling and callbacks for feeds and river.
  ...

Conflicts:
	config/nginx.newsblur.conf
2011-11-24 00:29:57 -05:00
Samuel Clay
596c00a281 Deprecating db02, moving redis and rabbitmq over to db01. 2011-11-18 10:13:39 -08:00
Samuel Clay
2d53d148c9 Bumping up the subscriber expire, now that I've got my wits back. 2011-11-14 09:18:15 -08:00
Samuel Clay
d3804e3265 JS is now complete. Need to fix css embeds. 2011-11-07 09:35:51 -08:00
Samuel Clay
a8c62eb7eb Initial stub of Jammit assets. 2011-11-07 08:48:00 -08:00
Samuel Clay
936774b654 Adding update_counts to /feeds API endpoint, to force a recalculation of feed unread counts (WARNING: slower than calling /feeds then /refresh_feeds). 2011-11-07 08:27:59 -08:00
Samuel Clay
ac3609bf7d Merge branch 'master' into realtime
* master:
  Adding 'E' as a keyboard shortcut for the Everything view.
  Doubling the amount Space pages in a story.
  Auto-linkify urls in stories.
  Reading stories from slave db during feed update.

Conflicts:
	settings.py
2011-11-06 15:28:37 -08:00
Samuel Clay
4e382e5caf Adding fabfile config for redis. 2011-11-06 15:19:58 -08:00