Commit graph

750 commits

Author SHA1 Message Date
Samuel Clay
9ea3be9999 Moving HAProxy's config to secrets so I can set a password. 2013-03-20 15:12:56 -07:00
Samuel Clay
90c2425db0 Upgrading django from 1.3 to 1.5. 2013-03-20 15:05:52 -07:00
Jeff Triplett
e2396c7380 Added django-redis-sessions to requirements. 2013-03-20 16:58:30 -05:00
Samuel Clay
b3744e3ac6 Merge branch 'master' into circular
* master:
  Warning on missing maintenance.
  Further pushing out feed updates.
  Using @dcramer's excellent getsentry.com for all exceptions. Turning off exception emails.
  Further pushing down feed fetches to handle load until db is scaled out.
  Scrolling code blocks.
  New task servers.
  Turning down feed fetches.
  If requests.raw won't work, sut fudge it with a StringIO for now.
  Further turning down feed fetches until mongo is ready to replicate.
  Fixing Facebook image calculation.
  Fixing facebook posting.
  Moving shared story unread recalc to background task. Will greatly speed up sharing.
  Ramping down feed fetching until they can be handled.
  Only show time breakdown when > 1 sec.
  Fixed API docs for /reader/river_stories
  make fabfile.py use requirements.txt
  Make sure to send the proper content-type with social feeds
  Restore default whitespace to pre/code blocks
  Phase 2: switching to using story_hash index instead of compound unique story_feed_id/story_guid index.
  document keyboard shortcut to add site/folder

Conflicts:
	apps/social/views.py
2013-03-20 10:49:09 -07:00
Jeff Triplett
f098b57490 Froze requirements to make installation a bit easier. 2013-03-19 15:32:14 -05:00
Thomas Weißschuh
88812a77f9 make fabfile.py use requirements.txt
The '$(<FILE)' syntax expands to a single line, separating the lines of FILE by
spaces. This works on recent shells (means: not dash, busybox sh).
For more backward compability one could use '$(cat FILE)' or even '`cat FILE`'.

The new requirement.txt includes all optional dependencies (taken straight from
fabfile.py) and misses gunicorn and psycopgs2, as those are installed
separately by fabric.
(Better getting fast 90% of packages and some superfluous ones than none at
all)
2013-03-19 18:06:01 +00:00
Samuel Clay
7bfb9b66be Adding port handling for socket.io when not on www. Useful for dev and debugging. 2013-03-19 10:18:22 -07:00
Samuel Clay
ee749794dc Activating premiums immediately for stripe users. 2013-03-19 10:18:21 -07:00
Samuel Clay
5e4b1be626 Adding X-server to headers to figure out request pinning. 2013-03-19 10:18:21 -07:00
Samuel Clay
447887fdfb Opening up gunicorn for use by HAProxy directly. 2013-03-19 10:18:21 -07:00
Samuel Clay
bc59711fa3 Naively connecting to real-time socket.io. 2013-03-19 10:18:21 -07:00
Samuel Clay
faa57db7c9 Preventing socket.io buildups. 2013-03-19 10:18:21 -07:00
Samuel Clay
80cc1ef6fb Rewriting HAProxy config to include gunicorn and maintenance. Much better monitoring. 2013-03-19 10:18:21 -07:00
Samuel Clay
4e0fb455d7 Fixing HAProxy to use http headers so a 502 error code doesn't get served with a 200 status code. I mean seriously, WTF HAProxy?! 2013-03-19 10:18:21 -07:00
Samuel Clay
3803776cf7 Adding port handling for socket.io when not on www. Useful for dev and debugging. 2013-03-18 15:18:43 -07:00
Samuel Clay
8281a1f3ec Activating premiums immediately for stripe users. 2013-03-18 13:14:50 -07:00
Samuel Clay
d283294bcc Adding X-server to headers to figure out request pinning. 2013-03-18 11:32:24 -07:00
Samuel Clay
1e1bbdb702 Opening up gunicorn for use by HAProxy directly. 2013-03-17 16:03:02 -07:00
Samuel Clay
def69cb0e3 Naively connecting to real-time socket.io. 2013-03-17 14:41:29 -07:00
Samuel Clay
1db8bc0c54 Preventing socket.io buildups. 2013-03-17 14:27:58 -07:00
Samuel Clay
065df8a196 Rewriting HAProxy config to include gunicorn and maintenance. Much better monitoring. 2013-03-17 14:06:17 -07:00
Samuel Clay
a073cec282 Fixing HAProxy to use http headers so a 502 error code doesn't get served with a 200 status code. I mean seriously, WTF HAProxy?! 2013-03-17 12:39:13 -07:00
Samuel Clay
233af12d0e Merge branch 'master' into circular
* master:
  Trying out a gunicorn haproxy backend.
  Re-upping 12 to 64 free feeds.
  Removing Redis state for socket.io. Too many open mongo connections.
  Referencing new secret hosts.
  Removing hosts.
  Adding dev hosts.
  Using new secrets repo instead of ignored files.
2013-03-17 11:26:54 -07:00
Samuel Clay
644751414f Trying out a gunicorn haproxy backend. 2013-03-17 11:25:16 -07:00
Samuel Clay
ee4fd11ca7 Re-upping 12 to 64 free feeds. 2013-03-17 10:28:26 -07:00
Samuel Clay
dca245762c Removing hosts. 2013-03-16 18:02:52 -07:00
Samuel Clay
403210be47 Adding dev hosts. 2013-03-16 17:58:39 -07:00
Samuel Clay
e15bf40fdc Merge branch 'master' into circular
* master:
  Fixing homepage copy.
  Using redisstore for socketio.
  Forcing reconnection for socket.io.
  Upgrading node modules.
  Reconnecting to socket.io when disconnected or failing reconnection.
  Updating website copy to show /year instead of .
  Upgrading socket.io, widening reconnection delay.

Conflicts:
	media/js/newsblur/reader/reader.js
2013-03-15 18:58:54 -07:00
Samuel Clay
6114aaefe4 Reconnecting to socket.io when disconnected or failing reconnection. 2013-03-15 17:05:44 -07:00
Samuel Clay
89439fff9d Updating website copy to show /year instead of . 2013-03-15 12:35:10 -07:00
Samuel Clay
0b81276c90 Upgrading socket.io, widening reconnection delay. 2013-03-15 12:11:29 -07:00
Samuel Clay
e0c88a84ff Merge branch 'master' into circular
* master:
  Trimming subdomains used for testing.
2013-03-15 11:51:01 -07:00
Samuel Clay
16db855454 Trimming subdomains used for testing. 2013-03-15 11:50:58 -07:00
Samuel Clay
d4d46cada1 Merge branch 'master' into circular
* master:
  Removing unused ec2 app servers.
  New host, moving socket.io to non-port.
  Adding hosts to HAProxy.
  Adding app10 (new haproxy server) to subdomain exclusion list.
  Min of 4 gunicorn servers.
  Adding HAProxy config.
  Fixing stripe form.
  Fetching more feeds.

Conflicts:
	config/hosts
2013-03-15 11:50:15 -07:00
Samuel Clay
872e1f459f Removing unused ec2 app servers. 2013-03-15 11:49:02 -07:00
Samuel Clay
225a38486e New host, moving socket.io to non-port. 2013-03-15 11:11:47 -07:00
Samuel Clay
98d76a53af Adding hosts to HAProxy. 2013-03-14 23:16:37 -07:00
Samuel Clay
7eb4012542 Min of 4 gunicorn servers. 2013-03-14 22:41:03 -07:00
Samuel Clay
881f24859b Adding HAProxy config. 2013-03-14 22:39:58 -07:00
Samuel Clay
7f9893f1f3 Merge branch 'master' into circular
* master:
  Refactoring fabfile for DO
  Moving redis servers for real-time.
  Increasing feed fetches quite a bit.
  More gunicorn servers.
  More gunicorn servers.
  Upping gunicorn processes.
  Hiding 12 option to cut back on number of new premiums.
  Bumping up premium refresh rates.
  Tasking only popular feeds for now.
  Pushing out feed updates until able to handle the giant influx.
2013-03-14 20:38:30 -07:00
Samuel Clay
e73f3aa66d Increasing feed fetches quite a bit. 2013-03-14 19:26:22 -07:00
Samuel Clay
8f5814bf1f More gunicorn servers. 2013-03-14 19:03:33 -07:00
Samuel Clay
c27c5f311a More gunicorn servers. 2013-03-14 19:00:10 -07:00
Samuel Clay
5e6e4b2a97 Upping gunicorn processes. 2013-03-14 18:57:35 -07:00
Samuel Clay
f62ce742b5 Hiding 12 option to cut back on number of new premiums. 2013-03-14 18:43:01 -07:00
Samuel Clay
85c85ab565 Pushing out feed updates until able to handle the giant influx. 2013-03-14 15:52:34 -07:00
Samuel Clay
20e541ba91 Merge branch 'master' into circular
* master:
  Moving redis to digital ocean.
  Only 5k feeds for minute.
  Moving task feeds to its own beat queue.
  New postgres standby db.
  Only fetching premium feeds.

Conflicts:
	fabfile.py
2013-03-14 13:58:24 -07:00
Samuel Clay
0d0baebc73 Moving redis to digital ocean. 2013-03-14 13:41:46 -07:00
Samuel Clay
9052636418 Moving task feeds to its own beat queue. 2013-03-14 12:55:15 -07:00
Samuel Clay
4720d6ccbb New postgres standby db. 2013-03-14 12:41:24 -07:00