Commit graph

207 commits

Author SHA1 Message Date
Samuel Clay
876c292cfc Merge branch 'master' into schedule
* master:
  Fixing ulimit on new machines. Upgrading celery.
2013-04-23 18:07:43 -07:00
Samuel Clay
e624fe53d9 Fixing ulimit on new machines. Upgrading celery. 2013-04-23 17:58:25 -07:00
Samuel Clay
1584208677 Adding metric for last story date, used to calculate next scheduled update. 2013-04-23 17:04:21 -07:00
Samuel Clay
76cbbd8d8b Refactoring real-time socketio clientside to fix multiple client updates. 2013-04-15 17:59:06 -07:00
Samuel Clay
48c5d4d53e Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:19:59 -07:00
Samuel Clay
0e7bcab43d Adding supervisord.conf config to include minfds (ulimit -a) support. 2013-04-06 12:31:51 -07:00
Samuel Clay
2acd91aa15 Adding --use-pythonrc to shell_plus. 2013-04-03 22:34:43 -07:00
Samuel Clay
12472a8484 Adding new task server role: only new and push feeds. 2013-04-03 16:23:55 -07:00
Samuel Clay
5ffcf84432 Migrating original page servers and munin servers. 2013-04-01 12:21:20 -07:00
Samuel Clay
25d21c9f69 Updating postgres config, celery queue. 2013-03-30 12:43:11 -07:00
Samuel Clay
03c27b42e8 Removing unused feed hash index (keeping the unique constraint). 2013-03-29 22:41:16 -07:00
Samuel Clay
a47fa4db0f Removing unused indexes. 2013-03-29 20:24:06 -07:00
Samuel Clay
9086e93c3b Moving from MongoDB's page_loads analytics table to Redis page loads. 2013-03-29 13:14:19 -07:00
Samuel Clay
02a0a0646a Adding MongoDB MMS agent. 2013-03-29 11:04:46 -07:00
Samuel Clay
bbd7d5060e Adding task servers to db firewall. 2013-03-28 19:08:46 -07:00
Samuel Clay
bc6b5a025b Adding redis cache. Returning favicon server. 2013-03-28 18:13:08 -07:00
Samuel Clay
b21ea88e8e Better munin plugins for redis and mongo. 2013-03-28 17:29:27 -07:00
Samuel Clay
a65236ea92 Removing unused redis keys for shared/comments. Dry-run. 2013-03-28 16:39:37 -07:00
Samuel Clay
e39dee98be Upping feed fetches, slowing down fetch interval for less active feeds, setting premium expire time to one year from most recent payment date (as opposed to borked payment gap logic), and adding logginf or tasking feeds. 2013-03-28 11:16:43 -07:00
Samuel Clay
9e17a2caed Sync delay in mongodb and updating story hash migration. 2013-03-27 22:25:08 -07:00
Michael Elovskikh
3809df22cd Fix duplicate requirement
Just a small fix
2013-03-28 00:22:25 +06:00
Samuel Clay
cd6bddb2a5 Adding hyphens to allowed hosts for blurblogs. 2013-03-25 12:32:15 -07:00
Samuel Clay
3e8c3b7e4b Adding X-nginx-server and X-gunicorn-server. 2013-03-25 11:53:31 -07:00
Samuel Clay
a37fcd4da8 Downgrading from Pillow, which is incompatible with PIL. 2013-03-22 17:16:16 -07:00
Samuel Clay
16688a4985 Upgrading from PIL to Pillow. 2013-03-22 15:04:34 -07:00
Samuel Clay
e91d11e068 Adding cached template loader. Adding new mongodb. 2013-03-22 13:36:32 -07:00
Samuel Clay
4b8b958078 Redis session db. 2013-03-20 19:26:10 -07:00
Jeff Triplett
6070552ebf Updated Django to always use the latest 1.5 version. Updated django-redis-session to latest version. 2013-03-20 17:32:56 -05:00
Jeff Triplett
c6cf31e7e2 Merged in master branch. 2013-03-20 17:30:16 -05:00
Samuel Clay
9ea3be9999 Moving HAProxy's config to secrets so I can set a password. 2013-03-20 15:12:56 -07:00
Samuel Clay
90c2425db0 Upgrading django from 1.3 to 1.5. 2013-03-20 15:05:52 -07:00
Jeff Triplett
e2396c7380 Added django-redis-sessions to requirements. 2013-03-20 16:58:30 -05:00
Jeff Triplett
f098b57490 Froze requirements to make installation a bit easier. 2013-03-19 15:32:14 -05:00
Thomas Weißschuh
88812a77f9 make fabfile.py use requirements.txt
The '$(<FILE)' syntax expands to a single line, separating the lines of FILE by
spaces. This works on recent shells (means: not dash, busybox sh).
For more backward compability one could use '$(cat FILE)' or even '`cat FILE`'.

The new requirement.txt includes all optional dependencies (taken straight from
fabfile.py) and misses gunicorn and psycopgs2, as those are installed
separately by fabric.
(Better getting fast 90% of packages and some superfluous ones than none at
all)
2013-03-19 18:06:01 +00:00
Samuel Clay
3803776cf7 Adding port handling for socket.io when not on www. Useful for dev and debugging. 2013-03-18 15:18:43 -07:00
Samuel Clay
8281a1f3ec Activating premiums immediately for stripe users. 2013-03-18 13:14:50 -07:00
Samuel Clay
d283294bcc Adding X-server to headers to figure out request pinning. 2013-03-18 11:32:24 -07:00
Samuel Clay
1e1bbdb702 Opening up gunicorn for use by HAProxy directly. 2013-03-17 16:03:02 -07:00
Samuel Clay
def69cb0e3 Naively connecting to real-time socket.io. 2013-03-17 14:41:29 -07:00
Samuel Clay
1db8bc0c54 Preventing socket.io buildups. 2013-03-17 14:27:58 -07:00
Samuel Clay
065df8a196 Rewriting HAProxy config to include gunicorn and maintenance. Much better monitoring. 2013-03-17 14:06:17 -07:00
Samuel Clay
a073cec282 Fixing HAProxy to use http headers so a 502 error code doesn't get served with a 200 status code. I mean seriously, WTF HAProxy?! 2013-03-17 12:39:13 -07:00
Samuel Clay
644751414f Trying out a gunicorn haproxy backend. 2013-03-17 11:25:16 -07:00
Samuel Clay
ee4fd11ca7 Re-upping 12 to 64 free feeds. 2013-03-17 10:28:26 -07:00
Samuel Clay
dca245762c Removing hosts. 2013-03-16 18:02:52 -07:00
Samuel Clay
403210be47 Adding dev hosts. 2013-03-16 17:58:39 -07:00
Samuel Clay
6114aaefe4 Reconnecting to socket.io when disconnected or failing reconnection. 2013-03-15 17:05:44 -07:00
Samuel Clay
89439fff9d Updating website copy to show /year instead of . 2013-03-15 12:35:10 -07:00
Samuel Clay
0b81276c90 Upgrading socket.io, widening reconnection delay. 2013-03-15 12:11:29 -07:00
Samuel Clay
16db855454 Trimming subdomains used for testing. 2013-03-15 11:50:58 -07:00