Commit graph

314 commits

Author SHA1 Message Date
Samuel Clay
7a41b6a949 Using proper hostname for task server. Adding verbosity to feed fetching. 2013-04-03 18:11:23 -07:00
Samuel Clay
8f8c88ca47 Adding tasked_feeds set to handle dropped feeds. 2013-04-03 17:22:45 -07:00
Samuel Clay
e0457bf0d0 Fixing missing feed bug. 2013-04-03 16:48:42 -07:00
Samuel Clay
12472a8484 Adding new task server role: only new and push feeds. 2013-04-03 16:23:55 -07:00
Samuel Clay
50b6eee6a8 Fixing haproxy install. 2013-04-01 14:41:54 -07:00
Samuel Clay
b4cc3b50b1 Ripping out memcache in favor of redis. 2013-04-01 12:30:37 -07:00
Samuel Clay
5ffcf84432 Migrating original page servers and munin servers. 2013-04-01 12:21:20 -07:00
Samuel Clay
03c27b42e8 Removing unused feed hash index (keeping the unique constraint). 2013-03-29 22:41:16 -07:00
Samuel Clay
cb0a30b171 Upgrade to postgres 9.2. 2013-03-29 17:39:35 -07:00
Samuel Clay
65e976e4a0 Culling some graphs on feed counts. 2013-03-29 16:36:13 -07:00
Samuel Clay
02a0a0646a Adding MongoDB MMS agent. 2013-03-29 11:04:46 -07:00
Samuel Clay
bbd7d5060e Adding task servers to db firewall. 2013-03-28 19:08:46 -07:00
Samuel Clay
bc6b5a025b Adding redis cache. Returning favicon server. 2013-03-28 18:13:08 -07:00
Samuel Clay
e39dee98be Upping feed fetches, slowing down fetch interval for less active feeds, setting premium expire time to one year from most recent payment date (as opposed to borked payment gap logic), and adding logginf or tasking feeds. 2013-03-28 11:16:43 -07:00
Samuel Clay
3bb1c95f91 Fixing limits.conf to just use integers. 2013-03-26 16:55:29 -07:00
Samuel Clay
bb803c50b4 Making it a bit easier to setup a new db. 2013-03-26 16:27:01 -07:00
Samuel Clay
e5485ff525 Adding dev and debug to firewall 2013-03-25 12:46:36 -07:00
Samuel Clay
3e8c3b7e4b Adding X-nginx-server and X-gunicorn-server. 2013-03-25 11:53:31 -07:00
Samuel Clay
b5a0e99b8e Fixing firewall setup. 2013-03-25 09:46:43 -07:00
Samuel Clay
a4238d20b3 Moving to a single hosts and hosts.yml file, used to control logs, deployment, firewalls, and communication. Awesome! 2013-03-24 22:31:46 -07:00
Samuel Clay
f6e5f04cb5 Moving hosts to secrets. 2013-03-24 19:09:04 -07:00
Samuel Clay
9e2fa3115d Cache busting feeds on force and 1% of the time. 2013-03-24 15:50:57 -07:00
Samuel Clay
a37fcd4da8 Downgrading from Pillow, which is incompatible with PIL. 2013-03-22 17:16:16 -07:00
Samuel Clay
6f8a05111a Logging feed fetch deletions. 2013-03-22 16:12:01 -07:00
Samuel Clay
acb1efd3ea Last imports for pillow. 2013-03-22 15:27:10 -07:00
Samuel Clay
16688a4985 Upgrading from PIL to Pillow. 2013-03-22 15:04:34 -07:00
Samuel Clay
e91d11e068 Adding cached template loader. Adding new mongodb. 2013-03-22 13:36:32 -07:00
Samuel Clay
c421a08889 Bootstrapping redis sessions. 2013-03-20 22:00:03 -07:00
Samuel Clay
670093e3bf Skipping real-time fetch for non-premium active feeds. 2013-03-20 16:13:10 -07:00
Samuel Clay
7111b362fb Upgrading django 1.5 manage.py. 2013-03-20 16:06:02 -07:00
Samuel Clay
d8a43d394f Upgrade to django 1.5 script. Also handling story lookups with objectids. 2013-03-20 15:43:35 -07:00
Samuel Clay
9ea3be9999 Moving HAProxy's config to secrets so I can set a password. 2013-03-20 15:12:56 -07:00
Samuel Clay
90c2425db0 Upgrading django from 1.3 to 1.5. 2013-03-20 15:05:52 -07:00
Samuel Clay
cd9b9929b4 Adding revsys fab command. 2013-03-20 12:24:36 -07:00
Samuel Clay
87f1a6a4a0 Warning on missing maintenance. 2013-03-20 10:48:36 -07:00
Samuel Clay
991318face New task servers. 2013-03-19 18:27:06 -07:00
Thomas Weißschuh
88812a77f9 make fabfile.py use requirements.txt
The '$(<FILE)' syntax expands to a single line, separating the lines of FILE by
spaces. This works on recent shells (means: not dash, busybox sh).
For more backward compability one could use '$(cat FILE)' or even '`cat FILE`'.

The new requirement.txt includes all optional dependencies (taken straight from
fabfile.py) and misses gunicorn and psycopgs2, as those are installed
separately by fabric.
(Better getting fast 90% of packages and some superfluous ones than none at
all)
2013-03-19 18:06:01 +00:00
Samuel Clay
2aaadfdd17 Adding new task servers. 2013-03-18 13:35:11 -07:00
Samuel Clay
8281a1f3ec Activating premiums immediately for stripe users. 2013-03-18 13:14:50 -07:00
Samuel Clay
7c8c965dd5 Merge pull request #96 from frac/master
Remove dependency to dop.client
2013-03-18 12:14:18 -07:00
Samuel Clay
d283294bcc Adding X-server to headers to figure out request pinning. 2013-03-18 11:32:24 -07:00
adriano petrich
6b8d1e1206 Merge branch 'master' of git://github.com/samuelclay/NewsBlur 2013-03-18 09:51:27 +00:00
adriano petrich
302f3f5c20 removing dependency to dop.client for common fab tasks 2013-03-18 09:51:20 +00:00
Samuel Clay
5847f8d05f Increase file descriptor limits with fabric. 2013-03-17 20:14:55 -07:00
Samuel Clay
def69cb0e3 Naively connecting to real-time socket.io. 2013-03-17 14:41:29 -07:00
Samuel Clay
065df8a196 Rewriting HAProxy config to include gunicorn and maintenance. Much better monitoring. 2013-03-17 14:06:17 -07:00
Samuel Clay
a073cec282 Fixing HAProxy to use http headers so a 502 error code doesn't get served with a 200 status code. I mean seriously, WTF HAProxy?! 2013-03-17 12:39:13 -07:00
Samuel Clay
ee4fd11ca7 Re-upping 12 to 64 free feeds. 2013-03-17 10:28:26 -07:00
Samuel Clay
6dc0824cca Referencing new secret hosts. 2013-03-16 18:04:19 -07:00
Samuel Clay
98ce0cd4dd Using new secrets repo instead of ignored files. 2013-03-16 17:58:34 -07:00