NewsBlur/config/gunicorn_conf.py

import os
import psutil
import math

GIGS_OF_MEMORY = psutil.virtual_memory().total/1024/1024/1024.
NUM_CPUS = psutil.cpu_count()

bind = "0.0.0.0:8000"
pidfile = "/srv/newsblur/logs/gunicorn.pid"
logfile = "/srv/newsblur/logs/production.log"
accesslog = "/srv/newsblur/logs/production.log"
errorlog = "/srv/newsblur/logs/errors.log"
loglevel = "info"
name = "newsblur"
timeout = 120
max_requests = 1000
x_forwarded_for_header = "X-FORWARDED-FOR"
forwarded_allow_ips = "*"
limit_request_line = 16000
limit_request_fields = 1000
worker_tmp_dir = /dev/shm

if GIGS_OF_MEMORY > NUM_CPUS:
    workers = NUM_CPUS
else:
    workers = int(NUM_CPUS / 2)

if workers <= 4:
    workers = max(int(math.floor(GIGS_OF_MEMORY * 1000 / 512)), 4)

if workers > 8:
    workers = 8

if os.environ.get('DOCKERBUILD', False):
    workers = 1
Reducing number of workers on docker-compose. Also removing extraneous task servers and consolidating to task-celery for feeds and task-work for cron and work 2021-03-17 20:13:58 -04:00			`import os`
DB migration. 2013-06-24 17:59:31 -07:00			`import psutil`
Bumping gunicorn workers. 2013-03-13 23:21:30 -07:00			`import math`
Adding full bootstrapping to fabfile. 2011-02-09 15:45:41 -05:00
Updating psutil dependency. 2016-12-02 19:10:54 -08:00			`GIGS_OF_MEMORY = psutil.virtual_memory().total/1024/1024/1024.`
			`NUM_CPUS = psutil.cpu_count()`
Adding full bootstrapping to fabfile. 2011-02-09 15:45:41 -05:00
Opening up gunicorn for use by HAProxy directly. 2013-03-17 16:03:02 -07:00			`bind = "0.0.0.0:8000"`
sclay -> /srv 2013-02-25 19:01:04 -08:00			`pidfile = "/srv/newsblur/logs/gunicorn.pid"`
			`logfile = "/srv/newsblur/logs/production.log"`
			`accesslog = "/srv/newsblur/logs/production.log"`
			`errorlog = "/srv/newsblur/logs/errors.log"`
Using the gunicorn config so workers can be toned down. 2021-03-17 17:16:49 -04:00			`loglevel = "info"`
Adding full bootstrapping to fabfile. 2011-02-09 15:45:41 -05:00			`name = "newsblur"`
Increasing timeout on gunicorn to 2 min. 2012-01-08 20:47:34 -08:00			`timeout = 120`
Adding a max_requests to gunicorn to take care of memory leaks. 2011-10-05 10:10:30 -07:00			`max_requests = 1000`
Gunicorn x-forwarded-for 2014-05-22 09:32:42 -07:00			`x_forwarded_for_header = "X-FORWARDED-FOR"`
Adding RealIP to nginx/gunicorn. 2014-05-22 09:21:38 -07:00			`forwarded_allow_ips = "*"`
Fixing haproxy and gunicorn url length issues. This ones for @misc. 2014-10-01 15:40:33 -07:00			`limit_request_line = 16000`
			`limit_request_fields = 1000`
Graceful deploys for gunicorn. Turns out a HUP signal to the docker container isn't the same thing as a HUP signal to the actual process, which can be done outside of the container. 2021-03-26 18:44:56 -04:00			`worker_tmp_dir = /dev/shm`
Gunicorn gets the real proxied ip. 2013-06-26 12:27:43 -07:00
Typo in gunicorn conf. 2012-07-20 19:50:11 -07:00			`if GIGS_OF_MEMORY > NUM_CPUS:`
			`workers = NUM_CPUS`
Only using appropriate number of gunicorn processes, making this machine agnostic. 2012-07-20 19:48:18 -07:00			`else:`
Typo in gunicorn conf. 2012-07-20 19:50:11 -07:00			`workers = int(NUM_CPUS / 2)`
Bumping gunicorn workers. 2013-03-13 23:21:30 -07:00
Upping gunicorn processes. 2013-03-14 18:57:35 -07:00			`if workers <= 4:`
Min of 4 gunicorn servers. 2013-03-14 22:41:03 -07:00			`workers = max(int(math.floor(GIGS_OF_MEMORY * 1000 / 512)), 4)`
Postgres min log statement to 0.5s. Syncing haproxy debug with haproxy config. 2015-07-29 13:30:17 -07:00
More gunicorn servers. 2013-03-14 19:03:33 -07:00			`if workers > 8:`
Postgres min log statement to 0.5s. Syncing haproxy debug with haproxy config. 2015-07-29 13:30:17 -07:00			`workers = 8`

Reducing number of workers on docker-compose. Also removing extraneous task servers and consolidating to task-celery for feeds and task-work for cron and work 2021-03-17 20:13:58 -04:00			`if os.environ.get('DOCKERBUILD', False):`
			`workers = 1`