47 commits

Author	SHA1	Message	Date
Samuel Clay	1f5e9053dd	Handling too many feeds tasked.	2024-02-28 09:33:10 -05:00
Samuel Clay	697d6ec270	Task server names, postgres replication, storing grafana.	2024-01-28 17:58:18 -05:00
Samuel Clay	1f7a2e47aa	Adding spam.py to work servers.	2022-06-06 16:03:11 -04:00
Samuel Clay	72bb032842	Celery also has a set user.	2022-01-10 09:52:57 -05:00
Samuel Clay	35bc9ad07f	Rewriting readme from #1545.	2021-12-08 14:55:26 -05:00
Samuel Clay	52b8cfb85b	Task servers at , may remove.	2021-10-19 10:58:24 -04:00
Samuel Clay	b4e9a56041	Making the docker network is now a docker role task.	2021-09-16 11:55:20 -04:00
Samuel Clay	3f00139541	Upgrading sentry on both web and node.	2021-09-10 15:58:22 -04:00
Samuel Clay	8aa172a590	Always restart celery	2021-07-29 18:36:39 -04:00
Samuel Clay	02b2546825	Adding hostnames to docker containers, changing mongo to just use host network mode dammit, and adding possibility for logging to dnsmasq.	2021-07-23 18:13:19 -04:00
Samuel Clay	925c13bd6e	Sanity checker logs needs permissions for writing.	2021-07-14 17:42:13 -04:00
Jonathan Math	ea489636c9	fix sanity checkers for task_worker and move to hourly	2021-07-13 15:16:58 -05:00
Samuel Clay	f2e64ca36e	Fixing sanity checkers. None of them were running. Turns out they needed to be shell scripts if in the /etc/cron.hourly dir (and crontab format if in the /etc/cron.d dir).	2021-07-08 15:39:29 -04:00
Samuel Clay	f652941687	Adding autoheal to celery label.	2021-06-30 20:41:17 -04:00
Samuel Clay	e160a86d2a	Switching celery to local log driver for docker due to logs filling up disk space.	2021-06-30 00:22:09 -04:00
Samuel Clay	57c2713029	Fixing redis bgsave and disk checker monitors.	2021-06-24 11:54:56 -04:00
Samuel Clay	ae95b25910	Cleaning up monitors, switching to cron file, adding hostname.	2021-06-24 11:50:38 -04:00
Samuel Clay	1d5173e7bc	Fixing monitor task fetches	2021-06-24 11:19:45 -04:00
Jonathan Math	15f40588f3	fix celery_task sanity checkers	2021-06-22 09:06:10 -06:00
Jonathan Math	debafdc9ad	fix ansible sanity checkers	2021-06-16 10:12:41 -06:00
Jonathan Math	60e08d6786	make container cron jobs for sanity checkers	2021-06-16 10:00:08 -06:00
Jonathan Math	23f1af298a	fix celery_task sanity checker docker container directive	2021-06-08 10:35:57 -04:00
Samuel Clay	8f5e0ba690	Ignore missing task_env.py.	2021-06-08 10:23:51 -04:00
Jonathan Math	78120ad11c	keep sanity checker container alive and only use on task_work servers	2021-06-07 16:27:46 -04:00
Jonathan Math	adf7955df5	add the rest of the sanity checkers to ansible	2021-06-07 15:57:01 -04:00
Samuel Clay	a63b4097a3	Fixing nginx on staging to expose proper ports.	2021-05-19 22:03:53 -04:00
Samuel Clay	82fddd415f	Switching from network_mode host to using a docker network. This gets us off host networking and to defined ports. The docker network connects the container's dns resolver to the machine's dnsmasq, which is used for consul.	2021-05-19 17:26:47 -04:00
Samuel Clay	d19f062b2a	Don't know why ansible keeps running a never tag	2021-05-11 17:14:53 -04:00
Samuel Clay	4efa1319a1	Mongo secondaries are on the primary consul.	2021-05-11 17:11:51 -04:00
Samuel Clay	a52bea2829	Removing separate celerybeat container and using unified celery+celerybeat container.	2021-04-22 16:27:57 -04:00
Samuel Clay	5d7ddb1d8a	Adding netdata in to task servers. Also setting up logrotate.	2021-04-22 11:36:44 -04:00
Samuel Clay	53e6998bbc	Adding celery start	2021-04-21 11:23:16 -04:00
Samuel Clay	230716465e	Adding new optional app/task env settings.	2021-04-20 18:02:12 -04:00
Samuel Clay	c96daac120	Don't restart unless requested.	2021-04-17 11:31:56 -04:00
Samuel Clay	0d01874cf2	Adding docker restart for applying celery container changes.	2021-04-14 13:06:57 -04:00
Samuel Clay	2251d29c2f	Celery should always reset.	2021-04-06 16:16:50 -04:00
Samuel Clay	d52a8d362c	Reducing number of workers on docker-compose. Also removing extraneous task servers and consolidating to task-celery for feeds and task-work for cron and work	2021-03-17 20:13:58 -04:00
Samuel Clay	05afdce691	Fixing search indexing. Also removing superfluous search_indexer_tasker queue.	2021-03-03 17:04:05 -05:00
Samuel Clay	cb0ccb3e02	Whitney everywhere. This is a big change. I think everything needs a 1px bump up in size.	2021-02-26 17:25:22 -05:00
Samuel Clay	d54de1cd23	Handling ConnectionResetError	2021-02-25 20:04:24 -05:00
Samuel Clay	01248e5a1b	Fixing task servers. Also fixing sentry max size limit.	2021-02-25 18:50:20 -05:00
Samuel Clay	67e36c40a6	Reloading celery when app secrets changes.	2021-02-25 11:34:40 -05:00
Samuel Clay	e6d6667099	Adding consul tags for easy installation on services.	2021-02-23 19:30:28 -05:00
Samuel Clay	06bdbf48e9	Splitting task into four task servers. Renaming elasticsearch to db-elasticsearch. Working on HAProxy.	2021-02-17 21:07:12 -05:00
Jonathan Math	f81390bf8a	registering task services in consul	2021-02-15 19:21:53 -05:00
Jonathan Math	df30dac8c5	fix string interpolation issue in celery_task role	2021-02-02 23:28:31 -05:00
Jonathan Math	7db3f3099f	add celery_task role and ruse in in setup_task.yml	2021-02-02 23:20:33 -05:00