1564 commits

Author	SHA1	Message	Date
Samuel Clay	f888e8a204	Only disconnecting twitter on expired token.	2021-07-09 12:46:07 -04:00
Samuel Clay	55adec1a74	Fixing zgrep to search python3 logs	2021-07-09 12:31:52 -04:00
Samuel Clay	f2e64ca36e	Fixing sanity checkers. None of them were running. Turns out they needed to be shell scripts if in the /etc/cron.hourly dir (and crontab format if in the /etc/cron.d dir).	2021-07-08 15:39:29 -04:00
Samuel Clay	2fea152441	No need to decode twice.	2021-07-05 12:57:21 -04:00
Samuel Clay	8d11cd68f1	Better normalization of feeds with feed:// in the protocol.	2021-07-05 12:54:23 -04:00
Samuel Clay	87b25c6bf6	Adding more granularity to mongo queries. Fixing double query bug.	2021-07-02 16:12:14 -04:00
Samuel Clay	14e3d6dd25	Fixing broken requirements.txt, downgrading pymongo to 3.6, since monitoring was changed and we're not ready for it yet.	2021-07-02 12:42:02 -04:00
Jonathan Math	18e43fd7f1	rm utils/test_settings.py. It is never used	2021-06-29 08:39:37 -06:00
Jonathan Math	0e81d2f346	no need to pass filename into backup_psql.py in ansible postgres backup. removing it	2021-06-27 14:40:00 -06:00
Jonathan Math	a78dec3ed9	fix syntax for backup_redis and duse socket for getting hostname instead of passing in as an argument	2021-06-27 14:36:24 -06:00
Jonathan Math	4846457bc4	fix syntax for mongo backups	2021-06-27 14:32:37 -06:00
Jonathan Math	8ede5a3987	change get_postgres_credentials.py to get_credentials.py so it can also be used to get the s3 bucket name. Fix postgres backups	2021-06-27 14:11:14 -06:00
Jonathan Math	4b257bce00	remove syntax error from redis bgsave sanity checker	2021-06-27 13:07:32 -06:00
Jonathan Math	fb1cdc9689	remove unused subprocess imports from sanity checkers	2021-06-25 11:41:29 -06:00
Samuel Clay	ae95b25910	Cleaning up monitors, switching to cron file, adding hostname.	2021-06-24 11:50:38 -04:00
Samuel Clay	f56acc1360	Enabling feed fetch monitor.	2021-06-24 11:24:59 -04:00
Samuel Clay	1d5173e7bc	Fixing monitor task fetches	2021-06-24 11:19:45 -04:00
Samuel Clay	96ccc7bdd9	Turning off work queue checker from firing all the time.	2021-06-24 11:12:52 -04:00
Jonathan Math	871947a849	fix disk usage sanity checker	2021-06-22 09:48:16 -06:00
Jonathan Math	4cea718d40	add redis backup and remove redundant redis backup scripts. Use one script and pass in hostname argument instead	2021-06-19 12:52:04 -06:00
Jonathan Math	c2bef5565b	add backup to ansible for postgres	2021-06-19 12:35:28 -06:00
Jonathan Math	97bc306567	add python paths to backup_mongo.py and backup_psql.py to make them executable	2021-06-19 12:24:33 -06:00
Jonathan Math	1dfd36630f	make backup_postgres compatible with docker/ansible	2021-06-19 12:17:19 -06:00
Jonathan Math	a71069994c	add mongo backup cronjob for ansible and integrate backup_mongo.py with docker setup	2021-06-19 12:02:29 -06:00
Jonathan Math	8d6a9732b3	use argv instead of env vars for redis log path	2021-06-19 10:03:02 -06:00
Jonathan Math	ad85403ab7	fix the monitors to work in cronjob and remove dead code	2021-06-19 09:56:35 -06:00
Jonathan Math	bf140f1aea	fix disk usage sanity checker to check host machine and pass the data into the container to evaluate the disk usage and send an email	2021-06-18 14:57:29 -06:00
Jonathan Math	7394517a40	try to make redis bgsave monitor work in docker	2021-06-16 11:58:57 -06:00
Jonathan Math	df70b0fdd2	try to fix redis bgsave util	2021-06-16 11:35:40 -06:00
Jonathan Math	915d051645	fix redis_bgsave to read docker bind-mounted data file and docker logs for redis	2021-06-16 11:28:39 -06:00
Jonathan Math	6ed9cb4bc8	change python path on redis_bgsave so it can be used in the newsblur container	2021-06-16 11:00:15 -06:00
Jonathan Math	1b5e2c9b31	fix monitor_disk_usage error	2021-06-16 10:56:30 -06:00
Jonathan Math	ba428afb83	use python path for newsblur container in disk usage sanity checker	2021-06-16 10:44:29 -06:00
Jonathan Math	706614498f	change python path back. it will need to go into a container because the import of newsblur.settings will require other modules that are in the newsblur base image	2021-06-16 10:36:50 -06:00
Jonathan Math	81c34d866c	change python path on monitor_disk_usage so it can be used in cron	2021-06-16 10:33:24 -06:00
Jonathan Math	4c2e7a37f5	change python path on monitor_disk_usage so it can be used in cron	2021-06-16 10:25:52 -06:00
Jonathan Math	27f9c655fb	update sanity checkers to fail for testing purposes	2021-06-16 10:12:59 -06:00
Samuel Clay	21a0d425b0	Typo on method.	2021-06-14 14:22:27 -04:00
Samuel Clay	25c9a75b9d	Disconnecting twitter when user is suspended or expired.	2021-06-14 14:21:23 -04:00
Samuel Clay	181a27ba68	Enumerating twitter errors.	2021-06-14 13:24:02 -04:00
Samuel Clay	ee7bd47e8b	Cleaning up deploy work and monitors. The task monitors need to be integrate with the flask db monitors.	2021-05-26 11:41:28 -04:00
Samuel Clay	d0f03779b3	Fixing sharing story issue with scrubbing encoding.	2021-05-14 20:52:28 -04:00
Samuel Clay	fe9272cc07	Python 3 doesn't leak variables from list comprehensions.	2021-05-13 15:41:40 -04:00
Samuel Clay	520438aaec	Newsletters should also send notifications.	2021-05-13 10:44:02 -04:00
Samuel Clay	b99603908b	Python 3 compatibility for requests in feed finder.	2021-05-12 15:52:48 -04:00
Samuel Clay	a83a7abda7	Adjusting sites loaded counter to ignore dashboard.	2021-04-30 12:47:29 -04:00
Samuel Clay	58f67e9216	Revert "Fixing feed finder py3 issue." ... This reverts commit 213ee843f2.	2021-04-30 11:21:40 -04:00
Samuel Clay	3f70025b7c	Revert "Fixing feed finder py3 issue." ... This reverts commit 2b2cbefee4.	2021-04-30 11:20:33 -04:00
Jonathan Math	e1748b8e90	remove netdata	2021-04-27 07:58:19 -05:00
Samuel Clay	fd96dfb0ae	Merge branch 'master' into dashboard3 ... * master: Sorting tasks times munin	2021-04-21 11:23:39 -04:00