Commit graph

1505 commits

Author SHA1 Message Date
Samuel Clay
108bd53efb Bytes go to utf-8 2021-03-25 15:35:45 -04:00
Samuel Clay
213ee843f2 Fixing feed finder py3 issue. 2021-03-24 20:30:11 -04:00
Samuel Clay
2b2cbefee4 Fixing feed finder py3 issue. 2021-03-24 20:28:20 -04:00
Samuel Clay
0ffcd8b35f Extending tlnb. 2021-03-17 20:53:25 -04:00
Samuel Clay
d52a8d362c Reducing number of workers on docker-compose. Also removing extraneous task servers and consolidating to task-celery for feeds and task-work for cron and work 2021-03-17 20:13:58 -04:00
Samuel Clay
dbd6f8bdee No consul on discovery. Fixing tlnb. 2021-03-16 15:20:24 -04:00
Samuel Clay
c424c3bb0f Merge branch 'master' into dashboard3
* master:
  Handling monitor failure
  Failed feeds fetched monitor needs to handle edge case.
  Move WebSub callbacks to HTTPS
2021-03-09 17:07:04 -05:00
Samuel Clay
a1475b3e51 Handling monitor failure 2021-03-09 17:05:55 -05:00
Samuel Clay
e7eeb6a2a2 Failed feeds fetched monitor needs to handle edge case. 2021-03-09 17:04:06 -05:00
Samuel Clay
bae6cf7348 Fixing feedback date format. 2021-03-09 12:42:02 -05:00
Samuel Clay
05afdce691 Fixing search indexing. Also removing superfluous search_indexer_tasker queue. 2021-03-03 17:04:05 -05:00
Samuel Clay
eac7e71b81 Refactoring image size fetcher to be much simpler, albeit slower. 2021-03-03 13:50:22 -05:00
Samuel Clay
b64f06c269 Refactoring tlnb and sshdo commands for new Docker-based installation. 2021-03-03 11:15:09 -05:00
Samuel Clay
28b09b5f3b Adding another exception handler to feed fetcher. 2021-03-03 09:30:20 -05:00
Samuel Clay
b266e3da4e badStatusLine exception handling. 2021-03-02 19:05:37 -05:00
Samuel Clay
5bf3cc251f IncompleteRead error 2021-03-02 19:03:57 -05:00
Samuel Clay
94e27a1f7b No need to decode 2021-03-02 18:33:00 -05:00
Samuel Clay
5adbafb046 bytes need bytes 2021-03-02 18:16:57 -05:00
Samuel Clay
cd62b41acf Convert bytes to str 2021-03-02 10:25:56 -05:00
Samuel Clay
8e088ba350 Switching to py3 html parser. 2021-03-02 09:46:59 -05:00
Samuel Clay
dffcd484d9 Handling SerialisationError 2021-02-28 20:20:41 -05:00
Samuel Clay
5e2e237871 Adding IncompleteRead error handling, fixing spacing. 2021-02-28 20:18:53 -05:00
Samuel Clay
37559d7237 Fixing InvalidURL 2021-02-26 11:39:36 -05:00
Samuel Clay
414c05bfbe Fixing ConnectionResetError. 2021-02-26 11:35:13 -05:00
Samuel Clay
d54de1cd23 Handling ConnectionResetError 2021-02-25 20:04:24 -05:00
Samuel Clay
ba6a8c81e0 Switching from raven to sentry sdk. 2021-02-25 19:52:36 -05:00
Samuel Clay
1fe20b91a9 Fixing py3 encoding issue when stripping comments using lxml. 2021-02-25 19:47:13 -05:00
Samuel Clay
c5f4734de4 Finally getting sentry to work in feed fetching. 2021-02-25 19:32:48 -05:00
Samuel Clay
7f328b11c8 Typo 2021-02-25 19:16:28 -05:00
Samuel Clay
1d16ec88b1 Wrapping feed fetcher in sentry exception capturing. 2021-02-25 19:13:21 -05:00
Samuel Clay
1da9f57697 Fixing broken request introspection. 2021-02-24 12:07:44 -05:00
Samuel Clay
fcebadfc64 Moving up ignore path. 2021-02-24 12:05:19 -05:00
Samuel Clay
3f75df76b6 Wrong url 2021-02-24 12:01:12 -05:00
Samuel Clay
297111917e Ignore haproxy check in logging. 2021-02-24 12:00:12 -05:00
Samuel Clay
d1e9f6764f Merge branch 'master' into dashboard3
* master:
  Backing up postgres version
2021-02-18 20:59:22 -05:00
Samuel Clay
8e224de2b9 Backing up postgres version 2021-02-18 20:57:56 -05:00
Samuel Clay
b6e0d835bd Renaming consul-manager to db-consul. Handling multiples in terraform by naming them with the droplet index. 2021-02-18 13:51:06 -05:00
Samuel Clay
5be06eefd3 Adding sshdo options to connect to old cluster. 2021-02-11 13:27:58 -05:00
Samuel Clay
e8fb94af23 Fixing new stories coming into dashboard being filtered out incorrectly. 2021-02-03 20:06:08 -05:00
Samuel Clay
dccb87bd26 Adding files for common setup on app. Finishing up dynamic inventory. 2021-01-28 19:06:30 -05:00
Samuel Clay
c7f4cbb13d Fixing a substantial number of encoding errors. Also fixing OPML uploads. 2021-01-24 21:05:22 -05:00
Samuel Clay
8cf070a72d Merge branch 'master' into dashboard3
* master:
  Removing old types field. Needed to upgrade to mongo 3.4.
  Checking if a feed has any notifications on it, set a max of 30 min fetch (yes this is a pretty good way of getting your feeds to fetch faster, but youll have to deal with the notifications).
  Fix task fetch monitor.
  Attempting to see iOS premium status over email.
  Handling work queue missing error.
2021-01-23 17:55:01 -05:00
Samuel Clay
d2f1a417c9 Fix task fetch monitor. 2021-01-22 19:31:49 -05:00
Samuel Clay
e15c5a358f Handling work queue missing error. 2021-01-20 21:25:01 -05:00
Samuel Clay
b91a906b45 Merge branch 'master' into dashboard3
* master:
  Limiting work queue checks.
2021-01-20 17:34:19 -05:00
Samuel Clay
3811d288d8 Limiting work queue checks. 2021-01-20 17:20:01 -05:00
Samuel Clay
33508f7361 Merge branch 'master' into dashboard3
* master:
  Executable monitor work queue.
  Adding monitor for work queue.
  Pointing to the new ssl cert.
  More descriptive failure email
  No default value
  Spitting out error on failure.
  Handling missing values
  Needs redis
  Only warn about falling feed fetches when actually falling.
  Revert "Removing unused types key from index."
2021-01-20 14:21:48 -05:00
Samuel Clay
e4cfb73b4f Executable monitor work queue. 2021-01-20 13:32:47 -05:00
Samuel Clay
b54c98198e Adding monitor for work queue. 2021-01-20 13:29:12 -05:00
Samuel Clay
4a608d2ce5 Finding all old celery invocations. 2021-01-19 17:30:11 -05:00