Commit graph

1761 commits

Author SHA1 Message Date
Samuel Clay
9f46ca2c77 Extending send service buttons. 2024-08-06 15:37:24 -07:00
Samuel Clay
db3bcc9180 Merge branch 'master' into discover
* master:
  Handling missing youtube duration.
  Fixing strip underscore
2024-08-04 13:56:47 -07:00
Samuel Clay
be9bbbd349 Handling missing youtube duration. 2024-07-11 11:01:09 -04:00
Samuel Clay
16cbf30e60 Fixing strip underscore 2024-07-11 10:59:42 -04:00
Samuel Clay
c31893f669 Merge branch 'master' into discover
* master:
  iOS 15 screenshots
  Don't use the underscore cache buster anymore.
  Correct archive sub count
  Don't resync stories on new sub if it already has archive subscribers.
2024-07-06 07:25:03 -04:00
Samuel Clay
84d0e4545e Don't use the underscore cache buster anymore. 2024-07-03 12:10:19 -04:00
Samuel Clay
e862793e01 Merge branch 'master' into discover
* master:
  More numpy changes.
  Strip underscores from feed addresses, special case jwz
2024-06-30 12:34:14 -04:00
Samuel Clay
546f338b8c Strip underscores from feed addresses, special case jwz 2024-06-30 12:13:29 -04:00
Samuel Clay
55dda973da Merge branch 'master' into discover
* master:
  Allowing traffic on docker0 interface.
  Clean TXT records so letsencrypt doesn't fail
  Thresholding bounced newsletters email.
  Another type of invalid url on the widget.
  Handling broken urls on widget
  Handling broken urls on image extraction.
  Handling invalid forgot password form.
  Fixing global shared stories blurblog.
  https for stripe urls. Fixes #1865.
2024-06-29 08:19:51 -04:00
Samuel Clay
7f045ba535 Thresholding bounced newsletters email. 2024-06-03 09:25:21 -04:00
Samuel Clay
da0275d7e6 Merge branch 'black-formatting' into discover
* black-formatting:
  Black formatting and isort
2024-04-24 09:52:22 -04:00
Samuel Clay
7165aa1bf6 Black formatting and isort 2024-04-24 09:50:42 -04:00
Samuel Clay
c63067754d Merge branch 'black-formatting' into discover
* black-formatting:
  Black formatting.
2024-04-24 09:49:17 -04:00
Samuel Clay
d1dafe7606 Black formatting. 2024-04-24 09:43:56 -04:00
Samuel Clay
573476e003 Merge branch 'master' into discover
* master: (84 commits)
  Cleanup postgres
  Adding support for hyphens in youtube usernames.
  New APNS updating cert instructions.
  Fiddling with metrics server.
  Handling broken youtube channel
  Youtube username/title
  Handling youtube usernames that are actually handles.
  Handling @handle youtube.com feeds when adding a feed.
  Users who are too far into paging now get a 404
  Updating youtube fetcher to use channels/playlists/users for everything, no longer relying on RSS/xml url.
  Updating certs.
  Handling too many feeds tasked.
  Bumping concurrency for feed fetchers.
  Icon importer also uses new consul domain.
  User not user agent
  Adding individual IP addresses from hetzner.
  Moving hetzner migration doc to archive
  Formatting
  Adding dwww
  Moving node consul
  ...
2024-04-24 09:25:45 -04:00
Samuel Clay
f552d6f2c7 Adding support for hyphens in youtube usernames. 2024-04-01 08:33:45 -04:00
Samuel Clay
65e51ac6ec Handling broken youtube channel 2024-03-04 09:24:23 -05:00
Samuel Clay
0181a2e4b0 Youtube username/title 2024-03-04 09:21:00 -05:00
Samuel Clay
7d08632e9c Handling youtube usernames that are actually handles. 2024-03-03 13:09:59 -05:00
Samuel Clay
a5222d9675 Updating youtube fetcher to use channels/playlists/users for everything, no longer relying on RSS/xml url. 2024-03-03 12:59:12 -05:00
Samuel Clay
ec44039cc9 Updating certs. 2024-03-02 08:37:20 -05:00
Samuel Clay
fe708196ee Tailing logs needs a bit more width for new task servers. 2024-02-18 08:23:41 -05:00
Samuel Clay
7bd7d4ba9d Tailing logs needs a bit more width for new task servers. 2024-02-18 08:23:21 -05:00
Samuel Clay
0e71bfd27a Rewriting tlnb command to handle naming servers. 2024-02-10 15:01:28 -05:00
Samuel Clay
f9ad93e336 Adding hetzner servers. 2024-01-07 10:00:39 -05:00
Samuel Clay
b398bed406 Adding overlap 2023-12-25 14:01:33 -05:00
Samuel Clay
ac008c1be7 Count stats on user item rating csv. 2023-11-24 15:51:59 -05:00
Samuel Clay
3acd6d1f82 It's a wash if this does anything. 2023-11-10 17:13:46 -05:00
Samuel Clay
7afed3e897 Attempting to add openai model. 2023-08-20 07:43:21 -04:00
Samuel Clay
ea22256c59 Increasing apns payload size close to the max of 4kb. 2023-05-10 07:26:22 -04:00
Samuel Clay
8adc2035ea Also handling time out in feedparser. 2023-05-09 09:35:56 -04:00
Samuel Clay
792ba9d204 Removing fetch user agent on timeout as well as 400 errors. 2023-05-09 09:31:09 -04:00
Samuel Clay
3de497d57e Bumping log colors. 2023-04-30 18:12:11 -04:00
Samuel Clay
9c49e0d5fe New twitter auth error. 2023-04-04 09:36:40 -04:00
Samuel Clay
6095bd709d Fixing relative image urls to be absolute urls. Looks like a BeautifulSoup4 upgrade didn't catch the new attrs syntax. Also fixing bookmarklet loading wrong JS/CSS in development. 2022-11-24 12:53:40 -05:00
Samuel Clay
855a96d633 Fixing NYPost feed by ensuring enclosures with href attrbiutes are added to stories even without content. Thanks @kleinmatic! 2022-11-23 12:21:46 -05:00
Samuel Clay
f93eb2520c Adding file size and archive count to rss feed fetch status board. 2022-09-11 22:13:54 -04:00
Samuel Clay
57cf284f13 Adding slow log aggregator to uncover which users and paths are slowest. 2022-09-11 21:37:02 -04:00
Samuel Clay
e83a8e5a9b Revert "Bumping min to fetch by 1.5X to root out 12 minute broken feed. If this succeeds, narrow down the min_to_decay and then find the feed."
This reverts commit fd16bb0b73.
2022-09-11 08:45:29 -04:00
Samuel Clay
fd16bb0b73 Bumping min to fetch by 1.5X to root out 12 minute broken feed. If this succeeds, narrow down the min_to_decay and then find the feed. 2022-09-11 04:54:35 -04:00
Samuel Clay
cdf5a36b81 Don't delete redis keys because they take time to rebuild and subs can be counted incorrectly during that time. 2022-08-10 17:45:25 -04:00
Samuel Clay
fa77ff6a27 Also scrub twitter authors for xml invalid chars. 2022-07-02 13:11:25 -04:00
Samuel Clay
b26817ba77 Refactoring xml serialization. 2022-07-02 13:09:37 -04:00
Samuel Clay
80a1d57944 Remove unserializable control characters from tweets. 2022-07-02 12:58:30 -04:00
Samuel Clay
63635f42e1 Replacing @username's in tweets with links. 2022-07-01 17:00:22 -04:00
Samuel Clay
fa78ec335a Handling missing feed 2022-07-01 13:37:55 -04:00
Samuel Clay
3cf7f1e7c8 Need a feed to process. 2022-07-01 13:32:33 -04:00
Samuel Clay
1d1859db7d Handling missing feed on exception retry. 2022-07-01 13:29:49 -04:00
Samuel Clay
d4833a0d56 Updating redis query log to include response time as well. Huge improvement in redis monitoring. 2022-06-24 12:30:29 -04:00
Samuel Clay
4fe6110e96 Moving redis introspection to send_command, not just pack_command 2022-06-23 17:57:31 -04:00