Samuel Clay
2f4d823303
Handling @handle youtube.com feeds when adding a feed.
2024-03-03 13:06:08 -05:00
Samuel Clay
1f5e9053dd
Handling too many feeds tasked.
2024-02-28 09:33:10 -05:00
Samuel Clay
8c226b55d3
Icon importer also uses new consul domain.
2024-02-26 21:07:40 -05:00
Samuel Clay
dc883aeac2
Moving to new node page consul domain.
2024-02-25 17:54:11 -05:00
Samuel Clay
006bdc7964
Logging failed page fetch timeout.
2024-02-25 15:41:35 -05:00
Samuel Clay
c25f3da5f1
Handling missing story content.
2023-10-09 13:34:29 -04:00
Samuel Clay
1065c964fd
Fixing elasticsearch to allow consul to assume its OK.
2022-12-26 19:17:14 -05:00
Samuel Clay
5aa06c393f
Adding support for subscribing to Mastodon usernames (newsblur@mastodon.social for instance).
2022-11-25 10:08:07 -05:00
Samuel Clay
6095bd709d
Fixing relative image urls to be absolute urls. Looks like a BeautifulSoup4 upgrade didn't catch the new attrs syntax. Also fixing bookmarklet loading wrong JS/CSS in development.
2022-11-24 12:53:40 -05:00
Samuel Clay
855a96d633
Fixing NYPost feed by ensuring enclosures with href attrbiutes are added to stories even without content. Thanks @kleinmatic!
2022-11-23 12:21:46 -05:00
Samuel Clay
44f9f0d1b0
Fixing typo on blog.
2022-11-23 09:19:05 -05:00
Samuel Clay
8363ba3ff8
RSS status can include all users.
2022-09-11 21:01:16 -07:00
Samuel Clay
e83a8e5a9b
Revert "Bumping min to fetch by 1.5X to root out 12 minute broken feed. If this succeeds, narrow down the min_to_decay and then find the feed."
...
This reverts commit fd16bb0b73
.
2022-09-11 08:45:29 -04:00
Samuel Clay
fd16bb0b73
Bumping min to fetch by 1.5X to root out 12 minute broken feed. If this succeeds, narrow down the min_to_decay and then find the feed.
2022-09-11 04:54:35 -04:00
Samuel Clay
92c117bb9f
Spit out feeds being fetched to spot an errant one.
2022-09-10 10:11:22 -04:00
Samuel Clay
cdf5a36b81
Don't delete redis keys because they take time to rebuild and subs can be counted incorrectly during that time.
2022-08-10 17:45:25 -04:00
Samuel Clay
78547af24b
Adding cutoff from trimming stories for memory profiling.
2022-07-27 08:19:46 -04:00
Samuel Clay
381953ee78
Bumping highlights max from 1024 characters to 16384 characters.
2022-07-19 10:00:16 -04:00
Samuel Clay
c94bb6640d
Improving redis performance by reading the config.
2022-07-18 21:10:42 -04:00
Samuel Clay
3c0cab8d8e
Preserve feed even if no subs.
2022-07-01 13:48:10 -04:00
Samuel Clay
f1734e3755
Handling weird exceptions from the exception_retry.
2022-07-01 13:24:47 -04:00
Samuel Clay
1e2ecb19d9
Handling unparseable error in text importer.
2022-07-01 12:21:40 -04:00
Samuel Clay
0e42edeb89
Including size in feed title
2022-06-27 13:16:08 -04:00
Samuel Clay
5674fc981c
Adding stories in archive to stats popover.
2022-06-09 10:18:32 -07:00
Samuel Clay
8ab3d871e7
Adding feed archive count and showing it in Statistics (with the feed byte size on hover).
2022-06-06 16:03:50 -04:00
Samuel Clay
c2f6cc3d99
Turning premium setup back on
2022-06-05 19:38:28 -04:00
Samuel Clay
e64dc781ed
Ignoring premium setup for now.
2022-06-05 19:19:33 -04:00
Samuel Clay
289eedb46f
Only count subscribers if none found.
2022-06-05 19:16:59 -04:00
Samuel Clay
9899816196
Fixing starting page for archives.
2022-05-24 11:40:49 -04:00
Samuel Clay
f6f0738acd
Back off counting fs_size so much, only on feed cleanup (2% chance).
2022-05-21 06:22:39 -04:00
Samuel Clay
3881b838c9
Merge branch 'master' into pro
...
* master:
Wrong output from mongo featurecompatibilityversion.
Revert "Prod debug on local postgres."
Fix strict JS error during folder moves
2022-05-18 10:25:23 -04:00
Samuel Clay
5d3ec41c50
Wrong output from mongo featurecompatibilityversion.
2022-05-17 16:45:35 -04:00
Samuel Clay
e7c507bae9
Adding merge migration for mongo compatibility into pro.
2022-05-17 09:55:25 -04:00
Samuel Clay
022ace9d90
Merge branch 'master' into pro
...
* master:
Downgrading to mongodb 4.0 with featureCompatibilityVersion migration to prepare for mongo 4.2.
2022-05-17 09:54:39 -04:00
Samuel Clay
2d4b1f508b
Downgrading to mongodb 4.0 with featureCompatibilityVersion migration to prepare for mongo 4.2.
2022-05-17 09:42:04 -04:00
Samuel Clay
bfdfa10bfd
Adding file system size (bytes) for feeds, decompressing stories to figure out their true size. Needs to be integrated into the UI.
2022-05-11 15:00:23 -04:00
Samuel Clay
5ff6a340f1
Merge branch 'master' into pro
...
* master:
Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery.
Removing unused mongo mms utils and configs.
Updating pymongo to mongodb 4.0 compatible. Any further and we lose mongo wire protocol inspection.
Full arm64 setup for imageproxy.
Rearranging TF vars
Upgrading to MongoDB 4.0, and upping mongo servers.
2022-05-10 20:59:03 -04:00
Samuel Clay
31de0f7a97
Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery.
2022-05-10 20:58:47 -04:00
Samuel Clay
a880a24b55
All new icons for the feed list.
2022-05-04 11:27:32 -04:00
Samuel Clay
caf85b679a
Merge branch 'master' into pro
...
* master:
Showing reason why an original page won't load. Fixes #1519 .
2022-05-03 16:50:19 -04:00
Samuel Clay
16f002fd59
Oldest first now also uses feed pager unless unread only filter included.
2022-05-03 15:40:10 -04:00
Samuel Clay
909722b361
Showing reason why an original page won't load. Fixes #1519 .
2022-05-02 16:57:15 -04:00
Samuel Clay
de1fb57406
Finishing RFC 5005 archive fetcher (for #1109 ). Also fixing mongo commands and adding checks for archive subscribers.
2022-04-29 11:31:32 -04:00
Samuel Clay
5981b24588
Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable.
2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db
Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories.
2022-04-18 13:29:13 -04:00
Samuel Clay
43695b8cd4
Back-filling archive pages. This closes #1564 .
2022-04-13 10:43:29 -04:00
Samuel Clay
f33cbcf312
Merge branch 'master' into pro
...
* master: (72 commits)
Missing import
Correctly decoding shared stories in RSS feed.
Adding scroll to feed and story options popover (Style menu).
Magazine view blog post.
Refactoring story content preview with newlines preserved.
Boosting db profiling from 1% to 5%.
Ignore data uris for widget, they are never the big images
Wait to strip data uri header until it's time.
Moving encoding
Don't double encode base64 images for widgets.
Preserving paragraphs in magazine and grid views.
Fixing bad instrumentation on mongo and redis logs.
Wrong url for db profiler.
Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
Fixing strict bug where wasn't defined.
Showing grid image previews. Not sure how this ever worked before.
Grid has image if found already.
Showing grid image on load if youtube
Only monitor river_stories for db times
Not hitting a db shouldnt be colored any differently than a small value.
...
2022-03-09 11:41:40 -05:00
Samuel Clay
2491e3bf86
Fixing youtube story content encoding bug.
2022-03-03 11:21:06 -05:00
Samuel Clay
e2cdc90e3f
More potential checks for youtube videos in story image preview.
2022-02-23 16:28:16 -05:00
Samuel Clay
f403fb624e
Using youtube thumbnails as image url in stories.
2022-02-22 15:50:21 -05:00