public-mirrors/NewsBlur
1
0
Fork 0
mirror of https://github.com/samuelclay/NewsBlur.git synced 2025-08-21 05:45:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16608 commits 16 branches 13 tags 926 MiB
Commit graph

1721 commits

Author SHA1 Message Date
Samuel Clay
cdf5a36b81 Don't delete redis keys because they take time to rebuild and subs can be counted incorrectly during that time. 2022-08-10 17:45:25 -04:00
Samuel Clay
fa77ff6a27 Also scrub twitter authors for xml invalid chars. 2022-07-02 13:11:25 -04:00
Samuel Clay
b26817ba77 Refactoring xml serialization. 2022-07-02 13:09:37 -04:00
Samuel Clay
80a1d57944 Remove unserializable control characters from tweets. 2022-07-02 12:58:30 -04:00
Samuel Clay
63635f42e1 Replacing @username's in tweets with links. 2022-07-01 17:00:22 -04:00
Samuel Clay
fa78ec335a Handling missing feed 2022-07-01 13:37:55 -04:00
Samuel Clay
3cf7f1e7c8 Need a feed to process. 2022-07-01 13:32:33 -04:00
Samuel Clay
1d1859db7d Handling missing feed on exception retry. 2022-07-01 13:29:49 -04:00
Samuel Clay
d4833a0d56 Updating redis query log to include response time as well. Huge improvement in redis monitoring. 2022-06-24 12:30:29 -04:00
Samuel Clay
4fe6110e96 Moving redis introspection to send_command, not just pack_command 2022-06-23 17:57:31 -04:00
Samuel Clay
81f51f1723 Handling soft time limits while fetching archives. 2022-06-22 17:40:16 -04:00
Samuel Clay
1665dc73a1 Don't skip pages on paged archives. 2022-06-22 14:49:31 -04:00
Samuel Clay
6c86bb479a Using correct url for rfc5005. 2022-06-22 12:11:52 -04:00
Samuel Clay
295bd65add Adding Twitter search. 2022-06-21 16:07:12 -04:00
Samuel Clay
6d5c1f29d5 Merge branch 'master' into pro 
* master:
  Substack now uses a <text> element, so we need to add it to the sanitizer.
 2022-06-07 09:36:18 -07:00
Samuel Clay
a269abc96d Substack now uses a <text> element, so we need to add it to the sanitizer. 2022-06-07 09:36:13 -07:00
Samuel Clay
9899816196 Fixing starting page for archives. 2022-05-24 11:40:49 -04:00
Samuel Clay
000c9b0954 Adding starting page for archive to help debug. 2022-05-24 11:37:54 -04:00
Samuel Clay
e6cf58a1d8 Boosting archive to 150 pages back. 2022-05-24 11:36:16 -04:00
Samuel Clay
b0a50f1834 Turning up the full archive. 2022-05-24 11:32:58 -04:00
Samuel Clay
8a5748fa37 Adding # of stories per dashboard module. Also fixing long-standing double load bug on initial page load. Fixed issues around phantom read stories popping in and out of existance on page load. 2022-05-16 17:21:46 -04:00
Samuel Clay
3a106b51bb Merge branch 'master' into pro 
* master:
  Don't change file permissions, let's see what happens.
  Bumping postgres server size, fixing monitor disk usage cronjob.
 2022-05-16 10:34:40 -04:00
Samuel Clay
b2cdff8a85 Bumping postgres server size, fixing monitor disk usage cronjob. 2022-05-13 16:59:57 -04:00
Samuel Clay
bfdfa10bfd Adding file system size (bytes) for feeds, decompressing stories to figure out their true size. Needs to be integrated into the UI. 2022-05-11 15:00:23 -04:00
Samuel Clay
9bb9700cc5 Merge branch 'master' into pro 
* master:
  Handling getMore mongo log.
  Naming pg_basebackup
 2022-05-11 13:12:06 -04:00
Samuel Clay
6b1d8cef78 Handling getMore mongo log. 2022-05-11 13:09:59 -04:00
Samuel Clay
5ff6a340f1 Merge branch 'master' into pro 
* master:
  Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery.
  Removing unused mongo mms utils and configs.
  Updating pymongo to mongodb 4.0 compatible. Any further and we lose mongo wire protocol inspection.
  Full arm64 setup for imageproxy.
  Rearranging TF vars
  Upgrading to MongoDB 4.0, and upping mongo servers.
 2022-05-10 20:59:03 -04:00
Samuel Clay
31de0f7a97 Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery. 2022-05-10 20:58:47 -04:00
Samuel Clay
7870eee728 Merge branch 'master' into pro 
* master:
  Moving pg basebackup to a backup role
  Adding a secondary postgres that starts from a pg_basebackup. Still needs testing.
  Adding timestamps to backup logs
  No TTY/input needed on backups.
  Paths are in different environments.
  Renaming postgresql backups
  Adding postgres restore command and updating backup script.
 2022-05-02 11:42:52 -04:00
Samuel Clay
1dc0e98448 Renaming postgresql backups 2022-04-29 16:53:47 -04:00
Samuel Clay
464fecd18e Adding postgres restore command and updating backup script. 2022-04-29 16:45:17 -04:00
Samuel Clay
2d2ed0a30d Adding postgres restore command and updating backup script. 2022-04-29 16:44:46 -04:00
Samuel Clay
de1fb57406 Finishing RFC 5005 archive fetcher (for #1109). Also fixing mongo commands and adding checks for archive subscribers. 2022-04-29 11:31:32 -04:00
Samuel Clay
4f69d15fcb RFC5005 fetching should be working, but the test site is changing urls to a weird http://x.com:443, so maybe we need to normalize the url? 2022-04-20 22:38:51 -04:00
Samuel Clay
104d50ff46 Use new url_normalize library, preserving old just in case anything changes. 2022-04-19 15:28:18 -04:00
Samuel Clay
4ee5525d71 Removing pdb 2022-04-19 15:27:59 -04:00
Samuel Clay
59b44088f6 Checking RFC5005 archive links in feeds. Needs testing, but first a fix for URL normalization. For #1109. 2022-04-19 13:26:39 -04:00
Samuel Clay
b4c9c4e896 Time to cleanup logging on archive. 2022-04-18 14:29:08 -04:00
Samuel Clay
5981b24588 Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable. 2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories. 2022-04-18 13:29:13 -04:00
Samuel Clay
43695b8cd4 Back-filling archive pages. This closes #1564. 2022-04-13 10:43:29 -04:00
Samuel Clay
ed0ed69aa1 Adding premium archive to home page. 2022-04-06 16:52:42 -04:00
Samuel Clay
a633c0983b Taking archive unreads into account in single feeds. 2022-03-23 16:25:03 -04:00
Samuel Clay
39e68e4744 Premium reason text 2022-03-17 15:36:49 -04:00
Samuel Clay
ab1481333c Randomizing reasons to upgrade. 2022-03-16 15:28:52 -04:00
Samuel Clay
a6ba249104 Fixing feed chooser selection issue. Adjusting sizes. 2022-03-16 12:01:02 -04:00
Samuel Clay
f33cbcf312 Merge branch 'master' into pro 
* master: (72 commits)
  Missing import
  Correctly decoding shared stories in RSS feed.
  Adding scroll to feed and story options popover (Style menu).
  Magazine view blog post.
  Refactoring story content preview with newlines preserved.
  Boosting db profiling from 1% to 5%.
  Ignore data uris for widget, they are never the big images
  Wait to strip data uri header until it's time.
  Moving encoding
  Don't double encode base64 images for widgets.
  Preserving paragraphs in magazine and grid views.
  Fixing bad instrumentation on mongo and redis logs.
  Wrong url for db profiler.
  Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
  Fixing strict bug where  wasn't defined.
  Showing grid image previews. Not sure how this ever worked before.
  Grid has image if found already.
  Showing grid image on load if youtube
  Only monitor river_stories for db times
  Not hitting a db shouldnt be colored any differently than a small value.
  ...
 2022-03-09 11:41:40 -05:00
Samuel Clay
d0571e2ab0 Wait to strip data uri header until it's time. 2022-03-08 13:11:08 -05:00
Samuel Clay
ca728af375 Don't double encode base64 images for widgets. 2022-03-08 12:48:57 -05:00
Samuel Clay
0e63da2d74 Fixing bad instrumentation on mongo and redis logs. 2022-03-07 15:57:51 -05:00