Commit graph

490 commits

Author SHA1 Message Date
Samuel Clay
82bba3f6a7 Temporarily disabling extra redis calls for archive users. 2022-05-25 18:21:42 -04:00
Samuel Clay
d65ece02d8 Left in a query that should've been higher. 2022-05-25 17:46:46 -04:00
Samuel Clay
1116569160 Adding graphic to archive thank you email. 2022-05-05 16:03:14 -04:00
Samuel Clay
03cab31143 Only use oldest unread story in unread only read filter for archive subscribers. Otherwise it will trim stories older than the oldest unread in All Stories. 2022-04-18 16:23:52 -04:00
Samuel Clay
5981b24588 Counting pre-archive pages. Need to format the email to better show what the user gained. And also to make it shareable. 2022-04-18 14:08:28 -04:00
Samuel Clay
ac593494db Sending all of a user's feeds through the archive fetcher to fill out their backfill, then email them the new stories. 2022-04-18 13:29:13 -04:00
Samuel Clay
ea31cef872 Fixed an issue where a feed going from 0 unreads to a manually marked unread would not show up in the river because the unread count was still marked as dirty. Now client will force an immediate feed recount when marking unread. 2022-03-29 12:25:38 -04:00
Samuel Clay
a633c0983b Taking archive unreads into account in single feeds. 2022-03-23 16:25:03 -04:00
Samuel Clay
da1f2c477a Adding user feed unreads to unread story list. That took care of the river it seems. Now for unread counts. 2022-03-18 17:36:27 -04:00
Samuel Clay
efea59efb3 Now cutting down unread story cache based on unread filter's min and max cutoffs. Less to store. 2022-03-18 17:29:35 -04:00
Samuel Clay
e58c135eb6 Rewrote user feed unread to live on redis and to change the stories coming out of UserSubscription.get_stories. Still need to update unread status and work on river. 2022-03-18 17:18:27 -04:00
Samuel Clay
7657f8ecf7 Renaming story can be marked as unread 2022-03-10 15:41:51 -05:00
Samuel Clay
d9b235498c Missing import 2022-03-10 12:04:27 -05:00
Samuel Clay
e061f410cc Stubbing in new MUserUnreadStory model. This is only for unread stories beyond a premium archive user's unread_cutoff. Need to change unread counts and get_stories to consider these stories. 2022-03-09 17:51:32 -05:00
Samuel Clay
3940e3f2a4 Less text 2022-01-19 14:32:27 -05:00
Samuel Clay
fdeca57412 Changing cutoff dates when fetching stories, fixing issues around Oldest first for both unreads and all stories. 2022-01-18 15:25:15 -05:00
Samuel Clay
2792e7305a Syncing redis on premium upgrade to sync new unread date possibilities for archive users. 2022-01-13 16:56:30 -05:00
Samuel Clay
1dd921fa61 Adding DAYS_OF_UNREAD_ARCHIVE and updating all the upread_cutoff's I could find. Doesn't seem to work yet when marking an older story as unread, but there's probably a line somewhere that's preventing the unread from working. 2022-01-13 14:55:44 -05:00
Samuel Clay
548ea15a9f Scheduling feed fetches immediately if found in safety net. 2022-01-12 12:04:25 -05:00
Samuel Clay
c766e781ed JSON Feeds 1.1. 2021-04-02 13:27:33 -04:00
Samuel Clay
dbec2708da Only show active feeds in dashboard river. Also link dashboard river title and icon. 2021-03-04 10:24:17 -05:00
Samuel Clay
889d37cebb Smarter merging of repeat feeds/folders when compacting folders. 2021-03-03 17:56:23 -05:00
Samuel Clay
4cc6246e4e Better logging for user sub folders compaction. 2021-02-02 19:23:53 -05:00
Samuel Clay
22162551d7 Rewriting compact to handle duplicate folders. 2021-02-02 19:18:01 -05:00
Samuel Clay
5869f40fe0 Weird encoding error on redis' part, where a DUMP causes an encoding error due to decode_responses=True. Seems easy enough to work around. 2021-01-14 19:42:38 -05:00
Samuel Clay
c1b9e0b09f Removing pdb 2021-01-14 19:27:15 -05:00
Samuel Clay
a20272ec9b New display options save. Now to hook them up. 2021-01-14 18:14:11 -05:00
Samuel Clay
a1f4d67d27 Changing how tasks are called. 2021-01-06 14:42:24 -05:00
Samuel Clay
82fecb23a6 Merge branch 'docker_django3.1' into dashboard3
* docker_django3.1: (117 commits)
  Adding docker to node scripts.
  Removing node_modules from repo
  Whoops
  Better logging for broken paypal ipns.
  Adding RSS Tracker for Windows to Goodies.
  Refactoring socketio so real-time works around username restrictions.
  Socket.IO v3 on the server too.
  Switching to Socket.IO v3.
  Haproxy splitting for socketio 3
  Socket.io 3
  Handling missing feed.
  Only nb.local.com uses ports for websockets.
  Adding GrazeTEN
  Full node install on setup.
  Updating toprc
  correct newsblur to newsblur_web in tasks
  Changing mongodb server.
  Fixing toprc
  Attempting to collect queries for 1% of requests by using DEBUG.
  Fixing mongo install.
  ...
2021-01-05 19:36:49 -05:00
Samuel Clay
c790b7c5f7 Fixing v2 to v3 pickle issue by namespacing cache. 2020-12-17 11:55:06 -05:00
Samuel Clay
1cbbbcceaf Reversing social/river_stories due to change in comparison of sorted lists (the old way used a b-a comparator, which is backwards to timestamps. 2020-12-15 18:23:48 -05:00
Samuel Clay
92d8caf2b4 Merge branch 'django3.1' into docker_django3.1
* django3.1:
  Auto-enabling newsblur3 virtualenv.
  Fixing 2to3 string encoding.
  Rolling back pymongo.
  Upgrading all dependencies. This probably won't work (looking at you timezones).
  Updating feedparser.
  Django 3.1.
2020-12-08 13:06:56 -05:00
Samuel Clay
05756155b1 Merge branch 'django3.0' into docker_django3.0
* django3.0: (184 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 13:04:39 -05:00
Samuel Clay
aea4fcbe5b Merge branch 'django3.0' into django3.1
* django3.0: (27 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 09:10:51 -05:00
Samuel Clay
8371c635f7 Merge branch 'master' into django2.0
* master: (27 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 09:09:25 -05:00
Samuel Clay
2aaf6d8b25 Better handling of missing subs. 2020-12-07 13:32:53 -05:00
Samuel Clay
cab602e3f1 Handling missing user sub on feed delete. 2020-12-07 13:13:56 -05:00
Samuel Clay
57a5f96b1d Fixing 2to3 string encoding. 2020-12-03 18:12:39 -05:00
Samuel Clay
feff1cd449 2to3 2020-12-03 14:20:19 -05:00
Samuel Clay
b89e7dc429 Merge branch 'django1.11' into django2.0
* django1.11: (152 commits)
  request.raw_post_data -> request.body (django 1.6)
  Upgrading pgbouncer to 1.15.0.
  Finishing off Postgresql 13 upgrade.
  Upgrading to Postgresql 13.
  Ubuntu 20.04
  Fixing supervisor path issues
  Upgrading setuptools
  Fixing flask
  Handling over capacity for twitter.
  Max length for image_urls.
  Properly filtering newsletter feeds.
  Fixing issue with text importer on feed-less urls.
  Removing dependency, fixing encoding issue for pages.
  Fixing DB Monitor.
  Updating User Agent for all fetchers.
  Ignoring VSCode.
  Fixing DB Monitor.
  Updating User Agent for all fetchers.
  Ignoring VSCode.
  Fixing Statistics by fixing how timezones are handled.
  ...
2020-12-03 14:04:26 -05:00
Samuel Clay
1504ef7a4e Merge branch 'master' into django1.11
* master:
  Checking the 'credit' field if author not found. Works for TechRepublic, which I suspect is a one off.
  Handling multiple newsletter feeds.
  Attempting a fix of stories taking too long to sort while counting unreads.
  Fixing newsletter search.
  Fixing newsletter search.
  Newsletters feeds now de-duplicate based on sender email as well as sender name. This should cut down on duplicates.
  Android v10.1.1.
  Fix exception
  Update dependencies
  #1380 Use image proxy only for http images
  #1379 Automatic light/dark theme
  #1367 Starred stories service
2020-11-23 18:12:03 -05:00
Samuel Clay
e9992eeb53 Attempting a fix of stories taking too long to sort while counting unreads. 2020-11-19 19:56:21 -05:00
Samuel Clay
f77c0c1aff Redis LREM takes a new argument. 2020-11-13 11:06:46 -05:00
Jonathan Math
89e51a2937 change celery Task import and task initialization as per the new version of celery 2020-10-05 00:45:20 +07:00
Samuel Clay
c508c58224 Merge branch 'django1.11' into django2.0
* django1.11: (102 commits)
  Beginning fix of rss_feeds unit tests.
  Fixing unit test for profile app and signup.
  Remove highlights count when it reaches zero.
  Android v10.1b1.
  Stubbing in profile tests.
  Adding nginx.local.conf
  Adding original text and original story to API docs.
  #1282 Adding feed to root folder
  #1319 In app and external browser options
  Adding a smarter wakeup for real-time to handle cases where a laptop is re-opened but real-time is not immediately reestablished.
  #1348 (scroll indicators theme)
  #1344 (search loses focus)
  #1335 Auto theme option for OS level dark mode
  Fixing signup flow.
  #1347 Show pager with stories after using the intel trainer and refreshing
  #1272 Load HTML in comments
  New icon for Infrequent Site Stories.
  Allowing selection in private notes.
  Autoresizing private notes field.
  For #1035: Adding private notes to saved stories.
  ...
2020-08-10 17:53:48 -04:00
Samuel Clay
ac1471017d Merge branch 'django1.10' into django1.11
* django1.10: (102 commits)
  Beginning fix of rss_feeds unit tests.
  Fixing unit test for profile app and signup.
  Remove highlights count when it reaches zero.
  Android v10.1b1.
  Stubbing in profile tests.
  Adding nginx.local.conf
  Adding original text and original story to API docs.
  #1282 Adding feed to root folder
  #1319 In app and external browser options
  Adding a smarter wakeup for real-time to handle cases where a laptop is re-opened but real-time is not immediately reestablished.
  #1348 (scroll indicators theme)
  #1344 (search loses focus)
  #1335 Auto theme option for OS level dark mode
  Fixing signup flow.
  #1347 Show pager with stories after using the intel trainer and refreshing
  #1272 Load HTML in comments
  New icon for Infrequent Site Stories.
  Allowing selection in private notes.
  Autoresizing private notes field.
  For #1035: Adding private notes to saved stories.
  ...
2020-08-10 17:52:24 -04:00
Samuel Clay
4e90e86e04 Merge branch 'django1.8' into django1.9
* django1.8: (102 commits)
  Beginning fix of rss_feeds unit tests.
  Fixing unit test for profile app and signup.
  Remove highlights count when it reaches zero.
  Android v10.1b1.
  Stubbing in profile tests.
  Adding nginx.local.conf
  Adding original text and original story to API docs.
  #1282 Adding feed to root folder
  #1319 In app and external browser options
  Adding a smarter wakeup for real-time to handle cases where a laptop is re-opened but real-time is not immediately reestablished.
  #1348 (scroll indicators theme)
  #1344 (search loses focus)
  #1335 Auto theme option for OS level dark mode
  Fixing signup flow.
  #1347 Show pager with stories after using the intel trainer and refreshing
  #1272 Load HTML in comments
  New icon for Infrequent Site Stories.
  Allowing selection in private notes.
  Autoresizing private notes field.
  For #1035: Adding private notes to saved stories.
  ...
2020-08-10 17:51:46 -04:00
Samuel Clay
5a3884c3bd Merge branch 'django1.7' into django1.8
* django1.7: (102 commits)
  Beginning fix of rss_feeds unit tests.
  Fixing unit test for profile app and signup.
  Remove highlights count when it reaches zero.
  Android v10.1b1.
  Stubbing in profile tests.
  Adding nginx.local.conf
  Adding original text and original story to API docs.
  #1282 Adding feed to root folder
  #1319 In app and external browser options
  Adding a smarter wakeup for real-time to handle cases where a laptop is re-opened but real-time is not immediately reestablished.
  #1348 (scroll indicators theme)
  #1344 (search loses focus)
  #1335 Auto theme option for OS level dark mode
  Fixing signup flow.
  #1347 Show pager with stories after using the intel trainer and refreshing
  #1272 Load HTML in comments
  New icon for Infrequent Site Stories.
  Allowing selection in private notes.
  Autoresizing private notes field.
  For #1035: Adding private notes to saved stories.
  ...
2020-08-10 17:51:25 -04:00
Samuel Clay
7ee517444e Merge branch 'django1.6' into django1.7
* django1.6: (102 commits)
  Beginning fix of rss_feeds unit tests.
  Fixing unit test for profile app and signup.
  Remove highlights count when it reaches zero.
  Android v10.1b1.
  Stubbing in profile tests.
  Adding nginx.local.conf
  Adding original text and original story to API docs.
  #1282 Adding feed to root folder
  #1319 In app and external browser options
  Adding a smarter wakeup for real-time to handle cases where a laptop is re-opened but real-time is not immediately reestablished.
  #1348 (scroll indicators theme)
  #1344 (search loses focus)
  #1335 Auto theme option for OS level dark mode
  Fixing signup flow.
  #1347 Show pager with stories after using the intel trainer and refreshing
  #1272 Load HTML in comments
  New icon for Infrequent Site Stories.
  Allowing selection in private notes.
  Autoresizing private notes field.
  For #1035: Adding private notes to saved stories.
  ...
2020-08-10 17:49:20 -04:00
Samuel Clay
5c18498d99 No future dating mark read dates due to stories being future dated. 2020-07-09 17:56:13 -04:00