Commit graph

72 commits

Author SHA1 Message Date
Samuel Clay
5f02400567 Re-normalizing dense vectors from 1584 dimensions to 256 dimensions, applying bbq_hnsw index to save 96% memory usage on vector embeddings. 2024-12-24 19:40:48 -05:00
Samuel Clay
2931e5d578 Moving to OpenAI Embeddings API. 2024-10-10 21:56:49 -07:00
Samuel Clay
d1dafe7606 Black formatting. 2024-04-24 09:43:56 -04:00
Samuel Clay
221743acbd Keep auto premium on for docker installs. 2022-09-26 09:40:18 -04:00
Samuel Clay
9e21d03255 Merging SDIFFSTORE and ZINTERSTORE into a single ZDIFFSTORE, thanks to redis 6.2.0. Requires new docker image. 2022-07-19 21:02:42 -04:00
Samuel Clay
8f1655d7d1 Revert "Merging SDIFFSTORE and ZINTERSTORE into a single ZDIFFSTORE, thanks to redis 6.2.0. Requires new docker image."
This reverts commit b3ec9fd748.
2022-07-18 22:45:22 -04:00
Samuel Clay
b3ec9fd748 Merging SDIFFSTORE and ZINTERSTORE into a single ZDIFFSTORE, thanks to redis 6.2.0. Requires new docker image. 2022-07-18 22:34:07 -04:00
Samuel Clay
b90501d955 Adding a paypal archive return page. Also redrawing when premium expire/renewal status changes on payment fetch in account dialog. 2022-04-06 15:56:13 -04:00
Samuel Clay
65fac88590 Merge branch 'master' into pro
* master:
  Renaming www in terraform until next www server
  Removing audio handler
  Removing unused audio handler shim that turned audio into flash for older browsers.
  Adding global shared stories feeds so they appear on the dashboard even when not subscribed.
  Adding metrics to a single server, let's see how these shake out.
  Don't show prometheus metrics for migrations.
  Adding django prometheus metrics.
  Beginning upgrade to Mongo 4.0 (eventually to 5.0 to get time-series dbs)
2022-04-01 16:47:03 -04:00
Samuel Clay
893619596b Adding django prometheus metrics. 2022-03-31 15:34:33 -04:00
Samuel Clay
ea31cef872 Fixed an issue where a feed going from 0 unreads to a manually marked unread would not show up in the river because the unread count was still marked as dirty. Now client will force an immediate feed recount when marking unread. 2022-03-29 12:25:38 -04:00
Samuel Clay
a633c0983b Taking archive unreads into account in single feeds. 2022-03-23 16:25:03 -04:00
Samuel Clay
d231499672 Merge branch 'master' into pro
* master: (28 commits)
  Bumping up node images size.
  Android v11.3.0.
  #1600 Mark story as read button width
  Cleaning up preferences on android
  Merge master into sictiru
  #1600 Mark story read timer WIP
  #1600 Mark story read immediately or manually.
  #1634 Update infrequent logo
  #1606 Adjust story title length based on story content preview style.
  #1628 Handle feed missing metadata.
  Merge master into sictiru
  #1618 Handle multi window mode lifecycle.
  #1624 Offer context before potentially logging out.
  Android v11.2.2.
  #1598 Add immutable flag for PendingIntents
  Android v11.2.1.
  Fix reading pager fragment transaction.
  Open billing connection for the subscription sync service.
  Android v11.2
  Finishing up PostgreSQL migration. Needs to test backups.
  ...
2022-03-09 17:32:07 -05:00
Samuel Clay
f33cbcf312 Merge branch 'master' into pro
* master: (72 commits)
  Missing import
  Correctly decoding shared stories in RSS feed.
  Adding scroll to feed and story options popover (Style menu).
  Magazine view blog post.
  Refactoring story content preview with newlines preserved.
  Boosting db profiling from 1% to 5%.
  Ignore data uris for widget, they are never the big images
  Wait to strip data uri header until it's time.
  Moving encoding
  Don't double encode base64 images for widgets.
  Preserving paragraphs in magazine and grid views.
  Fixing bad instrumentation on mongo and redis logs.
  Wrong url for db profiler.
  Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
  Fixing strict bug where  wasn't defined.
  Showing grid image previews. Not sure how this ever worked before.
  Grid has image if found already.
  Showing grid image on load if youtube
  Only monitor river_stories for db times
  Not hitting a db shouldnt be colored any differently than a small value.
  ...
2022-03-09 11:41:40 -05:00
sictiru
3dd01ba2ef Merge master into sictiru 2022-03-06 20:33:19 -08:00
Samuel Clay
443925b6b7 Fixing starred date in header. 2022-02-28 12:20:14 -05:00
Samuel Clay
13533f84b7 Removing broken CSS. 2022-02-24 10:41:20 -05:00
sictiru
df6a225da2 Merge master into sictiru 2022-02-16 21:16:24 -08:00
Samuel Clay
8dc3573b7d Adding active_provider field to profile to capture most recent payment provider in order to show correction options on feedchooser/premium dialog. Paypal now upgrades, just need to write messaging stating switches should happen at rewewal. 2022-02-16 09:20:43 -05:00
Samuel Clay
88d07b143c Merge branch 'master' into pro
* master: (31 commits)
  Adding postgres backup log.
  Handling operation failures in flask metrics.
  Locking consul to a working version. Also changing flask status code response to handle custom status codes.
  Explicitly uploading mongo backups
  Only need date once in filename
  Rotating mongo backups
  Using full path for progress.
  Showing full path of postgres backup.
  Separating out restoring backups and storing backups.
  Moving to postgres backup directory.
  Executable postgres backup script.
  Compressing Postgres db sql backup.
  Adding date to tarball to allow for versioning.
  Correcting permissions on mongo backup
  Fixing mongo upload to s3 by using host networking mode.
  Removing unused backup code.
  Forgot import
  Adding progress bar to mongo backup.
  Refactoring aws keys for mongo backups.
  Moving mongo backups
  ...
2022-02-04 13:55:38 -05:00
Samuel Clay
22feba4443 Moving to S3 compatible backup bucket name. 2022-02-02 16:35:48 -05:00
Samuel Clay
4df9858eb0 Adding /reader/river_stories_widget which downloads the first image in each story and adds it inline as base64 encoded. 2022-02-02 15:11:50 -05:00
Samuel Clay
7889fe4cf0 Fixing bookmarklet and saved story tags. 2022-01-28 17:05:23 -05:00
Samuel Clay
07fe59cb57 Upgrading subscriptions with stripe now works, even pro-rated. Need to hook up Paypal and fix all billing inconsistencies. 2022-01-25 17:26:24 -05:00
Samuel Clay
39047ee938 Merge branch 'master' into pro
* master:
  Task deploy needs single sentry update.
  Turning off PuSH for standalone installs.
2022-01-25 15:46:25 -05:00
Samuel Clay
6a61620d32 Turning off PuSH for standalone installs. 2022-01-25 15:27:29 -05:00
Samuel Clay
ee63184075 Restyling premium upgrade dialog. Needs stripe/paypal hookup and billing integration. 2022-01-21 12:55:12 -05:00
Samuel Clay
8164767a59 Merge branch 'master' into pro
* master:
  Cleaning up django collection pipeline.
  Upgrading jQuery and jQuery UI, fixing closure compiler language output to work in older browser.
  Fixing scope of webmanifest.
  Changing webmanifest scope.
  Adding Web App Manifest for PWA.
2022-01-20 16:56:51 -05:00
Samuel Clay
ced2e7d6a6 Upgrading jQuery and jQuery UI, fixing closure compiler language output to work in older browser. 2022-01-20 13:19:35 -05:00
Samuel Clay
fc8f3cb03e Installing Java in deploy image to get closure compiler working. Also updating closure binary path. 2022-01-19 13:01:31 -05:00
Samuel Clay
d0fdbde96b Ensuring dependencies met for deployment on local. 2022-01-19 10:48:11 -05:00
Samuel Clay
fdeca57412 Changing cutoff dates when fetching stories, fixing issues around Oldest first for both unreads and all stories. 2022-01-18 15:25:15 -05:00
Samuel Clay
0baaa951b9 Adding preference for changing days of unreads. Need to kick off a re-counter on preference change. 2022-01-18 12:40:49 -05:00
Samuel Clay
2792e7305a Syncing redis on premium upgrade to sync new unread date possibilities for archive users. 2022-01-13 16:56:30 -05:00
Samuel Clay
1dd921fa61 Adding DAYS_OF_UNREAD_ARCHIVE and updating all the upread_cutoff's I could find. Doesn't seem to work yet when marking an older story as unread, but there's probably a line somewhere that's preventing the unread from working. 2022-01-13 14:55:44 -05:00
Samuel Clay
3ef72e6f83 Fixing feed fetch status screen to better show how subs are being fetched. 2022-01-12 11:58:28 -05:00
Samuel Clay
5414b4c414 Integrating admin without gziping, as that's causing issues. Ready to go. 2022-01-06 13:32:40 -05:00
Samuel Clay
ddeaf55be0 Cleaning up pipeline and adding admin static assets, but now certain admin static assets are being post-processed multiple times but with different cache manifests, resulting in a file not found error. This needs work. 2022-01-06 11:01:35 -05:00
Samuel Clay
76ffe7bb8a Fixing bookmarklet, moving endlne fleuron, adding load-line, archviing Jammit. 2022-01-05 11:18:31 -05:00
Samuel Clay
04c62b11c7 Cleaning up static assets. Needs to run on first make nb or DEBUG_ASSETS needs to always be set to True. 2022-01-04 15:54:37 -05:00
Samuel Clay
9432e9a5b8 Merge branch 'master' into pipeline
* master:
  Pruning docker, updating sentry release webhook only on local.
  Delete .github directory
  Adding Sentry release webhook to deployment of web, task, monitor, and node.
  Add Sentry action workflow for actions
  Moving from hosted Sentry to self-hosted sentry.
  Flask transactions are way too often.
  Cleanup
  Seems redundant with newsblur_web/docker_local_settings.py
  Using new repo password for postgres.
  Moving around postgres config
  Moving directories.
  Adding postgresql backup restoration. Working on config.
  Using user log for db times.
  Last 5 minutes is actually last minute.
  Adding 5min loadtime to prometheus graphs.
  Switching back to nbanalytics with user auth.
  Mongo auth
2022-01-03 18:04:40 -05:00
Samuel Clay
d19a4f7545 Cleanup 2021-12-18 15:00:32 -05:00
Samuel Clay
8be0192702 Cleaning up pipeline 2021-12-16 20:06:15 -05:00
Samuel Clay
3d59e59636 Turning on DEBUG_ASSETS so developers dont need to compress their own assets. 2021-12-16 16:07:45 -05:00
Samuel Clay
45b3cfdecf Switching from yuglify to the original closure compiler. Everything's working well, although deployment needs to be rearranged a bit. 2021-11-17 13:41:22 -05:00
Samuel Clay
5f77322e4f
Merge pull request #1548 from louis-pre/fix/youtube-docker-settings
fix(docker): Remove duplicate YouTube API key setting
2021-09-30 16:18:43 -04:00
Jonathan Math
7fa72f5be3 fix flask metrics python files 2021-09-21 12:13:46 -05:00
Louis Pré
55420dbbe2 fix: Remove duplicate YouTube API key setting 2021-09-19 11:21:27 -07:00
Samuel Clay
3e23b6394a Revert "Revert "Merge branch 'add_grafana_monitors'""
This reverts commit a7f5025a16.
2021-09-16 11:57:57 -05:00
Samuel Clay
a7f5025a16 Revert "Merge branch 'add_grafana_monitors'"
This reverts commit f0c2176908, reversing
changes made to 72ef2e2f00.
2021-09-07 11:36:11 -04:00