* master:
Upgrading to latest pymongo v3 to work with mongodb v4.0. Required rewrite of mongodb introspection, now using built-in pymongo monitoring. Should work on both web and celery.
Removing unused mongo mms utils and configs.
Updating pymongo to mongodb 4.0 compatible. Any further and we lose mongo wire protocol inspection.
Full arm64 setup for imageproxy.
Rearranging TF vars
Upgrading to MongoDB 4.0, and upping mongo servers.
* master:
Clear prometheus cache on reload.
Rearranging urls for paypal. Also updating to latest gunicorn.
Pulling latest docker image in a separate task.
Update elasticsearch:7.16.3 (Log4j 2.17.1)
* master:
Renaming www in terraform until next www server
Removing audio handler
Removing unused audio handler shim that turned audio into flash for older browsers.
Adding global shared stories feeds so they appear on the dashboard even when not subscribed.
Adding metrics to a single server, let's see how these shake out.
Don't show prometheus metrics for migrations.
Adding django prometheus metrics.
Beginning upgrade to Mongo 4.0 (eventually to 5.0 to get time-series dbs)
* master: (72 commits)
Missing import
Correctly decoding shared stories in RSS feed.
Adding scroll to feed and story options popover (Style menu).
Magazine view blog post.
Refactoring story content preview with newlines preserved.
Boosting db profiling from 1% to 5%.
Ignore data uris for widget, they are never the big images
Wait to strip data uri header until it's time.
Moving encoding
Don't double encode base64 images for widgets.
Preserving paragraphs in magazine and grid views.
Fixing bad instrumentation on mongo and redis logs.
Wrong url for db profiler.
Let's try showing only single feeds in the DB profiler to see if it's better at showing abnormalities with less noise.
Fixing strict bug where wasn't defined.
Showing grid image previews. Not sure how this ever worked before.
Grid has image if found already.
Showing grid image on load if youtube
Only monitor river_stories for db times
Not hitting a db shouldnt be colored any differently than a small value.
...
* master: (31 commits)
Adding postgres backup log.
Handling operation failures in flask metrics.
Locking consul to a working version. Also changing flask status code response to handle custom status codes.
Explicitly uploading mongo backups
Only need date once in filename
Rotating mongo backups
Using full path for progress.
Showing full path of postgres backup.
Separating out restoring backups and storing backups.
Moving to postgres backup directory.
Executable postgres backup script.
Compressing Postgres db sql backup.
Adding date to tarball to allow for versioning.
Correcting permissions on mongo backup
Fixing mongo upload to s3 by using host networking mode.
Removing unused backup code.
Forgot import
Adding progress bar to mongo backup.
Refactoring aws keys for mongo backups.
Moving mongo backups
...
* master:
Cleaning up django collection pipeline.
Upgrading jQuery and jQuery UI, fixing closure compiler language output to work in older browser.
Fixing scope of webmanifest.
Changing webmanifest scope.
Adding Web App Manifest for PWA.
* pipeline:
Installing Java in deploy image to get closure compiler working. Also updating closure binary path.
Ensuring dependencies met for deployment on local.
Updating to docker buildx for multi-arch builds (amd64 + arm64)
* master:
Pruning docker, updating sentry release webhook only on local.
Delete .github directory
Adding Sentry release webhook to deployment of web, task, monitor, and node.
Add Sentry action workflow for actions
Moving from hosted Sentry to self-hosted sentry.
Flask transactions are way too often.
Cleanup
Seems redundant with newsblur_web/docker_local_settings.py
Using new repo password for postgres.
Moving around postgres config
Moving directories.
Adding postgresql backup restoration. Working on config.
Using user log for db times.
Last 5 minutes is actually last minute.
Adding 5min loadtime to prometheus graphs.
Switching back to nbanalytics with user auth.
Mongo auth
* master: (84 commits)
Deploying new analytics server.
Create mongodb database user. Only runs on analytics, but should work fine on main mongo.
Adding second mongo analytics db, cleaning up mongo analytics auth.
Adding RSS autodiscovery to blog. Thanks https://forum.newsblur.com/t/irony-newsblur-cant-auto-extract-rss-feed-from-blog-newsblur-com/8849.
Revert "Merge branch 'state_timeline'"
Fixing syntax error
Solving docker networking container issues by turning iptables back on but using ufw after.rules that allow ufw to retain blocking ability. Works on Redis, now to move to mongo.
fix flask_metrics ansible role
add state timeline dashboard to grafana
move state timeline to one single flask that gets astate for all services
Mongo analytics monitor not reayd yet
Turning consul monitor back on.
Turning on analytics
Need to strip csv values.
Binding redis to public interface.
Restore postgres backup. Needs work.
Prepping postgres backup
Prepping postgres transition, writing redis db maintenance.
Prepping redis for moving back to primary.
Updating redis backup to include percentage progress and access to the correct data dump.
...
