Commit graph

118 commits

Author SHA1 Message Date
Samuel Clay
3e33a96b73 Handling missing user in slow log (from SF). 2022-09-12 08:58:05 -07:00
Samuel Clay
9868001f22 Adjusting datetimes on slow log. 2022-09-11 23:48:34 -04:00
Samuel Clay
f93eb2520c Adding file size and archive count to rss feed fetch status board. 2022-09-11 22:13:54 -04:00
Samuel Clay
57cf284f13 Adding slow log aggregator to uncover which users and paths are slowest. 2022-09-11 21:37:02 -04:00
Samuel Clay
a22aaf349d Deferring execution of expensive statistics. 2022-07-28 23:08:49 -04:00
Samuel Clay
ee3b9e61a5 Caching newsblur_users.py statistics. 2022-07-28 22:47:35 -04:00
Samuel Clay
936ae4d70c Need content to read json from 2022-06-27 21:23:26 -04:00
Samuel Clay
0b77ec3e86 Refactoring story_hashes to be more efficient with the zunionstore's. 2022-06-27 16:16:02 -04:00
Samuel Clay
8f646988fb New updates category on discourse forum. 2022-03-28 16:06:44 -04:00
Samuel Clay
7956cf0c8d Last 5 minutes is actually last minute. 2021-12-17 11:56:33 -05:00
Samuel Clay
3e3dd700c3 Removing unused redis_avg (now split into user, session, story, and pubsub) 2021-12-06 11:48:27 -05:00
Samuel Clay
59afb86902 Adding new redis query log numbers. 2021-08-03 17:29:13 -04:00
Samuel Clay
b033ca0848 Docker users don't need DEBUG=True 2021-04-28 10:07:21 -04:00
Samuel Clay
6e07dbaf0f Merge branch 'master' into docker_django3.1
* master: (22 commits)
  Whoops
  Better logging for broken paypal ipns.
  Adding RSS Tracker for Windows to Goodies.
  Refactoring socketio so real-time works around username restrictions.
  Socket.IO v3 on the server too.
  Switching to Socket.IO v3.
  Haproxy splitting for socketio 3
  Socket.io 3
  Handling missing feed.
  Only nb.local.com uses ports for websockets.
  Adding GrazeTEN
  Full node install on setup.
  Updating toprc
  Changing mongodb server.
  Fixing toprc
  Attempting to collect queries for 1% of requests by using DEBUG.
  Fixing mongo install.
  Recalculating premium expiration to take into account forced expirations after gifts.
  Fixing never expire -> 1 year
  Adding 1 year expire to admin.
  ...
2021-01-05 19:12:19 -05:00
Jonathan Math
a2c7acf3ff correct newsblur to newsblur_web in tasks 2021-01-04 13:33:56 -05:00
Samuel Clay
a5cac63a74 Attempting to collect queries for 1% of requests by using DEBUG. 2021-01-04 10:22:04 -05:00
Samuel Clay
8371c635f7 Merge branch 'master' into django2.0
* master: (27 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 09:09:25 -05:00
Samuel Clay
871b434f6b Adding stats logging 2020-12-05 14:16:17 -05:00
Samuel Clay
b89e7dc429 Merge branch 'django1.11' into django2.0
* django1.11: (152 commits)
  request.raw_post_data -> request.body (django 1.6)
  Upgrading pgbouncer to 1.15.0.
  Finishing off Postgresql 13 upgrade.
  Upgrading to Postgresql 13.
  Ubuntu 20.04
  Fixing supervisor path issues
  Upgrading setuptools
  Fixing flask
  Handling over capacity for twitter.
  Max length for image_urls.
  Properly filtering newsletter feeds.
  Fixing issue with text importer on feed-less urls.
  Removing dependency, fixing encoding issue for pages.
  Fixing DB Monitor.
  Updating User Agent for all fetchers.
  Ignoring VSCode.
  Fixing DB Monitor.
  Updating User Agent for all fetchers.
  Ignoring VSCode.
  Fixing Statistics by fixing how timezones are handled.
  ...
2020-12-03 14:04:26 -05:00
Samuel Clay
3147fee8af Switching to shared celery app task. 2020-11-13 13:26:25 -05:00
Samuel Clay
0f77d1c441 Migrating to celery 4.0 2020-11-13 12:14:37 -05:00
Samuel Clay
eeb44e3400 Fixing a bunch of feed fetch py3 errors. Fetching now works! 2020-06-30 20:50:30 -04:00
jmath1
b5bef8a897 upgrade apps/statistics/ to python3 2020-06-15 05:23:58 -04:00
jmath1
a61e1a7b99 Remove use of RequestContext and change render_to_response to render 2020-06-12 01:27:07 -04:00
jmath1
0f9d839a49 Fix url patterns usage to use a list of url() calls 2020-06-11 04:34:16 -04:00
jmath1
ebd0da2d63 change management commands to use argparse instead of optparse 2020-06-08 07:55:17 -04:00
Samuel Clay
60472b2ec9 Fixing date on annuals. 2018-04-18 10:48:55 -07:00
Samuel Clay
544f8c0423 Annual dates 2018-04-17 19:19:26 -07:00
Samuel Clay
436d4ccff3 Fixing annual 2018-04-17 19:16:55 -07:00
Samuel Clay
01ea376471 Payment history feed 2018-04-17 19:13:44 -07:00
Samuel Clay
8e63c14267 Switching away from Get Satisfaction and to Discourse. forum.newsblur.com is the new support forum. 2018-04-17 16:50:34 -07:00
Samuel Clay
f9d9bce5ec Saving page load stats for munin graphs. 2018-02-26 16:00:44 -08:00
Samuel Clay
d0a20bd941 Fixing broken getsatisfaction community feedback. 2017-03-11 09:36:39 -08:00
Samuel Clay
451ed9f6ae Backwards stats. 2016-12-15 12:24:15 -08:00
Samuel Clay
b000b814b7 Testing 1 min last load time. May not work. 2016-12-15 10:47:53 -08:00
Samuel Clay
4a12c220fe Risky business: now capturing db times (sql/mongo/redis) for 1% of all tasks. Also updating munin to recognize new db profiling times. 2015-12-16 17:31:41 -08:00
Samuel Clay
1aaeeafef3 Handling broken getsatisfaction feedback url. 2015-11-28 13:56:50 -08:00
Samuel Clay
35b79bcb2b Deleting expired mstats objects. 2015-07-21 15:19:09 -07:00
Samuel Clay
a64b6068a2 Handling null datetime on stats. 2015-07-21 15:17:24 -07:00
Samuel Clay
66ca1d7628 Changing resoltuion of feed counts munin to 12 hours to spare the database. 2015-07-21 15:15:51 -07:00
Samuel Clay
1a578193a4 Updating to latest pymongo and mongoengine. 2015-07-20 16:44:50 -07:00
Samuel Clay
5adebcccae Fixing URL from getsatisfaction. 2014-04-03 15:59:11 -07:00
Samuel Clay
2caa5a91d7 Adding special DB request logs for sql, mongo, and redis. 2014-03-18 19:19:43 -07:00
Samuel Clay
4acad6e59f Major refactoring of social blurblog. Also adding a new trimmer, but keeping it turned off. 2013-10-07 13:36:10 -07:00
Samuel Clay
cc64e3626c Fixing rstats. 2013-10-07 10:51:28 -07:00
Samuel Clay
dac6eefb4c Adding non-expiring key totals to rstats. 2013-07-01 18:44:01 -07:00
Samuel Clay
74ae3dc564 Adding % space for keys in redis sampler. 2013-07-01 18:22:37 -07:00
Samuel Clay
60b78a3dda Adding key space to redis stats. 2013-07-01 18:13:31 -07:00
Samuel Clay
cdc62e46ce Updating styles on iOS story list to emphasize story title (thanks to @nriley for the inspiration). 2013-06-30 21:29:17 -07:00
Samuel Clay
f194f5210c Adding expiring key count to redis sampling. 2013-06-30 09:53:05 -07:00