Commit graph

81 commits

Author SHA1 Message Date
Samuel Clay
35b79bcb2b Deleting expired mstats objects. 2015-07-21 15:19:09 -07:00
Samuel Clay
a64b6068a2 Handling null datetime on stats. 2015-07-21 15:17:24 -07:00
Samuel Clay
66ca1d7628 Changing resoltuion of feed counts munin to 12 hours to spare the database. 2015-07-21 15:15:51 -07:00
Samuel Clay
1a578193a4 Updating to latest pymongo and mongoengine. 2015-07-20 16:44:50 -07:00
Samuel Clay
5adebcccae Fixing URL from getsatisfaction. 2014-04-03 15:59:11 -07:00
Samuel Clay
2caa5a91d7 Adding special DB request logs for sql, mongo, and redis. 2014-03-18 19:19:43 -07:00
Samuel Clay
4acad6e59f Major refactoring of social blurblog. Also adding a new trimmer, but keeping it turned off. 2013-10-07 13:36:10 -07:00
Samuel Clay
cc64e3626c Fixing rstats. 2013-10-07 10:51:28 -07:00
Samuel Clay
dac6eefb4c Adding non-expiring key totals to rstats. 2013-07-01 18:44:01 -07:00
Samuel Clay
74ae3dc564 Adding % space for keys in redis sampler. 2013-07-01 18:22:37 -07:00
Samuel Clay
60b78a3dda Adding key space to redis stats. 2013-07-01 18:13:31 -07:00
Samuel Clay
cdc62e46ce Updating styles on iOS story list to emphasize story title (thanks to @nriley for the inspiration). 2013-06-30 21:29:17 -07:00
Samuel Clay
f194f5210c Adding expiring key count to redis sampling. 2013-06-30 09:53:05 -07:00
Samuel Clay
2ca2607f0a Adding expiring key count to redis sampling. 2013-06-30 09:52:10 -07:00
Samuel Clay
edcbde615d Adding a massive feed trimmer. Cuts feeds, those that have no active subs and haven't a new story for a month, down to 10 stories. 2013-06-03 17:20:36 -07:00
Samuel Clay
e84c31884a Better labels for redis sampler. 2013-06-03 15:56:42 -07:00
Samuel Clay
b50986388a Adding ttls to redis stats sampler. 2013-06-03 15:50:03 -07:00
Samuel Clay
318aa32a80 Adding redis key sampler to determine nature of expanding redis collection. 2013-06-03 15:08:07 -07:00
Samuel Clay
f19721bb60 Can no longer have a clean method on a mongoengine model. 2013-05-29 18:09:52 -07:00
Samuel Clay
d209b2e905 Adding email for first share to tell users about their blurblog. 2013-04-22 15:24:38 -07:00
Samuel Clay
6011e4f2da Moving from feed/page/push histories to capped fetch history. 2013-04-15 14:30:31 -07:00
Samuel Clay
530a95bf63 Switching feed fetch counts from mongo to redis. 2013-04-15 12:08:53 -07:00
Samuel Clay
9086e93c3b Moving from MongoDB's page_loads analytics table to Redis page loads. 2013-03-29 13:14:19 -07:00
Samuel Clay
79200d7bc1 Adding RStats, necessary to remove mongodb analytics. 2013-03-25 11:10:41 -07:00
Samuel Clay
c146f17af6 Using secondary mongos for feed fetch histories. 2013-03-25 09:00:56 -07:00
Samuel Clay
d9613bf0a8 Pushing feed history deletion to end of stats collection. 2013-03-22 16:13:14 -07:00
Samuel Clay
6f8a05111a Logging feed fetch deletions. 2013-03-22 16:12:01 -07:00
Samuel Clay
62d210ffd6 Migration to increase max length of feed address. 2012-12-25 14:58:59 -08:00
Samuel Clay
a12139adb7 No need to clean analytics twice. Doh. 2012-12-24 20:32:08 -08:00
Samuel Clay
57ef407bc8 Adding analytics cleaning task. 2012-12-24 20:24:45 -08:00
Samuel Clay
8d158676b3 Moving statistics tasks. 2012-12-10 13:33:57 -08:00
Samuel Clay
f9ed7fdd26 Deprecating FeedLoadtime and moving to MongoDB-backed aggregate data for feed load time graphs. 2012-09-27 15:21:38 -07:00
Samuel Clay
2461b2f83a Cleaning analytics as a beat task. Fixing server status codes in munin, and removing app feed fetches from analytics. 2012-09-27 13:18:51 -07:00
Samuel Clay
6496f1560e Normalizing paths and adding graphs for browser breakdowns, paths, and task feed status codes. 2012-09-27 12:12:28 -07:00
Samuel Clay
0772b74aa7 Calculating correct page fetch timing offset (if it was a 304). 2012-09-06 23:33:42 -07:00
Samuel Clay
945b75ab36 Adding server name and feed code to analytics. 2012-09-06 22:31:44 -07:00
Samuel Clay
d7e70cafb0 Shortening names on analytics for improved space saving. 2012-09-06 17:39:18 -07:00
Samuel Clay
c07d7e7578 Adding new analytics collections to keep track of page loads and feed fetches. Need to start aggregating before I can tell how useful this data will be. 2012-09-06 17:24:42 -07:00
Samuel Clay
ae252b0293 Turning on mongodb replication lag watcher. 2012-08-17 00:00:02 -07:00
Samuel Clay
73cd4b6b5b Collecting replication lag statistics, to be used to count unreads. 2012-08-16 23:33:57 -07:00
Samuel Clay
10f6c2008b Showing better error messages for front-end users. 2012-07-25 14:03:15 -07:00
Samuel Clay
86292822c0 Removing cjson. Fixing collect_stats requirement on bootstrap. 2012-07-17 12:07:26 -07:00
Samuel Clay
049cc78433 Adding login view to blurblogs. Fixing a ton of bugs around sharing stories that don't exist anymore. 2012-07-02 10:15:17 -07:00
Samuel Clay
0cdba2ccdf Experimental change: statistics on dashboard now show total for the day. 2012-05-11 09:17:58 -07:00
Samuel Clay
d96ed5db54 Big change to tryfeed. Handling sites that the user isn't subscribed to now downloads them successfully. Useful for sharing stories on feeds you do not subscribe to. 2012-04-19 22:38:00 -07:00
Samuel Clay
3f0c9b3cfb Calculating stories shared for dashboard statistics graph. 2012-04-12 13:37:19 -07:00
Samuel Clay
451485d32e Splitting interactions into public/private interactions and activities. 2012-04-11 12:14:18 -07:00
Samuel Clay
3f7810287b Refactoring features module and adding interactions module + model. Stubbed in interactions module. 2012-04-09 17:20:47 -07:00
Samuel Clay
603ac08faa Merge branch 'master' into social
* master:
  Allow login from signup form.
  Reducing celery prefetch to get more accurate queue sizes.
  Removing RabbitMQ dependency. Moving to redis for task queuing.
  Counting queue size for celery/redis.
  Switching to redis to feed queuing. Also adding a weight for skipping feed fetches under high load.
  Skipping feed resurrection.
  Fixing last update problem that has been choking feed fetchers.
  Fixing last update problem that has been choking feed fetchers.
  Typo in feed pool drain.
  Adding ability to wind down feed queue by faking requests.
  Adding debug message about counting errors.

Conflicts:
	fabfile.py
2012-02-27 13:13:27 -08:00
Samuel Clay
ce536200f6 Adding ability to wind down feed queue by faking requests. 2012-02-24 16:43:08 -08:00