Commit graph

245 commits

Author SHA1 Message Date
Samuel Clay
a2c5aaafc6 Adding real ip to socketio. 2013-05-01 13:22:03 -07:00
Samuel Clay
171dc0d996 Merge branch 'schedule' into schedule_dev
* schedule:
  Fixing ulimit on new machines. Upgrading celery.
2013-04-23 18:07:48 -07:00
Samuel Clay
876c292cfc Merge branch 'master' into schedule
* master:
  Fixing ulimit on new machines. Upgrading celery.
2013-04-23 18:07:43 -07:00
Samuel Clay
e624fe53d9 Fixing ulimit on new machines. Upgrading celery. 2013-04-23 17:58:25 -07:00
Samuel Clay
42b85d485a Merge branch 'schedule' into schedule_dev
* schedule:
  Adding metric for last story date, used to calculate next scheduled update.
2013-04-23 17:04:27 -07:00
Samuel Clay
1584208677 Adding metric for last story date, used to calculate next scheduled update. 2013-04-23 17:04:21 -07:00
Samuel Clay
41f9257d7f Merge branch 'master' into circular
* master:
  Refactoring real-time socketio clientside to fix multiple client updates.
  Unread counts only for logged in users.

Conflicts:
	media/js/newsblur/reader/reader.js
2013-04-15 18:00:00 -07:00
Samuel Clay
76cbbd8d8b Refactoring real-time socketio clientside to fix multiple client updates. 2013-04-15 17:59:06 -07:00
Samuel Clay
1175b306cd Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:20:17 -07:00
Samuel Clay
88c593bc79 Adding supervisord.conf config to include minfds (ulimit -a) support. 2013-04-07 17:20:17 -07:00
Samuel Clay
48c5d4d53e Adding logging, feed cleanup to forced fetch feeds, and expirations on user read stories. 2013-04-07 17:19:59 -07:00
Samuel Clay
0e7bcab43d Adding supervisord.conf config to include minfds (ulimit -a) support. 2013-04-06 12:31:51 -07:00
Samuel Clay
2acd91aa15 Adding --use-pythonrc to shell_plus. 2013-04-03 22:34:43 -07:00
Samuel Clay
d18e287834 Broken nb-full-container implementation. 2013-04-03 22:33:01 -07:00
Samuel Clay
20698e9bc5 Merge branch 'master' into circular
* master:
  Adding tasked_feeds set to handle dropped feeds.
  Fixing missing feed bug.
  Adding new task server role: only new and push feeds.
  Fixing munin counts.
2013-04-03 17:26:10 -07:00
Samuel Clay
12472a8484 Adding new task server role: only new and push feeds. 2013-04-03 16:23:55 -07:00
Samuel Clay
c9f64f8193 Merge branch 'master' into circular
* master:
  Moving elastic search hosts.
  Fixing haproxy install.
  Changing dev/debug host for socketio.
  Ripping out memcache in favor of redis.
  Migrating original page servers and munin servers.
  Adding Paypal API.
2013-04-01 16:07:14 -07:00
Samuel Clay
5ffcf84432 Migrating original page servers and munin servers. 2013-04-01 12:21:20 -07:00
Samuel Clay
61dde968b8 Merge branch 'master' into circular
# By Samuel Clay (12) and Lance Johnson (1)
* master:
  Updating postgres config, celery queue.
  Boosting feed fetching.
  Android: show server error message to user when add feed fails. The error message was being sent when non-premium users tried to search for feeds and was causing the App to crash.
  Removing unused feed hash index (keeping the unique constraint).
  Adding two indexes and killing one unused one from feeds.
  Returning index on active subs.
  Changing logging on feed queueing.
  Turning off autocomplete for the time being.
  Removing unused indexes.
  Upgrade to postgres 9.2.
  Culling some graphs on feed counts.
  Cleaning up week old feeds.
  Boosting feed fetching way up for the weekend.
2013-03-30 19:05:20 -07:00
Samuel Clay
25d21c9f69 Updating postgres config, celery queue. 2013-03-30 12:43:11 -07:00
Samuel Clay
03c27b42e8 Removing unused feed hash index (keeping the unique constraint). 2013-03-29 22:41:16 -07:00
Samuel Clay
a47fa4db0f Removing unused indexes. 2013-03-29 20:24:06 -07:00
Samuel Clay
5d609355ee Merge branch 'master' into circular
# By Samuel Clay (2) and Lance Johnson (1)
# Via Samuel Clay (2) and Lance Johnson (1)
* master:
  Moving from MongoDB's page_loads analytics table to Redis page loads.
  Adding MongoDB MMS agent.
  Several changes in one commit (bad me)
2013-03-29 13:19:12 -07:00
Samuel Clay
9086e93c3b Moving from MongoDB's page_loads analytics table to Redis page loads. 2013-03-29 13:14:19 -07:00
Samuel Clay
02a0a0646a Adding MongoDB MMS agent. 2013-03-29 11:04:46 -07:00
Samuel Clay
a67df54101 Merge branch 'master' into circular
* master:
  Adding task servers to db firewall.
  Adding redis cache. Returning favicon server.
  Better munin plugins for redis and mongo.
  Removing unused redis keys for shared/comments. Dry-run.
  Adding read preference to migration.
  Migration to create story_hash for missing feeds.
  Making a clearer description of slow feeds.
  Upping feed fetches, slowing down fetch interval for less active feeds, setting premium expire time to one year from most recent payment date (as opposed to borked payment gap logic), and adding logginf or tasking feeds.
  Switching check for HAProxy'ied socket.io to dev instead of www. Thanks @anaconda!
  Sync delay in mongodb and updating story hash migration.
  Upping feed fetches.
  Fix force close when attempting to fetch a user with a null user.id value
  Fix force close updating ProfileActivityFragment if no profile response was received
  Move creating ImageLoader in NewsBlurApplication to onCreate to ensure that base context has been set and prevent force close
  Boosting fetches.
  Fix duplicate requirement

Conflicts:
	fabfile.py
2013-03-28 19:09:14 -07:00
Samuel Clay
bbd7d5060e Adding task servers to db firewall. 2013-03-28 19:08:46 -07:00
Samuel Clay
bc6b5a025b Adding redis cache. Returning favicon server. 2013-03-28 18:13:08 -07:00
Samuel Clay
b21ea88e8e Better munin plugins for redis and mongo. 2013-03-28 17:29:27 -07:00
Samuel Clay
a65236ea92 Removing unused redis keys for shared/comments. Dry-run. 2013-03-28 16:39:37 -07:00
Samuel Clay
e39dee98be Upping feed fetches, slowing down fetch interval for less active feeds, setting premium expire time to one year from most recent payment date (as opposed to borked payment gap logic), and adding logginf or tasking feeds. 2013-03-28 11:16:43 -07:00
Samuel Clay
9e17a2caed Sync delay in mongodb and updating story hash migration. 2013-03-27 22:25:08 -07:00
Michael Elovskikh
3809df22cd Fix duplicate requirement
Just a small fix
2013-03-28 00:22:25 +06:00
Samuel Clay
1b80b37dc9 Merge branch 'master' into circular
* master:
  Adding dev and debug to firewall
  Adding hyphens to allowed hosts for blurblogs.
  Adding X-nginx-server and X-gunicorn-server.
  Adding RStats, necessary to remove mongodb analytics.
  Fixing firewall setup.
  Using secondary mongos for feed fetch histories.
  Moving to a single hosts and hosts.yml file, used to control logs, deployment, firewalls, and communication. Awesome!
  Moving hosts to secrets.
  Cache busting feeds on force and 1% of the time.

Conflicts:
	config/nginx.newsblur.conf
2013-03-25 12:47:16 -07:00
Samuel Clay
cd6bddb2a5 Adding hyphens to allowed hosts for blurblogs. 2013-03-25 12:32:15 -07:00
Samuel Clay
3e8c3b7e4b Adding X-nginx-server and X-gunicorn-server. 2013-03-25 11:53:31 -07:00
Samuel Clay
568081eb0b Merge branch 'master' into circular
* master:
  Fixing Google+ sharing.
  64 sites, not 12 sites. Doh!
  Adding expires header to icons.
  Downgrading from Pillow, which is incompatible with PIL.
  Pushing feed history deletion to end of stats collection.
  Logging feed fetch deletions.
  Fixing missing scipy import missing form PILlow.
  Last imports for pillow.
  Boosting feed fetches.
  Upgrading from PIL to Pillow.
  Upgrading from PIL to Pillow.
  Upgrading from PIL to Pillow.
  Adding cached template loader. Adding new mongodb.
  Cutting number of feeds for fetching until mongo is sharded.

Conflicts:
	fabfile.py
2013-03-24 21:13:32 -07:00
Samuel Clay
a37fcd4da8 Downgrading from Pillow, which is incompatible with PIL. 2013-03-22 17:16:16 -07:00
Samuel Clay
16688a4985 Upgrading from PIL to Pillow. 2013-03-22 15:04:34 -07:00
Samuel Clay
e91d11e068 Adding cached template loader. Adding new mongodb. 2013-03-22 13:36:32 -07:00
Samuel Clay
fa2ad949ab Merge branch 'master' into circular
* master:
  Locking the mouse indicator by default.
  Grabbing forced refresh feeds.
  Fixing pgsql backup.
  Fixing autologin with no next param.
  Bootstrapping redis sessions.
  Using redis pipeline for speeeeed in django db sessions -> redis sessions.
  Adding redis session pool and migration script for sessions.
  Redis session db.
2013-03-21 11:09:09 -07:00
Samuel Clay
4b8b958078 Redis session db. 2013-03-20 19:26:10 -07:00
Samuel Clay
1338c69edb Merge branch 'master' into circular
* master:
  Using user's username on signup if no password.
  Using user's username on signup if no password.
  Fixing passwords if left blank.
  Patching Django 1.5 to handle underscores in subdomains.
  Allowed hosts
  Allowed hosts
  If not active subs, turn off real-time.
  If not active subs, turn off real-time.
  Skipping real-time fetch for non-premium active feeds.
  Upgrading django 1.5 manage.py.
  Upgrade to django 1.5 script. Also handling story lookups with objectids.
  Updated Django to always use the latest 1.5 version. Updated django-redis-session to latest version.
  Moving HAProxy's config to secrets so I can set a password.
  Allowing_hosts for django 1.5.
  Upgrading django from 1.3 to 1.5.
  Keep Raven from making settings puke.
  Added django-redis-sessions to requirements.
  Added a check for testing the email address provided during registration and throwing an error if the email address is already associated with an existing account.
  Adding revsys fab command.
  Froze requirements to make installation a bit easier.

Conflicts:
	templates/reader/dashboard.xhtml
	templates/social/social_page.xhtml
2013-03-20 18:57:06 -07:00
Jeff Triplett
6070552ebf Updated Django to always use the latest 1.5 version. Updated django-redis-session to latest version. 2013-03-20 17:32:56 -05:00
Jeff Triplett
c6cf31e7e2 Merged in master branch. 2013-03-20 17:30:16 -05:00
Samuel Clay
9ea3be9999 Moving HAProxy's config to secrets so I can set a password. 2013-03-20 15:12:56 -07:00
Samuel Clay
90c2425db0 Upgrading django from 1.3 to 1.5. 2013-03-20 15:05:52 -07:00
Jeff Triplett
e2396c7380 Added django-redis-sessions to requirements. 2013-03-20 16:58:30 -05:00
Samuel Clay
b3744e3ac6 Merge branch 'master' into circular
* master:
  Warning on missing maintenance.
  Further pushing out feed updates.
  Using @dcramer's excellent getsentry.com for all exceptions. Turning off exception emails.
  Further pushing down feed fetches to handle load until db is scaled out.
  Scrolling code blocks.
  New task servers.
  Turning down feed fetches.
  If requests.raw won't work, sut fudge it with a StringIO for now.
  Further turning down feed fetches until mongo is ready to replicate.
  Fixing Facebook image calculation.
  Fixing facebook posting.
  Moving shared story unread recalc to background task. Will greatly speed up sharing.
  Ramping down feed fetching until they can be handled.
  Only show time breakdown when > 1 sec.
  Fixed API docs for /reader/river_stories
  make fabfile.py use requirements.txt
  Make sure to send the proper content-type with social feeds
  Restore default whitespace to pre/code blocks
  Phase 2: switching to using story_hash index instead of compound unique story_feed_id/story_guid index.
  document keyboard shortcut to add site/folder

Conflicts:
	apps/social/views.py
2013-03-20 10:49:09 -07:00
Jeff Triplett
f098b57490 Froze requirements to make installation a bit easier. 2013-03-19 15:32:14 -05:00