Commit graph

913 commits

Author SHA1 Message Date
Samuel Clay
25d21c9f69 Updating postgres config, celery queue. 2013-03-30 12:43:11 -07:00
Samuel Clay
65e976e4a0 Culling some graphs on feed counts. 2013-03-29 16:36:13 -07:00
Samuel Clay
0f53acdf6d Merge branch 'master' into circular
* master:
  Fixing stripe reimport
  Upping feed fetching by quite a bit.
  Fixing double counting stripe payment bug by clearing out striep purchase history when inserting.
2013-03-29 14:27:04 -07:00
Samuel Clay
0572dbf0b7 Fixing stripe reimport 2013-03-29 14:27:00 -07:00
Samuel Clay
aa4bf71b34 Upping feed fetching by quite a bit. 2013-03-29 14:14:29 -07:00
Samuel Clay
5d609355ee Merge branch 'master' into circular
# By Samuel Clay (2) and Lance Johnson (1)
# Via Samuel Clay (2) and Lance Johnson (1)
* master:
  Moving from MongoDB's page_loads analytics table to Redis page loads.
  Adding MongoDB MMS agent.
  Several changes in one commit (bad me)
2013-03-29 13:19:12 -07:00
Samuel Clay
9086e93c3b Moving from MongoDB's page_loads analytics table to Redis page loads. 2013-03-29 13:14:19 -07:00
Samuel Clay
a67df54101 Merge branch 'master' into circular
* master:
  Adding task servers to db firewall.
  Adding redis cache. Returning favicon server.
  Better munin plugins for redis and mongo.
  Removing unused redis keys for shared/comments. Dry-run.
  Adding read preference to migration.
  Migration to create story_hash for missing feeds.
  Making a clearer description of slow feeds.
  Upping feed fetches, slowing down fetch interval for less active feeds, setting premium expire time to one year from most recent payment date (as opposed to borked payment gap logic), and adding logginf or tasking feeds.
  Switching check for HAProxy'ied socket.io to dev instead of www. Thanks @anaconda!
  Sync delay in mongodb and updating story hash migration.
  Upping feed fetches.
  Fix force close when attempting to fetch a user with a null user.id value
  Fix force close updating ProfileActivityFragment if no profile response was received
  Move creating ImageLoader in NewsBlurApplication to onCreate to ensure that base context has been set and prevent force close
  Boosting fetches.
  Fix duplicate requirement

Conflicts:
	fabfile.py
2013-03-28 19:09:14 -07:00
Samuel Clay
e159a7223d Adding read preference to migration. 2013-03-28 15:15:24 -07:00
Samuel Clay
328ca6b386 Migration to create story_hash for missing feeds. 2013-03-28 15:04:54 -07:00
Samuel Clay
ceaf07ac87 Adding dev to tlnb. 2013-03-26 10:11:27 -07:00
Samuel Clay
2ec2e0a2e4 Adding dev to tlnb. 2013-03-25 12:48:36 -07:00
Samuel Clay
1b80b37dc9 Merge branch 'master' into circular
* master:
  Adding dev and debug to firewall
  Adding hyphens to allowed hosts for blurblogs.
  Adding X-nginx-server and X-gunicorn-server.
  Adding RStats, necessary to remove mongodb analytics.
  Fixing firewall setup.
  Using secondary mongos for feed fetch histories.
  Moving to a single hosts and hosts.yml file, used to control logs, deployment, firewalls, and communication. Awesome!
  Moving hosts to secrets.
  Cache busting feeds on force and 1% of the time.

Conflicts:
	config/nginx.newsblur.conf
2013-03-25 12:47:16 -07:00
Samuel Clay
79200d7bc1 Adding RStats, necessary to remove mongodb analytics. 2013-03-25 11:10:41 -07:00
Samuel Clay
a4238d20b3 Moving to a single hosts and hosts.yml file, used to control logs, deployment, firewalls, and communication. Awesome! 2013-03-24 22:31:46 -07:00
Samuel Clay
568081eb0b Merge branch 'master' into circular
* master:
  Fixing Google+ sharing.
  64 sites, not 12 sites. Doh!
  Adding expires header to icons.
  Downgrading from Pillow, which is incompatible with PIL.
  Pushing feed history deletion to end of stats collection.
  Logging feed fetch deletions.
  Fixing missing scipy import missing form PILlow.
  Last imports for pillow.
  Boosting feed fetches.
  Upgrading from PIL to Pillow.
  Upgrading from PIL to Pillow.
  Upgrading from PIL to Pillow.
  Adding cached template loader. Adding new mongodb.
  Cutting number of feeds for fetching until mongo is sharded.

Conflicts:
	fabfile.py
2013-03-24 21:13:32 -07:00
Samuel Clay
9e2fa3115d Cache busting feeds on force and 1% of the time. 2013-03-24 15:50:57 -07:00
Samuel Clay
9da98efcf6 Upgrading from PIL to Pillow. 2013-03-22 15:06:40 -07:00
Samuel Clay
bc9f1230b8 Upgrading from PIL to Pillow. 2013-03-22 15:06:01 -07:00
Samuel Clay
16688a4985 Upgrading from PIL to Pillow. 2013-03-22 15:04:34 -07:00
Samuel Clay
fa2ad949ab Merge branch 'master' into circular
* master:
  Locking the mouse indicator by default.
  Grabbing forced refresh feeds.
  Fixing pgsql backup.
  Fixing autologin with no next param.
  Bootstrapping redis sessions.
  Using redis pipeline for speeeeed in django db sessions -> redis sessions.
  Adding redis session pool and migration script for sessions.
  Redis session db.
2013-03-21 11:09:09 -07:00
Samuel Clay
0b38e1bece Fixing pgsql backup. 2013-03-21 10:41:48 -07:00
Samuel Clay
c421a08889 Bootstrapping redis sessions. 2013-03-20 22:00:03 -07:00
Samuel Clay
bb6aac3b35 Using redis pipeline for speeeeed in django db sessions -> redis sessions. 2013-03-20 19:54:36 -07:00
Samuel Clay
095ceef45a Adding redis session pool and migration script for sessions. 2013-03-20 19:45:45 -07:00
Samuel Clay
1338c69edb Merge branch 'master' into circular
* master:
  Using user's username on signup if no password.
  Using user's username on signup if no password.
  Fixing passwords if left blank.
  Patching Django 1.5 to handle underscores in subdomains.
  Allowed hosts
  Allowed hosts
  If not active subs, turn off real-time.
  If not active subs, turn off real-time.
  Skipping real-time fetch for non-premium active feeds.
  Upgrading django 1.5 manage.py.
  Upgrade to django 1.5 script. Also handling story lookups with objectids.
  Updated Django to always use the latest 1.5 version. Updated django-redis-session to latest version.
  Moving HAProxy's config to secrets so I can set a password.
  Allowing_hosts for django 1.5.
  Upgrading django from 1.3 to 1.5.
  Keep Raven from making settings puke.
  Added django-redis-sessions to requirements.
  Added a check for testing the email address provided during registration and throwing an error if the email address is already associated with an existing account.
  Adding revsys fab command.
  Froze requirements to make installation a bit easier.

Conflicts:
	templates/reader/dashboard.xhtml
	templates/social/social_page.xhtml
2013-03-20 18:57:06 -07:00
Samuel Clay
d793946e3a If not active subs, turn off real-time. 2013-03-20 16:17:20 -07:00
Samuel Clay
90c2425db0 Upgrading django from 1.3 to 1.5. 2013-03-20 15:05:52 -07:00
Samuel Clay
b3744e3ac6 Merge branch 'master' into circular
* master:
  Warning on missing maintenance.
  Further pushing out feed updates.
  Using @dcramer's excellent getsentry.com for all exceptions. Turning off exception emails.
  Further pushing down feed fetches to handle load until db is scaled out.
  Scrolling code blocks.
  New task servers.
  Turning down feed fetches.
  If requests.raw won't work, sut fudge it with a StringIO for now.
  Further turning down feed fetches until mongo is ready to replicate.
  Fixing Facebook image calculation.
  Fixing facebook posting.
  Moving shared story unread recalc to background task. Will greatly speed up sharing.
  Ramping down feed fetching until they can be handled.
  Only show time breakdown when > 1 sec.
  Fixed API docs for /reader/river_stories
  make fabfile.py use requirements.txt
  Make sure to send the proper content-type with social feeds
  Restore default whitespace to pre/code blocks
  Phase 2: switching to using story_hash index instead of compound unique story_feed_id/story_guid index.
  document keyboard shortcut to add site/folder

Conflicts:
	apps/social/views.py
2013-03-20 10:49:09 -07:00
Samuel Clay
a75554374b Using @dcramer's excellent getsentry.com for all exceptions. Turning off exception emails. 2013-03-20 08:24:11 -07:00
Samuel Clay
61fac02304 If requests.raw won't work, sut fudge it with a StringIO for now. 2013-03-19 17:49:56 -07:00
Samuel Clay
1854f719d3 Fixing Facebook image calculation. 2013-03-19 17:27:04 -07:00
Samuel Clay
90b66017f1 Fixing log for non-requests. 2013-03-19 10:19:05 -07:00
Samuel Clay
b9e5753e6a Reducing page load logging to only abre essentials. 2013-03-19 10:18:22 -07:00
Samuel Clay
e9bae8bba8 Fixing log for non-requests. 2013-03-18 18:20:45 -07:00
Samuel Clay
8f7f5a2976 Reducing page load logging to only abre essentials. 2013-03-18 15:27:14 -07:00
Samuel Clay
233af12d0e Merge branch 'master' into circular
* master:
  Trying out a gunicorn haproxy backend.
  Re-upping 12 to 64 free feeds.
  Removing Redis state for socket.io. Too many open mongo connections.
  Referencing new secret hosts.
  Removing hosts.
  Adding dev hosts.
  Using new secrets repo instead of ignored files.
2013-03-17 11:26:54 -07:00
Samuel Clay
ee4fd11ca7 Re-upping 12 to 64 free feeds. 2013-03-17 10:28:26 -07:00
Samuel Clay
7f9893f1f3 Merge branch 'master' into circular
* master:
  Refactoring fabfile for DO
  Moving redis servers for real-time.
  Increasing feed fetches quite a bit.
  More gunicorn servers.
  More gunicorn servers.
  Upping gunicorn processes.
  Hiding 12 option to cut back on number of new premiums.
  Bumping up premium refresh rates.
  Tasking only popular feeds for now.
  Pushing out feed updates until able to handle the giant influx.
2013-03-14 20:38:30 -07:00
Samuel Clay
f62ce742b5 Hiding 12 option to cut back on number of new premiums. 2013-03-14 18:43:01 -07:00
Samuel Clay
89904d1eb0 Merge branch 'master' into circular
* master:
  Turning off PuSH if no hub url found.
2013-03-07 11:24:09 -05:00
Samuel Clay
e4fc8b6c49 Turning off PuSH if no hub url found. 2013-03-07 10:58:05 -05:00
Samuel Clay
850cfe5812 Merge branch 'master' into circular
* master:
  Fixing push re-sub logging.
  Resubscribing to PuSH feeds that have expired.
2013-03-06 14:58:29 -08:00
Samuel Clay
bdd60bf3f7 Fixing push re-sub logging. 2013-03-06 14:47:15 -08:00
Samuel Clay
00f59821be Resubscribing to PuSH feeds that have expired. 2013-03-06 14:45:01 -08:00
Samuel Clay
7c7b8c213e Merge branch 'master' into circular
* master:
  sclay -> /srv
2013-02-28 23:29:43 -08:00
Samuel Clay
37c8d36eb7 sclay -> /srv 2013-02-25 19:01:11 -08:00
Samuel Clay
cd9de15b5a Rearranging site counter and unread counter. 2013-02-22 12:13:01 -08:00
Samuel Clay
0627e6fdb2 Merge branch 'master' into circular
* master:
  If there are no unread stories in a folder, don't request river_stories with no feeds, since that will return all unread stories. Fetch all feeds in folder. Thanks to @afita for pushing this.
  Fixing sharing story by email if the story has no feed.
  Fixing sharing story by email if the story has no feed.
  Adding Tafiti, Windows 8 app, to logs.
  1 month max on next fetch.

Conflicts:
	media/js/newsblur/reader/reader.js
2013-02-14 17:21:15 -08:00
Samuel Clay
366797280c Adding Tafiti, Windows 8 app, to logs. 2013-02-13 16:27:20 -08:00