Commit graph

1095 commits

Author SHA1 Message Date
Samuel Clay
36028cc719 Text view. Needs a few tweaks and a premium only view. 2013-01-08 18:33:30 -08:00
Samuel Clay
4dd1d10d5a Adding avatar photo uploading. 2013-01-08 14:11:59 -08:00
Samuel Clay
cb30fe2ae8 Bumping up duplicate address length for feeds. 2013-01-07 16:35:29 -08:00
Samuel Clay
aefd8de78c Backporting collections.Counter to python2.6 2013-01-03 18:15:00 -08:00
Samuel Clay
63bd36212c Fixing feed fetcher to use updated date if the feed doesn't provide it otherwise. 2012-12-24 00:10:40 -08:00
Samuel Clay
eeae903791 Adding active premiums to status page. 2012-12-21 18:22:26 -08:00
Samuel Clay
223bd26721 No more error messages on deploying new celery/gunicorn. Also adding NUMA cancellation support to mongo db server. 2012-12-19 17:38:46 -08:00
Samuel Clay
1cc128b5a2 Doubling resync likelihood. 2012-12-17 18:20:26 -08:00
Samuel Clay
53b5c4e2db Clearing out old read stories for 1% of all feed fetches with new stories. 2012-12-17 17:28:45 -08:00
Samuel Clay
5a5aa0d17b Turning off deletion of old stories until the db can be prepped. 2012-12-17 16:19:28 -08:00
Samuel Clay
28d5f44182 Deleting old stories. 2012-12-17 15:48:43 -08:00
Samuel Clay
033a56dfe9 Deleting old user stories again. This time going out to 5 times the unread bounds. 2012-12-17 15:14:48 -08:00
Samuel Clay
1387d7cfc4 Upgrading celery just in case it's causing priority loss. 2012-12-17 13:44:10 -08:00
Samuel Clay
f9918a4917 Fixing numerous exceptions. Story training when not having a story selected. Forbidden RSS feeds throwing exceptions instead of 403s. 2012-12-12 14:24:51 -08:00
Samuel Clay
dac88c0a25 Adding a better API view decorator for required paramters, their types, and http method used. 2012-12-12 13:58:10 -08:00
Samuel Clay
2716d0c404 Cleaning up invalid story dates. 2012-12-10 15:48:05 -08:00
Samuel Clay
bea0b1da51 Fixing dateutil on broken dates. 2012-12-10 15:32:31 -08:00
Samuel Clay
a4267f423e Handling broken publish dates. 2012-12-10 15:31:39 -08:00
Samuel Clay
8f2dc95b18 S3 utils. 2012-12-10 11:40:35 -08:00
Samuel Clay
e4930cc3c8 Searching for celery instead of celeryd to also take celerybeat into account. 2012-12-10 10:57:12 -08:00
Samuel Clay
36377040e3 Adding monit for gunicorn + kill gunicorn script for doing the dirty work. 2012-12-10 10:50:04 -08:00
Samuel Clay
afbba14390 Upping log colors to only show slow calls. 2012-12-05 14:39:58 -08:00
Samuel Clay
17c1450951 Merge branch 'master' into ios_story
* master:
  Cleanup.
  Gutting dynamodb and just keeping good changes.
  Bumped version number.
  Modified to remove default URL-encoding for GSON.
  Fixed email field not being visible on some smaller screen devices.
  Modified CSS to include max-width for divs, overriding inline styles and reduce max-width.
  Added padding to share button.
  Shifting mgirations for DStory.
  Optional backked by dynamodb.
  First half of DynamoDB trial, converting stories from mongo to dynamodb. Still needs to be updated/inserted on feed update, and then processed with all MStory uses.
2012-11-27 17:34:53 -08:00
Samuel Clay
61aac7fc06 Merge branch 'master' into dynamodb
* master: (331 commits)
  Adding blurblog permalink to story on blurblog. Adding story slug to permalink. Fixing story guid hashes.
  Re-enabling message property for facebook.
  Ignoring image for facebook shares.
  Commenting out facebook share message until they approve it.
  Cleaning up Facebook og description.
  Facebook using a website instead of article.
  Facebook being a PITA.
  Facebook wants ISO8601 datetime format.
  Facebook doesn't like going to other URLs.
  Facebook doesn't like going to other URLs.
  Dumb typo in new facebook og crap.
  Using blurblog permalink for new facebook shares.
  Fixing Facebook share to use fancy actions.
  Adding scroll to comments button to share bar. Thanks @afita.
  Turning off microformats for more errors.
  Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds.
  Cleaning redis stories for 1% of all feed fetches.
  Refreshing feed on fetch.
  Fiddling with logging on dupe feeds.
  Adding bs facebook assets.
  ...

Conflicts:
	apps/rss_feeds/models.py
	settings.py
	utils/feed_fetcher.py
2012-11-27 16:39:39 -08:00
Samuel Clay
1ad7031fbb Fixing tests. 2012-11-27 16:22:03 -08:00
Samuel Clay
c61ba75988 Turning off microformats for more errors. 2012-11-26 11:50:13 -08:00
Samuel Clay
04d61ceff4 Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds. 2012-11-26 11:41:31 -08:00
Samuel Clay
cf554bb598 Cleaning redis stories for 1% of all feed fetches. 2012-11-26 10:39:10 -08:00
Samuel Clay
6b9c737366 Refreshing feed on fetch. 2012-11-26 10:27:08 -08:00
Samuel Clay
f33d46fe88 Better to push together than to spread apart. Diffing html is hard. 2012-11-20 09:54:23 -08:00
Samuel Clay
127d98b667 Experimental change to story diffing. Adding spaces back in. 2012-11-09 09:39:43 -08:00
Samuel Clay
240f5e4c6e Cleaning up RSS feed header for shared stories feeds. 2012-10-30 15:06:30 -07:00
Samuel Clay
fa692d746c Forcing all unread counts to be counted from primary mongo. 2012-10-30 10:57:12 -07:00
Samuel Clay
691598aedd Fixing wonky unread counts. 2012-10-30 08:31:37 -07:00
Samuel Clay
2ec10bcf7e Readying unread counting to incorporate the new read preference in mongoengine. 2012-10-29 12:25:28 -07:00
Samuel Clay
b543640554 Fixing raven client on feed fetchers. 2012-10-25 16:23:35 -07:00
Samuel Clay
e572b3d53f Moving to better feed finder (in the case of dupe feeds). 2012-10-25 16:14:25 -07:00
Samuel Clay
7e281e1d7b Adding timeout errors to raven/sentry error reporting. 2012-10-25 16:09:06 -07:00
Samuel Clay
c0b791a01b Fixing an uncaught exception around feeds that change ids. 2012-10-25 15:16:21 -07:00
Samuel Clay
68d12d8c24 Using a regex to remove comments. 2012-10-19 13:53:11 -07:00
Samuel Clay
e215082032 Handling invalid html when cleaning. 2012-10-19 13:36:57 -07:00
Samuel Clay
a23b830c06 Removing old lxml attr. 2012-10-19 13:35:05 -07:00
Samuel Clay
5ce475428f Stripping comments from all stories. This fixes the weird bug where '>more>' crap shows up. 2012-10-19 12:49:39 -07:00
Samuel Clay
093887b39c Adding collections for mongo to backup. 2012-10-16 14:12:38 -07:00
Samuel Clay
24c649df37 Readying task servers for ec2. 2012-10-15 16:32:32 -07:00
Samuel Clay
4a7516cb83 Fixing a bunch of feed fetch errors. 2012-10-01 19:31:33 -07:00
Samuel Clay
ee72253695 Fixing these damn Link: text urls in story modifications. 2012-10-01 19:04:09 -07:00
Samuel Clay
a7911316cd Adding folder collapse for blurblogs. 2012-10-01 13:07:45 -07:00
Samuel Clay
79a770bd5e Forcing all munin graphs to start at 0. 2012-09-28 09:50:12 -07:00
Samuel Clay
c258bbdd11 Ordering and smoothing munin graphs. 2012-09-27 16:51:52 -07:00