Commit graph

345 commits

Author SHA1 Message Date
Samuel Clay
53b5c4e2db Clearing out old read stories for 1% of all feed fetches with new stories. 2012-12-17 17:28:45 -08:00
Samuel Clay
5a5aa0d17b Turning off deletion of old stories until the db can be prepped. 2012-12-17 16:19:28 -08:00
Samuel Clay
28d5f44182 Deleting old stories. 2012-12-17 15:48:43 -08:00
Samuel Clay
033a56dfe9 Deleting old user stories again. This time going out to 5 times the unread bounds. 2012-12-17 15:14:48 -08:00
Samuel Clay
1387d7cfc4 Upgrading celery just in case it's causing priority loss. 2012-12-17 13:44:10 -08:00
Samuel Clay
2716d0c404 Cleaning up invalid story dates. 2012-12-10 15:48:05 -08:00
Samuel Clay
17c1450951 Merge branch 'master' into ios_story
* master:
  Cleanup.
  Gutting dynamodb and just keeping good changes.
  Bumped version number.
  Modified to remove default URL-encoding for GSON.
  Fixed email field not being visible on some smaller screen devices.
  Modified CSS to include max-width for divs, overriding inline styles and reduce max-width.
  Added padding to share button.
  Shifting mgirations for DStory.
  Optional backked by dynamodb.
  First half of DynamoDB trial, converting stories from mongo to dynamodb. Still needs to be updated/inserted on feed update, and then processed with all MStory uses.
2012-11-27 17:34:53 -08:00
Samuel Clay
61aac7fc06 Merge branch 'master' into dynamodb
* master: (331 commits)
  Adding blurblog permalink to story on blurblog. Adding story slug to permalink. Fixing story guid hashes.
  Re-enabling message property for facebook.
  Ignoring image for facebook shares.
  Commenting out facebook share message until they approve it.
  Cleaning up Facebook og description.
  Facebook using a website instead of article.
  Facebook being a PITA.
  Facebook wants ISO8601 datetime format.
  Facebook doesn't like going to other URLs.
  Facebook doesn't like going to other URLs.
  Dumb typo in new facebook og crap.
  Using blurblog permalink for new facebook shares.
  Fixing Facebook share to use fancy actions.
  Adding scroll to comments button to share bar. Thanks @afita.
  Turning off microformats for more errors.
  Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds.
  Cleaning redis stories for 1% of all feed fetches.
  Refreshing feed on fetch.
  Fiddling with logging on dupe feeds.
  Adding bs facebook assets.
  ...

Conflicts:
	apps/rss_feeds/models.py
	settings.py
	utils/feed_fetcher.py
2012-11-27 16:39:39 -08:00
Samuel Clay
1ad7031fbb Fixing tests. 2012-11-27 16:22:03 -08:00
Samuel Clay
c61ba75988 Turning off microformats for more errors. 2012-11-26 11:50:13 -08:00
Samuel Clay
04d61ceff4 Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds. 2012-11-26 11:41:31 -08:00
Samuel Clay
cf554bb598 Cleaning redis stories for 1% of all feed fetches. 2012-11-26 10:39:10 -08:00
Samuel Clay
6b9c737366 Refreshing feed on fetch. 2012-11-26 10:27:08 -08:00
Samuel Clay
240f5e4c6e Cleaning up RSS feed header for shared stories feeds. 2012-10-30 15:06:30 -07:00
Samuel Clay
fa692d746c Forcing all unread counts to be counted from primary mongo. 2012-10-30 10:57:12 -07:00
Samuel Clay
2ec10bcf7e Readying unread counting to incorporate the new read preference in mongoengine. 2012-10-29 12:25:28 -07:00
Samuel Clay
b543640554 Fixing raven client on feed fetchers. 2012-10-25 16:23:35 -07:00
Samuel Clay
e572b3d53f Moving to better feed finder (in the case of dupe feeds). 2012-10-25 16:14:25 -07:00
Samuel Clay
7e281e1d7b Adding timeout errors to raven/sentry error reporting. 2012-10-25 16:09:06 -07:00
Samuel Clay
c0b791a01b Fixing an uncaught exception around feeds that change ids. 2012-10-25 15:16:21 -07:00
Samuel Clay
b81381b120 Merge branch 'master' into dynamodb
* master:
  Updating favicon to include 64x64 icon for Metro.
  Marking shared stories as read.
  Coering story content into unicode to handle changes.
  Fetching more stories.
  Moving from Aaron Swartz's html diff lib to lxml's html diff lib. Should fix issues around disappearing content.
  Favicon for IE9 and for 32x32.
  Trying to repair favicon for ie9 users.
2012-09-24 14:25:35 -07:00
Samuel Clay
ec57fc927a Fetching more stories. 2012-09-24 13:24:45 -07:00
Samuel Clay
2bb38975eb Merge branch 'master' into dynamodb
* master:
  Adding 1.5X as many stories to the dupe detector. Hope I don't regret this.
  Fixing issue when opening feed in Story view but second story gets selected instead of first.
  Changing how signin locks on welcome page.
2012-09-21 15:24:24 -07:00
Samuel Clay
ce52a329c2 Adding 1.5X as many stories to the dupe detector. Hope I don't regret this. 2012-09-21 13:03:38 -07:00
Samuel Clay
294e790e2c Merge branch 'master' into dynamodb
* master: (31 commits)
  Adding delay to showing login when moving from reader.
  Updating welcome email to point to iPad app.
  Correctly handling URL loading cases and hiding/showing sidebar correctly in welcome splash screen.
  Showing signup button in tryout view. Splash apge hides when in tryout mode. Still need to preload feed view and show feed list on url load.
  Finishing up tryout. Still need Sign Up callout.
  Deleting unused maintenance.
  Updating logo for retina.
  Fixing a small gradient color, and blurring on rotation.
  Re-coloring welcome header.
  Adding padding for activities module.
  Updating logo for retina.
  Fixing android header image.
  Styling footer, using better web graphic for header.
  Upgrading iphone/ipad app to support both ios 6 and tall-iphone.
  New folder options: add subfolder.
  Adding location to find friends.
  Trimming mongodb lag cutoff to force feeds to correct themselves when slave lag becomes an issue.
  Fixing 'r' refresh command for All Site Stories.
  Fixing broken social page.
  Google Reader logo and spacing.
  ...
2012-09-17 14:53:12 -07:00
Samuel Clay
b92e564b1f Ignore skip of unread counts if theres no mongodb lag. 2012-09-10 17:50:36 -07:00
Samuel Clay
4ec6c9fefd Merge branch 'master' into dynamodb
* master: (23 commits)
  Fixing trainer for stories in social feeds.
  Fixing small bug in story titles header now showing socialsubs correctly.
  Fixing headers for Everything river and river blurblog.
  Massive refactor around feedbar, brought on by @afita, in order to give Folders a menu in the story titles header (and then make the mark as read button work on folders in the header.)
  Updating story position in closed story titles when pane is re-opened. Thanks to @afita for the bug.
  Updating to altest jQuery layout.
  Adding folder story counts to content pane. Thanks to @afita for the suggestion.
  Fixing activities bug when the user is unknown and there is no source/with_user.
  Calculating correct page fetch timing offset (if it was a 304).
  Adding server name and feed code to analytics.
  Turning analytics logging back on.
  Temporarily commenting out analytics to see if they cure the slow down.
  Shortening names on analytics for improved space saving.
  Adding new analytics collections to keep track of page loads and feed fetches. Need to start aggregating before I can tell how useful this data will be.
  Adding new analytics collections to keep track of page loads and feed fetches. Need to start aggregating before I can tell how useful this data will be.
  Adding VentureBeat article to press page.
  Adding order/read_filter to api. Also adding river blurblog.
  Fixing right click on folders.
  Fixing bug where publisher-disabled original pages were not properly disabled.
  Fixing bug where publisher-disabled original pages were not properly disabled.
  ...

Conflicts:
	utils/feed_fetcher.py
2012-09-07 22:26:19 -07:00
Samuel Clay
945b75ab36 Adding server name and feed code to analytics. 2012-09-06 22:31:44 -07:00
Samuel Clay
1511ca7fc3 Turning analytics logging back on. 2012-09-06 21:43:18 -07:00
Samuel Clay
88172988ee Temporarily commenting out analytics to see if they cure the slow down. 2012-09-06 20:56:44 -07:00
Samuel Clay
d7e70cafb0 Shortening names on analytics for improved space saving. 2012-09-06 17:39:18 -07:00
Samuel Clay
c07d7e7578 Adding new analytics collections to keep track of page loads and feed fetches. Need to start aggregating before I can tell how useful this data will be. 2012-09-06 17:24:42 -07:00
Samuel Clay
0a03154473 First half of DynamoDB trial, converting stories from mongo to dynamodb. Still needs to be updated/inserted on feed update, and then processed with all MStory uses. 2012-09-04 12:01:55 -07:00
Samuel Clay
0fb8c8459d Cleaning up feed calculation in feed fetching. 2012-08-17 00:10:17 -07:00
Samuel Clay
2fa00fd737 Forcing the feed fetcher to not count scores when there's replica lag. God this had better work. 2012-08-16 23:56:21 -07:00
Samuel Clay
88a46dc3b4 Typo 2012-08-16 22:42:13 -07:00
Samuel Clay
92cdfaff66 Removing all removal of read stories, so that they stick around for blurblogs. No good answer for this one. 2012-08-16 22:40:54 -07:00
Samuel Clay
9cbb21c91d Moving Oldest-first date from mark_read_date to 2 weeks ago, everytime. 2012-08-01 21:57:55 -07:00
Samuel Clay
78338bba0d Tons of small fixes: opml uploads, rss feeds for blurblogs, default images on blurblogs. 2012-07-30 21:43:55 -07:00
Samuel Clay
15df6b6b47 Making the icon importer a bit faster and more slave lag resilient by using page fetch data. Also fixing title on blurblogs. 2012-07-30 11:12:58 -07:00
Samuel Clay
72892f0a2b Better watching for story changes. This is both a speed improvement and usability fix, since now stories that haven't changed recently but did change before will no longer be declared as updated every time they are fetched. Props to @textfiles for the push. 2012-07-22 12:25:09 -07:00
Samuel Clay
18428a32a1 Auto-linkifying comments and replies, and stripping html from comments, replies, and story titles, tags, and authors. 2012-07-21 16:38:37 -07:00
Samuel Clay
e40b93882a Fixing issue around feeds thinking they are unfetched. 2012-06-18 15:59:31 -07:00
Samuel Clay
69bf581cd2 Merge branch 'master' into social
* master:
  Adding story permalink to story context-menu. Thanks to @grammargirl for the idea.
  Adding task servers and updating automated deploy.
  Removing dupe unique index in prep for social.
  Adding 3 new task servers.

Conflicts:
	apps/analyzer/models.py
	fabfile.py
	media/js/newsblur/reader/reader.js
	utils/feed_fetcher.py
2012-05-17 13:27:29 -07:00
Samuel Clay
96cf1e2dec Adding task servers and updating automated deploy. 2012-05-17 12:43:13 -07:00
Samuel Clay
d9d7ed279a Merge branch 'master' into social
* master:
  Don't know how I feel about this change, but http://gizmodo.com/author/mat-honan.xml is failing when 'Safari/X' is in the user agent, but only with http opener. Ugh.

Conflicts:
	utils/feed_fetcher.py
2012-05-07 17:17:12 -07:00
Samuel Clay
852202899d Don't know how I feel about this change, but http://gizmodo.com/author/mat-honan.xml is failing when 'Safari/X' is in the user agent, but only with http opener. Ugh. 2012-05-07 17:16:32 -07:00
Samuel Clay
b5c5cdeda3 Merge branch 'master' into social
* master:
  Fixing icon fetching error when the page is corrupted.
  Writing a glorious hack that forces a count of unread scores.

Conflicts:
	apps/reader/models.py
	apps/rss_feeds/management/commands/refresh_feeds.py
	fabfile.py
	utils/feed_fetcher.py
2012-04-24 17:55:20 -07:00
Samuel Clay
c1b5aef983 Fixing icon fetching error when the page is corrupted. 2012-04-24 17:40:34 -07:00
Samuel Clay
60eceda244 Merge branch 'master' into social
* master:
  Trying to fix inaccurate unread counts by forcing the dirty flag and not allowing timeouts.
  Removing unused cache.

Conflicts:
	apps/reader/models.py
	utils/feed_fetcher.py
2012-04-24 16:36:38 -07:00