Commit graph

922 commits

Author SHA1 Message Date
Samuel Clay
8c085b0a3c Gutting dynamodb and just keeping good changes. 2012-11-27 16:44:10 -08:00
Samuel Clay
61aac7fc06 Merge branch 'master' into dynamodb
* master: (331 commits)
  Adding blurblog permalink to story on blurblog. Adding story slug to permalink. Fixing story guid hashes.
  Re-enabling message property for facebook.
  Ignoring image for facebook shares.
  Commenting out facebook share message until they approve it.
  Cleaning up Facebook og description.
  Facebook using a website instead of article.
  Facebook being a PITA.
  Facebook wants ISO8601 datetime format.
  Facebook doesn't like going to other URLs.
  Facebook doesn't like going to other URLs.
  Dumb typo in new facebook og crap.
  Using blurblog permalink for new facebook shares.
  Fixing Facebook share to use fancy actions.
  Adding scroll to comments button to share bar. Thanks @afita.
  Turning off microformats for more errors.
  Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds.
  Cleaning redis stories for 1% of all feed fetches.
  Refreshing feed on fetch.
  Fiddling with logging on dupe feeds.
  Adding bs facebook assets.
  ...

Conflicts:
	apps/rss_feeds/models.py
	settings.py
	utils/feed_fetcher.py
2012-11-27 16:39:39 -08:00
Samuel Clay
1ad7031fbb Fixing tests. 2012-11-27 16:22:03 -08:00
Samuel Clay
931d4bc991 Adding blurblog permalink to story on blurblog. Adding story slug to permalink. Fixing story guid hashes. 2012-11-27 11:59:54 -08:00
Samuel Clay
20439ea85f Fiddling with logging on dupe feeds. 2012-11-26 10:20:41 -08:00
Samuel Clay
caa0564f11 Adding share info to saved stories. 2012-11-16 15:43:39 -08:00
Samuel Clay
c19713eabf Adding offsets to unread count fixing. 2012-10-30 11:41:01 -07:00
Samuel Clay
34898004d5 Recount popular authors every 50 new stories. 2012-10-30 10:40:49 -07:00
Samuel Clay
769a1e084e Manually counting can now use offsets in case of broken feeds. 2012-10-30 09:11:39 -07:00
Samuel Clay
b49526d87b Upgrading redis to 2.6.2. 2012-10-29 14:58:43 -07:00
Samuel Clay
e572b3d53f Moving to better feed finder (in the case of dupe feeds). 2012-10-25 16:14:25 -07:00
Samuel Clay
a4e57a0a1f Removing feedloadtime and hide_mobile in db. 2012-10-23 17:55:09 -07:00
Samuel Clay
143e32e205 Merge branch 'master' of github.com:samuelclay/NewsBlur
* 'master' of github.com:samuelclay/NewsBlur:
  Adding a new endpoint for updating unread counts that isn't rate limited.
  Big new feature: real-time unread counts when reading on multiple devices. Read a story on your iPhone and the feed unread count updates instantaneously on the web.
  Cleaning invalid ids.
  Cleanign up ec2 firewall rules.
  Cleaning up a few things, specifically laying out groundwork for pools.
  Registered additional handlers for Firefox.
  Using a regex to remove comments.
  Disabling the crippling effects of comment stripping.
  Handling invalid html when cleaning.
  Removing old lxml attr.
  Stripping comments from all stories. This fixes the weird bug where '>more>' crap shows up.
  Prettifying rss feed for social shared stories blurblog.
  Updating android welcome header graphic.
  Adding official Android app static page.
  Adding new iPhone screenshots. Also rewriting rss feed to include user comments.
  Fixing last few bugs (paging for next unread on river blurblog) before submission of v1.6 of iOS app.
  Updating saved stories count on save/unsave.
2012-10-23 09:30:39 -07:00
Samuel Clay
83ebd2391a Turning down replica lag unread count give up time to 10 sec from 60s. 2012-10-23 09:30:14 -07:00
Samuel Clay
f071e8c43e Cleaning invalid ids. 2012-10-22 11:23:38 -07:00
Samuel Clay
df1fd7176e Cleaning up a few things, specifically laying out groundwork for pools. 2012-10-22 10:16:42 -07:00
Samuel Clay
68d12d8c24 Using a regex to remove comments. 2012-10-19 13:53:11 -07:00
Samuel Clay
927d8e39b6 Disabling the crippling effects of comment stripping. 2012-10-19 13:44:32 -07:00
Samuel Clay
5ce475428f Stripping comments from all stories. This fixes the weird bug where '>more>' crap shows up. 2012-10-19 12:49:39 -07:00
Samuel Clay
4a7516cb83 Fixing a bunch of feed fetch errors. 2012-10-01 19:31:33 -07:00
Samuel Clay
ee72253695 Fixing these damn Link: text urls in story modifications. 2012-10-01 19:04:09 -07:00
Samuel Clay
79d07cac05 Fixing JS issues around stories with no feeds clobbering the river view. 2012-09-27 10:44:55 -07:00
Samuel Clay
568d97cdac Shifting mgirations for DStory. 2012-09-24 14:32:07 -07:00
Samuel Clay
b81381b120 Merge branch 'master' into dynamodb
* master:
  Updating favicon to include 64x64 icon for Metro.
  Marking shared stories as read.
  Coering story content into unicode to handle changes.
  Fetching more stories.
  Moving from Aaron Swartz's html diff lib to lxml's html diff lib. Should fix issues around disappearing content.
  Favicon for IE9 and for 32x32.
  Trying to repair favicon for ie9 users.
2012-09-24 14:25:35 -07:00
Samuel Clay
cff4b404fe Coering story content into unicode to handle changes. 2012-09-24 13:36:06 -07:00
Samuel Clay
04184bfd6d Moving from Aaron Swartz's html diff lib to lxml's html diff lib. Should fix issues around disappearing content. 2012-09-24 13:23:31 -07:00
Samuel Clay
bf8c202848 Merge branch 'master' into dynamodb
* master:
  Fixing issue on ev machines not being backed by s3. Also removing unused faq and about js.
2012-09-24 11:16:41 -07:00
Samuel Clay
56162dc871 Fixing issue on ev machines not being backed by s3. Also removing unused faq and about js. 2012-09-21 17:41:07 -07:00
Samuel Clay
2bb38975eb Merge branch 'master' into dynamodb
* master:
  Adding 1.5X as many stories to the dupe detector. Hope I don't regret this.
  Fixing issue when opening feed in Story view but second story gets selected instead of first.
  Changing how signin locks on welcome page.
2012-09-21 15:24:24 -07:00
Samuel Clay
1252819c8c Fixing issue when opening feed in Story view but second story gets selected instead of first. 2012-09-21 11:36:27 -07:00
Samuel Clay
5ae803ff7d Merge branch 'master' into dynamodb
* master:
  Typo in s3 icon.
  Forcing icon save if the icon is not yet in s3.
  Completing feed icon migration to S3.
  Segmenting color for load times.
  Segmenting color for load times.
  Ignoring replica lag if no replicas present.
  Ignoring replica lag if no replicas present.
2012-09-20 12:55:34 -07:00
Samuel Clay
838cabbd42 Typo in s3 icon. 2012-09-20 12:44:41 -07:00
Samuel Clay
a8975a3bc4 Forcing icon save if the icon is not yet in s3. 2012-09-20 12:43:34 -07:00
Samuel Clay
1ace793648 Completing feed icon migration to S3. 2012-09-20 12:29:52 -07:00
Samuel Clay
3c9114fa05 Merge branch 'master' into dynamodb
* master:
  S3 icons. Untested.
  Removing old feed pages from mongo.
  Allowing proxy of S3 for original pages to be turned off.
  Adding ec2 mdadm setup.
  Adding proxy for S3 pages.
  Migration for s3 flags for pages + icons.
  Migrating to S3 for feed pages.
  Cleaning up footer on welcome page.
  Retina-izing twitter and github logos.
  Adding mongo conf for ec2 (trying out ec2 for some servers).
  Fixing a bunch of small exceptions.
  Small cleanup on welcome page, fixing social subs urls.
  Updating welcome apge to include pricing and a cleaned up footer.
  Fixing a couple of update bugs -- story cascading potentially resulting in invalid ids (probably not), and not unique errors on new page fetches.

Conflicts:
	apps/rss_feeds/models.py
	settings.py
2012-09-19 16:37:47 -07:00
Samuel Clay
88c86e273a S3 icons. Untested. 2012-09-19 16:33:23 -07:00
Samuel Clay
db3b2ae4d6 Removing old feed pages from mongo. 2012-09-19 12:36:50 -07:00
Samuel Clay
f1d660cd9e Migration for s3 flags for pages + icons. 2012-09-18 17:09:20 -07:00
Samuel Clay
00ba259c66 Migrating to S3 for feed pages. 2012-09-18 17:09:07 -07:00
Samuel Clay
f4add87dc6 Fixing a couple of update bugs -- story cascading potentially resulting in invalid ids (probably not), and not unique errors on new page fetches. 2012-09-17 17:01:56 -07:00
Samuel Clay
294e790e2c Merge branch 'master' into dynamodb
* master: (31 commits)
  Adding delay to showing login when moving from reader.
  Updating welcome email to point to iPad app.
  Correctly handling URL loading cases and hiding/showing sidebar correctly in welcome splash screen.
  Showing signup button in tryout view. Splash apge hides when in tryout mode. Still need to preload feed view and show feed list on url load.
  Finishing up tryout. Still need Sign Up callout.
  Deleting unused maintenance.
  Updating logo for retina.
  Fixing a small gradient color, and blurring on rotation.
  Re-coloring welcome header.
  Adding padding for activities module.
  Updating logo for retina.
  Fixing android header image.
  Styling footer, using better web graphic for header.
  Upgrading iphone/ipad app to support both ios 6 and tall-iphone.
  New folder options: add subfolder.
  Adding location to find friends.
  Trimming mongodb lag cutoff to force feeds to correct themselves when slave lag becomes an issue.
  Fixing 'r' refresh command for All Site Stories.
  Fixing broken social page.
  Google Reader logo and spacing.
  ...
2012-09-17 14:53:12 -07:00
Samuel Clay
47434c2823 Trimming mongodb lag cutoff to force feeds to correct themselves when slave lag becomes an issue. 2012-09-13 13:54:40 -07:00
Samuel Clay
4ec6c9fefd Merge branch 'master' into dynamodb
* master: (23 commits)
  Fixing trainer for stories in social feeds.
  Fixing small bug in story titles header now showing socialsubs correctly.
  Fixing headers for Everything river and river blurblog.
  Massive refactor around feedbar, brought on by @afita, in order to give Folders a menu in the story titles header (and then make the mark as read button work on folders in the header.)
  Updating story position in closed story titles when pane is re-opened. Thanks to @afita for the bug.
  Updating to altest jQuery layout.
  Adding folder story counts to content pane. Thanks to @afita for the suggestion.
  Fixing activities bug when the user is unknown and there is no source/with_user.
  Calculating correct page fetch timing offset (if it was a 304).
  Adding server name and feed code to analytics.
  Turning analytics logging back on.
  Temporarily commenting out analytics to see if they cure the slow down.
  Shortening names on analytics for improved space saving.
  Adding new analytics collections to keep track of page loads and feed fetches. Need to start aggregating before I can tell how useful this data will be.
  Adding new analytics collections to keep track of page loads and feed fetches. Need to start aggregating before I can tell how useful this data will be.
  Adding VentureBeat article to press page.
  Adding order/read_filter to api. Also adding river blurblog.
  Fixing right click on folders.
  Fixing bug where publisher-disabled original pages were not properly disabled.
  Fixing bug where publisher-disabled original pages were not properly disabled.
  ...

Conflicts:
	utils/feed_fetcher.py
2012-09-07 22:26:19 -07:00
Samuel Clay
6e9c604241 Fixing bug where publisher-disabled original pages were not properly disabled. 2012-09-05 12:18:06 -07:00
Samuel Clay
0a03154473 First half of DynamoDB trial, converting stories from mongo to dynamodb. Still needs to be updated/inserted on feed update, and then processed with all MStory uses. 2012-09-04 12:01:55 -07:00
Samuel Clay
2e42cd3e8f Encoding utf-8 strings into bytecodes so lxml doesn't choke. 2012-08-29 23:16:23 -07:00
Samuel Clay
b2f771e53b Attempting to fix user exception dialogs. 2012-08-27 15:22:42 -07:00
Samuel Clay
0fb8c8459d Cleaning up feed calculation in feed fetching. 2012-08-17 00:10:17 -07:00
Samuel Clay
2fa00fd737 Forcing the feed fetcher to not count scores when there's replica lag. God this had better work. 2012-08-16 23:56:21 -07:00
Samuel Clay
92cdfaff66 Removing all removal of read stories, so that they stick around for blurblogs. No good answer for this one. 2012-08-16 22:40:54 -07:00