92 commits

Author	SHA1	Message	Date
Samuel Clay	279041249e	Fixing missing scipy import missing form PILlow.	2013-03-22 15:33:26 -07:00
Samuel Clay	acb1efd3ea	Last imports for pillow.	2013-03-22 15:27:10 -07:00
Samuel Clay	4a7516cb83	Fixing a bunch of feed fetch errors.	2012-10-01 19:31:33 -07:00
Samuel Clay	1252819c8c	Fixing issue when opening feed in Story view but second story gets selected instead of first.	2012-09-21 11:36:27 -07:00
Samuel Clay	838cabbd42	Typo in s3 icon.	2012-09-20 12:44:41 -07:00
Samuel Clay	a8975a3bc4	Forcing icon save if the icon is not yet in s3.	2012-09-20 12:43:34 -07:00
Samuel Clay	1ace793648	Completing feed icon migration to S3.	2012-09-20 12:29:52 -07:00
Samuel Clay	88c86e273a	S3 icons. Untested.	2012-09-19 16:33:23 -07:00
Samuel Clay	00ba259c66	Migrating to S3 for feed pages.	2012-09-18 17:09:07 -07:00
Samuel Clay	2e42cd3e8f	Encoding utf-8 strings into bytecodes so lxml doesn't choke.	2012-08-29 23:16:23 -07:00
Samuel Clay	15df6b6b47	Making the icon importer a bit faster and more slave lag resilient by using page fetch data. Also fixing title on blurblogs.	2012-07-30 11:12:58 -07:00
Samuel Clay	febd0ae0a3	Lots of little bugs: avatar images, icon importer, page importer, adding analytics tracking to intro.	2012-07-12 12:57:35 -07:00
Samuel Clay	cd589951c9	Adding etags (304's) to feed icons.	2012-03-29 16:03:06 -07:00
Samuel Clay	53efae20ff	Fixing a few bugs introduced with feed_id conversions.	2012-01-27 15:29:14 -08:00
Samuel Clay	2b9ad97b51	Switching a ton of feed and user fetches to simple ID matches. ".user.pk -> .user_id"	2012-01-26 09:32:24 -08:00
Samuel Clay	6a68181974	Fixing image processing issue and updating to latest feedparser.	2011-08-27 13:27:21 -07:00
Samuel Clay	130196e6e0	Adding attribution on favicon .ico handling.	2011-07-13 17:45:43 -07:00
Samuel Clay	bb18f3e284	Icon importer now saves to both mongo and psql for icons.	2011-04-26 19:43:19 -04:00
Samuel Clay	232af01b98	Commenting the icon importer for the Braindump Algorithms talk.	2011-04-13 20:05:34 -04:00
Samuel Clay	74c1227739	Fixing icon download errors.	2011-02-02 13:32:52 -05:00
Samuel Clay	1ed82654aa	Fixing icon download errors.	2011-02-02 13:24:58 -05:00
Samuel Clay	7424dc9715	Adding a bit for finding the favicon. Also handling all errors on fetching the HTML of the site for finding the icon.	2011-01-30 20:42:11 -05:00
Samuel Clay	70bb450b8d	Handling a weird typeerror on feed parsaing.	2011-01-30 20:16:34 -05:00
Samuel Clay	4b4c5b76aa	Screw it. Too many different exceptions come from fetching URLs. If anything goes wrong, not much we can do.	2011-01-30 14:58:14 -05:00
Samuel Clay	5927f857b2	Handling non-numeric ports in icon fetching.	2011-01-30 14:26:18 -05:00
Samuel Clay	470af9fa19	Handling non-numeric ports in icon fetching.	2011-01-30 14:23:26 -05:00
Samuel Clay	f3d922f6b1	Fixing up statistics modal.Also handling weird URL cases in icon fetching.	2011-01-30 13:33:09 -05:00
Samuel Clay	40b6ac4c7c	Handling parser errors from lxml in icon fetching.	2011-01-30 13:25:45 -05:00
Samuel Clay	3f4018249f	Handling parser errors from lxml in icon fetching.	2011-01-30 13:24:17 -05:00
Samuel Clay	eefb189e52	Handling parser errors from lxml in icon fetching.	2011-01-30 13:23:54 -05:00
Samuel Clay	7941e2f8b0	Handling parser errors from lxml in icon fetching.	2011-01-30 13:23:20 -05:00
Samuel Clay	0175a8b26f	Forcing useful feed_links.	2011-01-30 13:07:55 -05:00
Samuel Clay	bb0b8502af	Handling timeouts from inside the icon_importer.	2011-01-30 13:06:31 -05:00
Samuel Clay	c5d380ec3e	Adding timeout to icon fetching, and handling bad .ICOs	2011-01-30 12:53:05 -05:00
Samuel Clay	d4bed1399c	Don't bother fetching an icon if we don't even have the feed_link.	2011-01-30 12:44:34 -05:00
Samuel Clay	93810cf1c6	Short circuiting feeds with no pages during icon importing.	2011-01-30 12:40:29 -05:00
Samuel Clay	f9062edc6e	Using global PIL imports rather than namespaced PIL imports. (import Image vs. from PIL import Image)	2011-01-30 11:07:15 -05:00
Samuel Clay	75fead0a27	Cleaning up logging, adding several errors and timeout checks on page and icon fetching. Standardizing fetcher headers.	2011-01-29 22:01:09 -05:00
Samuel Clay	235f88fb50	Handling Win32 ICOs with alpha. Holy god, this was fucking insane to handle. My saturday evenings, people.	2011-01-29 20:20:35 -05:00
Samuel Clay	b938e95124	Correctly downloading, storing, retrieving, and showing favicons and gradients for favicons. This commit includes numerous fixes for the Feed view, too. Loaded.	2011-01-29 19:16:40 -05:00
Samuel Clay	27c633f0b0	Success on saving all images. Still some issues with transparency and resizing large images and having weird cutoffs.	2011-01-29 11:24:27 -05:00
Samuel Clay	a182bb1216	Finally saving proper base64 encoded favicons, along with their URLs, autodetecting when not found at /favicon.ico, and now all thats left is serving icons and their colors. Woohoo!	2011-01-27 19:05:50 -05:00