Commit graph

264 commits

Author SHA1 Message Date
Samuel Clay
47a2b4868d Don't save the literal word None. Doh. 2011-01-30 12:42:32 -05:00
Samuel Clay
b37d57613e Adapting icon_url, which comes from lxml, into unicode for the purposes of storing in the db. 2011-01-30 11:22:57 -05:00
Samuel Clay
75fead0a27 Cleaning up logging, adding several errors and timeout checks on page and icon fetching. Standardizing fetcher headers. 2011-01-29 22:01:09 -05:00
Samuel Clay
b938e95124 Correctly downloading, storing, retrieving, and showing favicons and gradients for favicons. This commit includes numerous fixes for the Feed view, too. Loaded. 2011-01-29 19:16:40 -05:00
Samuel Clay
27c633f0b0 Success on saving all images. Still some issues with transparency and resizing large images and having weird cutoffs. 2011-01-29 11:24:27 -05:00
Samuel Clay
a182bb1216 Finally saving proper base64 encoded favicons, along with their URLs, autodetecting when not found at /favicon.ico, and now all thats left is serving icons and their colors. Woohoo! 2011-01-27 19:05:50 -05:00
Samuel Clay
1478d7371b Merge branch 'river' into favicon
Conflicts:
	utils/feed_functions.py
2011-01-26 22:02:23 -05:00
Samuel Clay
93829518c1 Fixing errors in feed fetching. 2011-01-26 17:45:04 -05:00
Samuel Clay
ed3e34ea36 Merge branch 'master' into bookmarklet 2011-01-22 14:18:34 -05:00
Samuel Clay
cfc84416a4 Fixing up trim feeds so we can trim old unused feeds. 2011-01-22 11:33:58 -05:00
Samuel Clay
e14ba054ad Fixing up trim feeds so we can trim old unused feeds. 2011-01-22 11:32:49 -05:00
Samuel Clay
567840ffff Bookmarklet now shows a modal where you can select which folder to add the site. Includes JS and CSS, uncompressed, on host page. 2011-01-21 20:29:19 -05:00
Samuel Clay
80de98662a Removing many psql tables that no longer do anything. 2011-01-17 23:24:30 -05:00
Samuel Clay
0ab880f855 Dropping a bunch of extra postgres tables. 2011-01-17 23:20:25 -05:00
Samuel Clay
443fe69156 Moving text fields from Feed to FeedData. Migration includes deletion of old fields on Feed, now unused. 2011-01-17 22:48:38 -05:00
Samuel Clay
b433fae866 Adding FeedData table to remove the extra text heavy ifnormation from the already too-cluttered Feed table. 2011-01-17 20:23:29 -05:00
Samuel Clay
abb1b08f68 Updating timezones to be django 1.3 compliant. Also adding index to active and active_subs fields on feeds table. 2011-01-17 13:52:11 -05:00
Samuel Clay
2396854475 Handling feeds that disappear due to being duped, but the user is already logged in and is eventually going to click on the now missing feed. Correctly identifies missing feed, switches out the original non-dupe feed, and all is well. 2011-01-14 00:59:51 -05:00
Samuel Clay
fed9bc0924 Downloading, parsing, and shaping favicons into colors. Doesn't work for many images, though. Still need to parse the best non-black/white color. 2011-01-09 23:11:09 -05:00
Samuel Clay
f0a75efe0a Forcing merge_feeds to respect insertion order. 2010-12-23 17:09:08 -05:00
Samuel Clay
4f35c2fade Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin. 2010-12-23 13:29:31 -05:00
Samuel Clay
b98c63dd14 Abstracting feed queueing so I can queue a queryset of feeds from the command line. Also adding in queueing of feeds that have not been updated in a week (for those that fall through the cracks. 2010-12-23 12:32:24 -05:00
Samuel Clay
ae4646e979 Nice middle ground between guids and dates. Now only retrieving as many guids are in the feed, but then comparing them with N stories. Very old stories shouldnt change, and they'll get thwarted by an IntegrityCheck. 2010-12-16 17:10:13 -05:00
Samuel Clay
86af737159 Experimental feed difference change. More expensive, but will detect when things are actually changing. 2010-12-16 16:52:00 -05:00
Samuel Clay
ea024ad0ff Remvoing read stories from river, but this doesn't take into account the last marked_read date, nor intelligence classifiers. 2010-12-13 10:15:43 -05:00
Samuel Clay
a6818219d7 Fixing feed parsing for stories with dict ids. This includes all Google Reader feeds and Google News Alerts. Thanks to Richard <richard@lbrc.org>. 2010-12-10 15:58:21 -05:00
Samuel Clay
fd88d41f74 Showing starred stories in their own feed view. 2010-12-02 20:18:33 -05:00
Samuel Clay
4507f7286a Stars now save to the new StarredStory mongo model. THey are also persistent on the client-side. Now to just make a special starred stories view and counter. 2010-11-30 10:30:18 -05:00
Samuel Clay
540246e30a Trying to load redirected images in the feed view. Also fixing up the feed api to not quote URLs. 2010-11-15 22:43:01 -05:00
Samuel Clay
fa663e910a Faster feed refreshing (insta-fetching) by only computing the score for the current user and leaving the other users with dirty subscriptions. 2010-11-10 18:04:17 -05:00
Samuel Clay
21379537aa Showing title classifiers in story trainer. 2010-11-09 22:06:08 -05:00
Samuel Clay
582b302bd1 Merge feeds chokes when a user has read stories from both the dupe feed and the original feed. Uhh, ok. 2010-11-09 11:40:26 -05:00
Samuel Clay
b66080ca4d Fixing how duplicate feeds are handled and found. When a subscription is not found, check for duplicate feeds and then switch accordingly. When merging feeds, don't forget to bring along the dupe feed's dupe feeds. 2010-11-09 09:55:44 -05:00
Samuel Clay
e7646d7e98 Adding change password to Preferences. Also changing timing for feed updates. 2010-11-08 12:09:55 -05:00
Samuel Clay
3afe36171e Story count cutoffs get even more restrictive in the hopes of tirmming feed load times. 2010-11-07 22:32:27 -05:00
Samuel Clay
3865cb77fa Small visual tweaks as well as tightening up some logging. 2010-11-07 00:40:26 -04:00
Samuel Clay
9803dfaf09 Premium subscribers get their 5x bonus on updates. 2010-11-06 13:44:23 -04:00
Samuel Clay
fd535e7103 Removing odd benefit to popular feeds with no stories. 2010-11-06 13:42:58 -04:00
Samuel Clay
896645f5c7 Lessening the damage of such high update rates on feeds. 2010-11-06 13:33:04 -04:00
Samuel Clay
1c9b2fbff8 Fixing a bug around empty/blank story content. Don't panic 2010-11-06 12:59:54 -04:00
Samuel Clay
b30752a9c1 A huge slew of bug fixes related to feed fetching, missing ids, and missing feeds. 2010-11-05 20:34:17 -04:00
Samuel Clay
b31c277dd0 Making more sane intervals between feed updates. 2010-11-05 15:54:26 -04:00
Samuel Clay
5a6db9c1fb Adding story_date index back in to MStory. 2010-11-04 23:04:42 -04:00
Samuel Clay
44fcee1568 Adding uniqueness on Folders. Also removing unused indexes in mongo. 2010-11-04 22:47:18 -04:00
Samuel Clay
905766c7e5 Preferences! Timezone support, new window setting, and default story view. 2010-10-31 16:03:50 -04:00
Samuel Clay
edae9eff38 Ensure no negative subscribers during feed update calculation. 2010-10-29 14:18:39 -04:00
Samuel Clay
224def1eed Updating collocations for mongodb. 2010-10-29 12:37:51 -04:00
Samuel Clay
d0e25a0716 Updating feed polling intervals. Also adding a progress bar to premium upgrading screen. Should make for a smoother transition for those high-feed subscribers. 2010-10-29 12:28:05 -04:00
Samuel Clay
f5e36c5b8e Only deactivating feed exceptions. Turning page exceptions back on, since they can now be handled in the UI. 2010-10-29 11:45:00 -04:00
Samuel Clay
667de1e1f1 Forcing inactive feeds to go active when exception is gone. 2010-10-27 13:09:46 -04:00