Commit graph

299 commits

Author SHA1 Message Date
Samuel Clay
df386cbf6d Updating feeds just a tad bit quicker, to test out the new servers. 2011-03-23 19:00:28 -04:00
Samuel Clay
549536753f Toning down the aggresiveness on feed fetching. 2011-03-23 17:18:57 -04:00
Samuel Clay
90b2e4d5a8 Fetching feeds 4-6x times as often. 2011-03-22 19:30:50 -04:00
Samuel Clay
71c0ec32dc Cutting refresh delays by more than half. 2011-03-21 22:45:33 -04:00
Samuel Clay
fbfede640c Upgrading to mongodb 1.8. Adding user/pass to mongo, using item_frequencies with map_reduce (to avoid eval on the db). 2011-03-19 16:19:53 -04:00
Samuel Clay
a3e974f329 Merge branch 'master' into recommended
Conflicts:
	media/css/reader.css
2011-03-11 19:53:45 -05:00
Samuel Clay
b47f85dd2e Fixing issue around adding a URL that has both a duplicatefeed address, as well as a perfectly good canonical address. Use the Feed befor ethe DuplicateFeed. 2011-03-09 18:52:06 -05:00
Samuel Clay
24aa214346 Refactoring feed canonical representations. Split Feed from UserSubscription for use in the feed recommended module. Hooked up Statistics and Intelligence Trainer modals to the recommended feed. Still need Try/Add, and paging. 2011-03-04 12:27:31 -05:00
Samuel Clay
2b7542e090 Retooling feed fetch times to be based on active subscribers, not total subscribers. 2011-03-01 10:34:49 -05:00
Samuel Clay
eada5c565a Reloading feed on update. 2011-02-24 15:48:00 -05:00
Samuel Clay
e33656d000 Feed parsing bugs fixed. 2011-02-23 14:25:07 -05:00
Samuel Clay
d44d36d8f4 Limiting tags. 2011-02-22 13:36:38 -05:00
Samuel Clay
b68611a6d2 Fixing more bugs in feed fetching. 2011-02-15 21:16:34 -05:00
Samuel Clay
bb4e81b278 Fixing a whole lot of feed fetch bugs. 2011-02-15 21:08:40 -05:00
Samuel Clay
6549aa3a65 Adding feed and page fetch histories to statistics dialog. 2011-02-13 14:47:58 -05:00
Samuel Clay
bea23e23de Speeding up feed refreshes. Hopefully this won't strain the system too much. 2011-02-11 11:49:21 -05:00
Samuel Clay
5f473ef746 Fixing a glut of issues for missing feeds and missing subscriptions. 2011-02-09 18:52:36 -05:00
Samuel Clay
b22cada5e4 Adding full bootstrapping to fabfile. 2011-02-09 15:45:41 -05:00
Samuel Clay
6f92b7082e Fixing a slight error in lists vs. instances of feeds during adding. 2011-02-08 22:54:40 -05:00
Samuel Clay
48afe91758 Refactoring how feeds are found using urls in the add modal. Also fixing a display issue around showing the river icon in a collapsed feed and showing the manage menu. Lastly, changing the feedfinder's user agent because some assclown website was disallowing on the string 'feedfinder' 2011-02-08 22:07:59 -05:00
Samuel Clay
5b982d61b5 Fixing drag-and-drop for folders. Not ideal, but at least it works, including empty folders. 2011-02-08 09:44:24 -05:00
Samuel Clay
07e7e744c9 Helping out a strained fetch system by adding time between updates. 2011-02-07 17:19:40 -05:00
Samuel Clay
7892dbec33 No need to change tagline's max_length on migration. 2011-02-06 15:43:13 -05:00
Samuel Clay
4fd6a7cfe0 Fixing a metric-ton of bugs: Google Reader import on badly parsed xml, refreshing toplevel feeds loses their manage menu, retrying exception feeds now de-dupes and correctly updates on the page. Plus a bunch of other bugs. 2011-02-06 15:04:21 -05:00
Samuel Clay
33e2ee0960 Length check on feed tagline. 2011-02-05 22:19:28 -05:00
Samuel Clay
1b83aa088f Testing why a feed_tagline thats too long is causing issues. 2011-02-05 22:16:27 -05:00
Samuel Clay
ebad038920 Length check on feed tagline. 2011-02-05 22:15:03 -05:00
Samuel Clay
fc4d39da04 Length check on feed tagline. 2011-02-05 22:09:31 -05:00
Samuel Clay
57bb59bc4c Turning of MapReduce on popular tags for now. Waiting until Mongodb 1.8 to get MR on item_frequencies, so I can finally shard the database. 2011-02-05 19:37:15 -05:00
Samuel Clay
4a1062927a Turning off logging for dupe stories. 2011-02-05 15:43:59 -05:00
Samuel Clay
3723160155 A huge number of misc fixes: fixing potential errors on paypal return screen, mailing all feed/page parse errors, and swithcing to mapreduce item_frequencies in mongoengine. 2011-02-05 15:34:43 -05:00
Samuel Clay
5acbae2da9 Scaling back refreshes a bit for the time being. 2011-02-04 11:00:32 -05:00
Samuel Clay
53d759520f Fixing miscellaneous issues that have been throwing exceptions. Feed importing, google reader, loading feeds/pages, approving feeds. ALl with bad requests now let the user down easily as opposed to 500ing. 2011-02-03 18:38:10 -05:00
Samuel Clay
22cf5ede6c Crazy refactor of feedfinder to extract timelimits, so they can be caught by a lower-level api instead of messing up the feed fetcher. 2011-02-02 13:07:12 -05:00
Samuel Clay
58ae33fd50 Dynamically updating feed icons as they load. 2011-01-30 21:40:00 -05:00
Samuel Clay
47a2b4868d Don't save the literal word None. Doh. 2011-01-30 12:42:32 -05:00
Samuel Clay
b37d57613e Adapting icon_url, which comes from lxml, into unicode for the purposes of storing in the db. 2011-01-30 11:22:57 -05:00
Samuel Clay
75fead0a27 Cleaning up logging, adding several errors and timeout checks on page and icon fetching. Standardizing fetcher headers. 2011-01-29 22:01:09 -05:00
Samuel Clay
b938e95124 Correctly downloading, storing, retrieving, and showing favicons and gradients for favicons. This commit includes numerous fixes for the Feed view, too. Loaded. 2011-01-29 19:16:40 -05:00
Samuel Clay
27c633f0b0 Success on saving all images. Still some issues with transparency and resizing large images and having weird cutoffs. 2011-01-29 11:24:27 -05:00
Samuel Clay
a182bb1216 Finally saving proper base64 encoded favicons, along with their URLs, autodetecting when not found at /favicon.ico, and now all thats left is serving icons and their colors. Woohoo! 2011-01-27 19:05:50 -05:00
Samuel Clay
1478d7371b Merge branch 'river' into favicon
Conflicts:
	utils/feed_functions.py
2011-01-26 22:02:23 -05:00
Samuel Clay
93829518c1 Fixing errors in feed fetching. 2011-01-26 17:45:04 -05:00
Samuel Clay
ed3e34ea36 Merge branch 'master' into bookmarklet 2011-01-22 14:18:34 -05:00
Samuel Clay
cfc84416a4 Fixing up trim feeds so we can trim old unused feeds. 2011-01-22 11:33:58 -05:00
Samuel Clay
e14ba054ad Fixing up trim feeds so we can trim old unused feeds. 2011-01-22 11:32:49 -05:00
Samuel Clay
567840ffff Bookmarklet now shows a modal where you can select which folder to add the site. Includes JS and CSS, uncompressed, on host page. 2011-01-21 20:29:19 -05:00
Samuel Clay
80de98662a Removing many psql tables that no longer do anything. 2011-01-17 23:24:30 -05:00
Samuel Clay
0ab880f855 Dropping a bunch of extra postgres tables. 2011-01-17 23:20:25 -05:00
Samuel Clay
443fe69156 Moving text fields from Feed to FeedData. Migration includes deletion of old fields on Feed, now unused. 2011-01-17 22:48:38 -05:00