Commit graph

1452 commits

Author SHA1 Message Date
Samuel Clay
c172fd5f3e Adding new status page to show last feeds fetched and their stats. 2011-03-01 09:59:06 -05:00
Samuel Clay
eada5c565a Reloading feed on update. 2011-02-24 15:48:00 -05:00
Samuel Clay
e33656d000 Feed parsing bugs fixed. 2011-02-23 14:25:07 -05:00
Samuel Clay
de80258365 Adding *'s to premium users during logging. 2011-02-23 13:46:47 -05:00
Samuel Clay
d44d36d8f4 Limiting tags. 2011-02-22 13:36:38 -05:00
Samuel Clay
09021ea08c Trying to fix stale feeds by checking for a last update of a day. 2011-02-22 09:37:09 -05:00
Samuel Clay
b68611a6d2 Fixing more bugs in feed fetching. 2011-02-15 21:16:34 -05:00
Samuel Clay
bb4e81b278 Fixing a whole lot of feed fetch bugs. 2011-02-15 21:08:40 -05:00
Samuel Clay
6549aa3a65 Adding feed and page fetch histories to statistics dialog. 2011-02-13 14:47:58 -05:00
Samuel Clay
bea23e23de Speeding up feed refreshes. Hopefully this won't strain the system too much. 2011-02-11 11:49:21 -05:00
Samuel Clay
5f473ef746 Fixing a glut of issues for missing feeds and missing subscriptions. 2011-02-09 18:52:36 -05:00
Samuel Clay
b22cada5e4 Adding full bootstrapping to fabfile. 2011-02-09 15:45:41 -05:00
Samuel Clay
6f92b7082e Fixing a slight error in lists vs. instances of feeds during adding. 2011-02-08 22:54:40 -05:00
Samuel Clay
48afe91758 Refactoring how feeds are found using urls in the add modal. Also fixing a display issue around showing the river icon in a collapsed feed and showing the manage menu. Lastly, changing the feedfinder's user agent because some assclown website was disallowing on the string 'feedfinder' 2011-02-08 22:07:59 -05:00
Samuel Clay
5b982d61b5 Fixing drag-and-drop for folders. Not ideal, but at least it works, including empty folders. 2011-02-08 09:44:24 -05:00
Samuel Clay
07e7e744c9 Helping out a strained fetch system by adding time between updates. 2011-02-07 17:19:40 -05:00
Samuel Clay
7892dbec33 No need to change tagline's max_length on migration. 2011-02-06 15:43:13 -05:00
Samuel Clay
4fd6a7cfe0 Fixing a metric-ton of bugs: Google Reader import on badly parsed xml, refreshing toplevel feeds loses their manage menu, retrying exception feeds now de-dupes and correctly updates on the page. Plus a bunch of other bugs. 2011-02-06 15:04:21 -05:00
Samuel Clay
33e2ee0960 Length check on feed tagline. 2011-02-05 22:19:28 -05:00
Samuel Clay
1b83aa088f Testing why a feed_tagline thats too long is causing issues. 2011-02-05 22:16:27 -05:00
Samuel Clay
ebad038920 Length check on feed tagline. 2011-02-05 22:15:03 -05:00
Samuel Clay
fc4d39da04 Length check on feed tagline. 2011-02-05 22:09:31 -05:00
Samuel Clay
ea15aa1175 Major improvement to feed fetching and parsing by upgrading feedparser to v5.0. Also sending correctly formatted feed information to debug email. And handling invalid page URLs gracefully. 2011-02-05 20:49:52 -05:00
Samuel Clay
57bb59bc4c Turning of MapReduce on popular tags for now. Waiting until Mongodb 1.8 to get MR on item_frequencies, so I can finally shard the database. 2011-02-05 19:37:15 -05:00
Samuel Clay
ff3a078d30 Fixing feed error on page importer. Whoops. 2011-02-05 15:47:56 -05:00
Samuel Clay
4a1062927a Turning off logging for dupe stories. 2011-02-05 15:43:59 -05:00
Samuel Clay
3723160155 A huge number of misc fixes: fixing potential errors on paypal return screen, mailing all feed/page parse errors, and swithcing to mapreduce item_frequencies in mongoengine. 2011-02-05 15:34:43 -05:00
Samuel Clay
5acbae2da9 Scaling back refreshes a bit for the time being. 2011-02-04 11:00:32 -05:00
Samuel Clay
53d759520f Fixing miscellaneous issues that have been throwing exceptions. Feed importing, google reader, loading feeds/pages, approving feeds. ALl with bad requests now let the user down easily as opposed to 500ing. 2011-02-03 18:38:10 -05:00
Samuel Clay
74c1227739 Fixing icon download errors. 2011-02-02 13:32:52 -05:00
Samuel Clay
1ed82654aa Fixing icon download errors. 2011-02-02 13:24:58 -05:00
Samuel Clay
22cf5ede6c Crazy refactor of feedfinder to extract timelimits, so they can be caught by a lower-level api instead of messing up the feed fetcher. 2011-02-02 13:07:12 -05:00
Samuel Clay
58ae33fd50 Dynamically updating feed icons as they load. 2011-01-30 21:40:00 -05:00
Samuel Clay
7424dc9715 Adding a bit for finding the favicon. Also handling all errors on fetching the HTML of the site for finding the icon. 2011-01-30 20:42:11 -05:00
Samuel Clay
70bb450b8d Handling a weird typeerror on feed parsaing. 2011-01-30 20:16:34 -05:00
Samuel Clay
4b4c5b76aa Screw it. Too many different exceptions come from fetching URLs. If anything goes wrong, not much we can do. 2011-01-30 14:58:14 -05:00
Samuel Clay
5927f857b2 Handling non-numeric ports in icon fetching. 2011-01-30 14:26:18 -05:00
Samuel Clay
470af9fa19 Handling non-numeric ports in icon fetching. 2011-01-30 14:23:26 -05:00
Samuel Clay
f3d922f6b1 Fixing up statistics modal.Also handling weird URL cases in icon fetching. 2011-01-30 13:33:09 -05:00
Samuel Clay
40b6ac4c7c Handling parser errors from lxml in icon fetching. 2011-01-30 13:25:45 -05:00
Samuel Clay
3f4018249f Handling parser errors from lxml in icon fetching. 2011-01-30 13:24:17 -05:00
Samuel Clay
eefb189e52 Handling parser errors from lxml in icon fetching. 2011-01-30 13:23:54 -05:00
Samuel Clay
7941e2f8b0 Handling parser errors from lxml in icon fetching. 2011-01-30 13:23:20 -05:00
Samuel Clay
0175a8b26f Forcing useful feed_links. 2011-01-30 13:07:55 -05:00
Samuel Clay
bb0b8502af Handling timeouts from inside the icon_importer. 2011-01-30 13:06:31 -05:00
Samuel Clay
c5d380ec3e Adding timeout to icon fetching, and handling bad .ICOs 2011-01-30 12:53:05 -05:00
Samuel Clay
d4bed1399c Don't bother fetching an icon if we don't even have the feed_link. 2011-01-30 12:44:34 -05:00
Samuel Clay
47a2b4868d Don't save the literal word None. Doh. 2011-01-30 12:42:32 -05:00
Samuel Clay
93810cf1c6 Short circuiting feeds with no pages during icon importing. 2011-01-30 12:40:29 -05:00
Samuel Clay
b37d57613e Adapting icon_url, which comes from lxml, into unicode for the purposes of storing in the db. 2011-01-30 11:22:57 -05:00