Samuel Clay
42b85d485a
Merge branch 'schedule' into schedule_dev
...
* schedule:
Adding metric for last story date, used to calculate next scheduled update.
2013-04-23 17:04:27 -07:00
Samuel Clay
1584208677
Adding metric for last story date, used to calculate next scheduled update.
2013-04-23 17:04:21 -07:00
Samuel Clay
9aafd8eab2
Adding delaying to reader import. Adding reader starred story import.
2013-04-02 15:41:50 -07:00
Samuel Clay
79200d7bc1
Adding RStats, necessary to remove mongodb analytics.
2013-03-25 11:10:41 -07:00
Samuel Clay
9e2fa3115d
Cache busting feeds on force and 1% of the time.
2013-03-24 15:50:57 -07:00
Samuel Clay
aefd8de78c
Backporting collections.Counter to python2.6
2013-01-03 18:15:00 -08:00
Samuel Clay
61aac7fc06
Merge branch 'master' into dynamodb
...
* master: (331 commits)
Adding blurblog permalink to story on blurblog. Adding story slug to permalink. Fixing story guid hashes.
Re-enabling message property for facebook.
Ignoring image for facebook shares.
Commenting out facebook share message until they approve it.
Cleaning up Facebook og description.
Facebook using a website instead of article.
Facebook being a PITA.
Facebook wants ISO8601 datetime format.
Facebook doesn't like going to other URLs.
Facebook doesn't like going to other URLs.
Dumb typo in new facebook og crap.
Using blurblog permalink for new facebook shares.
Fixing Facebook share to use fancy actions.
Adding scroll to comments button to share bar. Thanks @afita.
Turning off microformats for more errors.
Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds.
Cleaning redis stories for 1% of all feed fetches.
Refreshing feed on fetch.
Fiddling with logging on dupe feeds.
Adding bs facebook assets.
...
Conflicts:
apps/rss_feeds/models.py
settings.py
utils/feed_fetcher.py
2012-11-27 16:39:39 -08:00
Samuel Clay
04d61ceff4
Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds.
2012-11-26 11:41:31 -08:00
Samuel Clay
0a03154473
First half of DynamoDB trial, converting stories from mongo to dynamodb. Still needs to be updated/inserted on feed update, and then processed with all MStory uses.
2012-09-04 12:01:55 -07:00
Samuel Clay
32ba51a775
Fixing folder merge so category additions can be idempotent. Also fixing social connect size for iPhone.
2012-08-12 18:57:29 -07:00
Samuel Clay
d3b58e7cc9
Deferring OPML import if it takes > 20 seconds. Email user when complete. Also, hamburgers. This one's for @torrez.
2012-07-20 19:43:28 -07:00
Samuel Clay
0468fe12dc
Finished styling comments. Showing all sharers now.
2012-01-15 20:51:48 -08:00
Samuel Clay
c0fa6b263e
Adding share keys and comment keys to redis, in order to distinguish between the two.
2012-01-13 09:20:37 -08:00
Samuel Clay
288d6c8e49
The @kennethreitz commit: logging all discrepencies between requests and urllib2. This should take a few hours.
2012-01-05 20:59:48 -08:00
Samuel Clay
6637c05adf
Adding a little bit more leeway in page importer by falling back to urllib2 when requests fail.
2011-12-20 22:30:55 -08:00
Samuel Clay
646df377bf
Fixing emergency UTF-8 encoding bug. Russians rejoice\!
2011-12-02 11:37:55 -08:00
Samuel Clay
8f5a4c612d
Updating rss_feeds tests for completeness. Updating README to include how to run test suite.
2011-09-01 09:11:29 -07:00
Samuel Clay
442012fdeb
Ading pull to refresh on feed detail in iphone app. Not done, but also added extra parameter in feed canonical model that gives seconds since last update.
2011-08-18 09:56:52 -07:00
Samuel Clay
b87a5de6ce
Lots of work towards the eventual release of recommended feeds. Now can try feeds (maybe taste would've been a better name?).
2011-03-15 23:42:27 -04:00
Samuel Clay
7c136f7ea1
Fixing an issue around adding feeds and having them show up in every single folder. Sanity check to make sure that doesn't happen. Seems to only happen to feeds added to the top-level root folder.
2011-03-09 20:09:32 -05:00
Samuel Clay
5703340a79
Fixing timeout error email subject.
2011-02-15 21:34:39 -05:00
Samuel Clay
bb4e81b278
Fixing a whole lot of feed fetch bugs.
2011-02-15 21:08:40 -05:00
Samuel Clay
19ce3180cd
Checking for dupes in the toplevel when adding subscriptions.
2011-02-14 01:26:58 -05:00
Samuel Clay
95abe1aac2
Allowing adding a url even if already subscribed. Just checks for dupes in the specific folder, but otherwise, dupes are allowed.
2011-02-14 01:15:45 -05:00
Samuel Clay
48afe91758
Refactoring how feeds are found using urls in the add modal. Also fixing a display issue around showing the river icon in a collapsed feed and showing the manage menu. Lastly, changing the feedfinder's user agent because some assclown website was disallowing on the string 'feedfinder'
2011-02-08 22:07:59 -05:00
Samuel Clay
4fd6a7cfe0
Fixing a metric-ton of bugs: Google Reader import on badly parsed xml, refreshing toplevel feeds loses their manage menu, retrying exception feeds now de-dupes and correctly updates on the page. Plus a bunch of other bugs.
2011-02-06 15:04:21 -05:00
Samuel Clay
ea15aa1175
Major improvement to feed fetching and parsing by upgrading feedparser to v5.0. Also sending correctly formatted feed information to debug email. And handling invalid page URLs gracefully.
2011-02-05 20:49:52 -05:00
Samuel Clay
72a32f1976
Using the correct message for the feed error email subject.
2011-02-05 16:16:11 -05:00
Samuel Clay
3723160155
A huge number of misc fixes: fixing potential errors on paypal return screen, mailing all feed/page parse errors, and swithcing to mapreduce item_frequencies in mongoengine.
2011-02-05 15:34:43 -05:00
Samuel Clay
22cf5ede6c
Crazy refactor of feedfinder to extract timelimits, so they can be caught by a lower-level api instead of messing up the feed fetcher.
2011-02-02 13:07:12 -05:00
Samuel Clay
a182bb1216
Finally saving proper base64 encoded favicons, along with their URLs, autodetecting when not found at /favicon.ico, and now all thats left is serving icons and their colors. Woohoo!
2011-01-27 19:05:50 -05:00
Samuel Clay
36a960b13b
Cleaning up request image function.
2011-01-26 23:41:20 -05:00
Samuel Clay
c74388e137
Woohoo! Got favicon downloading and parsing working. Still need to: a) handle transparency b) discard ugly colors (black, white) c) save the image d) pass the image/color e) render the image/color
2011-01-26 23:38:36 -05:00
Samuel Clay
1478d7371b
Merge branch 'river' into favicon
...
Conflicts:
utils/feed_functions.py
2011-01-26 22:02:23 -05:00
Samuel Clay
fa46f47639
Refactoring folder creation. This could be done a lot more abstractly as to make sense to new functions I build which include folder subscription creating. Let this be a reminder as to how shoddy code is born. And let this be quickly remedied.
2011-01-23 02:15:02 -05:00
Samuel Clay
a31717b7ca
Refactoring folder creation. This could be done a lot more abstractly as to make sense to new functions I build which include folder subscription creating. Let this be a reminder as to how shoddy code is born. And let this be quickly remedied.
2011-01-23 02:13:55 -05:00
Samuel Clay
443fe69156
Moving text fields from Feed to FeedData. Migration includes deletion of old fields on Feed, now unused.
2011-01-17 22:48:38 -05:00
Samuel Clay
fed9bc0924
Downloading, parsing, and shaping favicons into colors. Doesn't work for many images, though. Still need to parse the best non-black/white color.
2011-01-09 23:11:09 -05:00
Samuel Clay
4cf9b05f0c
Changing all datetime.datetime.now() to datetime.datetime.utcnow().
2010-10-10 23:55:00 -04:00
Samuel Clay
7dee2103a9
Refactoring timelimit to add feed address re-check to a limited timeout.
2010-09-27 11:44:23 -04:00
Samuel Clay
154ac4d3a9
Fixing delete feeds to only delete the one feed you want to delete, not all of the others. Also fixed add URL to check more aggressively for duplicate feeds.
2010-09-14 23:47:21 -04:00
Samuel Clay
2b8f4bff95
Normalizing logging across all views and models.
2010-08-17 17:45:51 -04:00
Samuel Clay
0bcc3ae484
Small fixes: removing height calculation from classifier modal, adding in better logging for feed address changes, iPhone story detail view bug.
2010-08-03 21:53:08 -04:00
Samuel Clay
a4c6b093c4
Don't normalize non-string urls.
2010-07-28 18:18:01 -04:00
Samuel Clay
7b7475ac70
Adding feed update stats to stats modal.
2010-07-28 01:14:25 -04:00
Samuel Clay
65e5b0dada
Rudimentary statistics modals. There's more data coming in, but I'm too excited to work on the collocation phrase filter to finish this out. It'll get done, but for now it's functional.
2010-07-26 22:21:58 -04:00
Samuel Clay
0f50f1349b
Adding a last updated date display to every feed.
2010-07-26 21:38:56 -04:00
Samuel Clay
2f86bbbb24
Fixing bad page URLs to use the feed fetcher to find the correct address.
2010-07-21 12:29:09 -04:00
Samuel Clay
bd0099ad81
Rewrote ingestion and acquiring of feeds. This needs some serious TLC soon.
2009-08-01 04:26:57 +00:00
Samuel Clay
5d185bae74
Optimizing and refactoring a ton of queries and calls. Really, I touched almost everything, from the feed ingestion system, to marking stories as read, to merging ReadStories and Opinions.
2009-07-28 02:27:27 +00:00
