Commit graph

65 commits

Author SHA1 Message Date
Samuel Clay
c7f4cbb13d Fixing a substantial number of encoding errors. Also fixing OPML uploads. 2021-01-24 21:05:22 -05:00
Samuel Clay
82fecb23a6 Merge branch 'docker_django3.1' into dashboard3
* docker_django3.1: (117 commits)
  Adding docker to node scripts.
  Removing node_modules from repo
  Whoops
  Better logging for broken paypal ipns.
  Adding RSS Tracker for Windows to Goodies.
  Refactoring socketio so real-time works around username restrictions.
  Socket.IO v3 on the server too.
  Switching to Socket.IO v3.
  Haproxy splitting for socketio 3
  Socket.io 3
  Handling missing feed.
  Only nb.local.com uses ports for websockets.
  Adding GrazeTEN
  Full node install on setup.
  Updating toprc
  correct newsblur to newsblur_web in tasks
  Changing mongodb server.
  Fixing toprc
  Attempting to collect queries for 1% of requests by using DEBUG.
  Fixing mongo install.
  ...
2021-01-05 19:36:49 -05:00
Samuel Clay
1fecc9aca3 Fixing global shared stories on dashboard. 2020-12-14 15:08:14 -05:00
Jonathan Math
6bd4ecb569 change smart_text to smart_str to get rid of deprecation warning 2020-11-06 14:46:40 +07:00
jmath1
2d62e80344 change smart_unicode to smart_text in utils/feedfunctions.py 2020-06-13 13:16:50 -04:00
jmath1
66b2011707 2to3 NewsBlur/utils/ 2020-06-13 13:13:20 -04:00
Samuel Clay
bb089f4aeb When adding a feed to a folder, check against the lower case folder name to correct for dupes. 2016-11-14 12:31:41 -08:00
Samuel Clay
4bda8ff0f0 Adding qurl library to better add and remove cache buster while maintain url query string order. 2016-02-03 12:18:35 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Slavik Svyrydiuk
650b2aabb1 deprecated function 'utf8encode'. It's better to use django.utils.encoding.smart_unicode instead. 2015-12-02 06:49:05 +01:00
Samuel Clay
79b3872e1e Fixing URL munging when the url includes a non key=value pair in the query string. Ex: https://cns.utoronto.ca/~cks/space/blog/?atom. Thanks to @firesock for finding this. 2014-10-03 16:47:43 -07:00
Samuel Clay
8aa50201eb Fixing add new subscription action to use correct folders. 2014-02-10 12:55:56 -08:00
Samuel Clay
b2f93cb75b Chunking story hash pipeline to let others in. 2013-06-28 19:09:34 -07:00
Samuel Clay
67b82a3a60 Converting lua script to multi/exec block. 2013-06-27 15:21:13 -07:00
Samuel Clay
42b85d485a Merge branch 'schedule' into schedule_dev
* schedule:
  Adding metric for last story date, used to calculate next scheduled update.
2013-04-23 17:04:27 -07:00
Samuel Clay
1584208677 Adding metric for last story date, used to calculate next scheduled update. 2013-04-23 17:04:21 -07:00
Samuel Clay
9aafd8eab2 Adding delaying to reader import. Adding reader starred story import. 2013-04-02 15:41:50 -07:00
Samuel Clay
79200d7bc1 Adding RStats, necessary to remove mongodb analytics. 2013-03-25 11:10:41 -07:00
Samuel Clay
9e2fa3115d Cache busting feeds on force and 1% of the time. 2013-03-24 15:50:57 -07:00
Samuel Clay
aefd8de78c Backporting collections.Counter to python2.6 2013-01-03 18:15:00 -08:00
Samuel Clay
61aac7fc06 Merge branch 'master' into dynamodb
* master: (331 commits)
  Adding blurblog permalink to story on blurblog. Adding story slug to permalink. Fixing story guid hashes.
  Re-enabling message property for facebook.
  Ignoring image for facebook shares.
  Commenting out facebook share message until they approve it.
  Cleaning up Facebook og description.
  Facebook using a website instead of article.
  Facebook being a PITA.
  Facebook wants ISO8601 datetime format.
  Facebook doesn't like going to other URLs.
  Facebook doesn't like going to other URLs.
  Dumb typo in new facebook og crap.
  Using blurblog permalink for new facebook shares.
  Fixing Facebook share to use fancy actions.
  Adding scroll to comments button to share bar. Thanks @afita.
  Turning off microformats for more errors.
  Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds.
  Cleaning redis stories for 1% of all feed fetches.
  Refreshing feed on fetch.
  Fiddling with logging on dupe feeds.
  Adding bs facebook assets.
  ...

Conflicts:
	apps/rss_feeds/models.py
	settings.py
	utils/feed_fetcher.py
2012-11-27 16:39:39 -08:00
Samuel Clay
04d61ceff4 Fixing errors in timeouts to show the correct error. Also fixing microformats parsing issue and allow IPv6 URLs in enclosures to be ignored, fixing a bunch of feeds. 2012-11-26 11:41:31 -08:00
Samuel Clay
0a03154473 First half of DynamoDB trial, converting stories from mongo to dynamodb. Still needs to be updated/inserted on feed update, and then processed with all MStory uses. 2012-09-04 12:01:55 -07:00
Samuel Clay
32ba51a775 Fixing folder merge so category additions can be idempotent. Also fixing social connect size for iPhone. 2012-08-12 18:57:29 -07:00
Samuel Clay
d3b58e7cc9 Deferring OPML import if it takes > 20 seconds. Email user when complete. Also, hamburgers. This one's for @torrez. 2012-07-20 19:43:28 -07:00
Samuel Clay
0468fe12dc Finished styling comments. Showing all sharers now. 2012-01-15 20:51:48 -08:00
Samuel Clay
c0fa6b263e Adding share keys and comment keys to redis, in order to distinguish between the two. 2012-01-13 09:20:37 -08:00
Samuel Clay
288d6c8e49 The @kennethreitz commit: logging all discrepencies between requests and urllib2. This should take a few hours. 2012-01-05 20:59:48 -08:00
Samuel Clay
6637c05adf Adding a little bit more leeway in page importer by falling back to urllib2 when requests fail. 2011-12-20 22:30:55 -08:00
Samuel Clay
646df377bf Fixing emergency UTF-8 encoding bug. Russians rejoice\! 2011-12-02 11:37:55 -08:00
Samuel Clay
8f5a4c612d Updating rss_feeds tests for completeness. Updating README to include how to run test suite. 2011-09-01 09:11:29 -07:00
Samuel Clay
442012fdeb Ading pull to refresh on feed detail in iphone app. Not done, but also added extra parameter in feed canonical model that gives seconds since last update. 2011-08-18 09:56:52 -07:00
Samuel Clay
b87a5de6ce Lots of work towards the eventual release of recommended feeds. Now can try feeds (maybe taste would've been a better name?). 2011-03-15 23:42:27 -04:00
Samuel Clay
7c136f7ea1 Fixing an issue around adding feeds and having them show up in every single folder. Sanity check to make sure that doesn't happen. Seems to only happen to feeds added to the top-level root folder. 2011-03-09 20:09:32 -05:00
Samuel Clay
5703340a79 Fixing timeout error email subject. 2011-02-15 21:34:39 -05:00
Samuel Clay
bb4e81b278 Fixing a whole lot of feed fetch bugs. 2011-02-15 21:08:40 -05:00
Samuel Clay
19ce3180cd Checking for dupes in the toplevel when adding subscriptions. 2011-02-14 01:26:58 -05:00
Samuel Clay
95abe1aac2 Allowing adding a url even if already subscribed. Just checks for dupes in the specific folder, but otherwise, dupes are allowed. 2011-02-14 01:15:45 -05:00
Samuel Clay
48afe91758 Refactoring how feeds are found using urls in the add modal. Also fixing a display issue around showing the river icon in a collapsed feed and showing the manage menu. Lastly, changing the feedfinder's user agent because some assclown website was disallowing on the string 'feedfinder' 2011-02-08 22:07:59 -05:00
Samuel Clay
4fd6a7cfe0 Fixing a metric-ton of bugs: Google Reader import on badly parsed xml, refreshing toplevel feeds loses their manage menu, retrying exception feeds now de-dupes and correctly updates on the page. Plus a bunch of other bugs. 2011-02-06 15:04:21 -05:00
Samuel Clay
ea15aa1175 Major improvement to feed fetching and parsing by upgrading feedparser to v5.0. Also sending correctly formatted feed information to debug email. And handling invalid page URLs gracefully. 2011-02-05 20:49:52 -05:00
Samuel Clay
72a32f1976 Using the correct message for the feed error email subject. 2011-02-05 16:16:11 -05:00
Samuel Clay
3723160155 A huge number of misc fixes: fixing potential errors on paypal return screen, mailing all feed/page parse errors, and swithcing to mapreduce item_frequencies in mongoengine. 2011-02-05 15:34:43 -05:00
Samuel Clay
22cf5ede6c Crazy refactor of feedfinder to extract timelimits, so they can be caught by a lower-level api instead of messing up the feed fetcher. 2011-02-02 13:07:12 -05:00
Samuel Clay
a182bb1216 Finally saving proper base64 encoded favicons, along with their URLs, autodetecting when not found at /favicon.ico, and now all thats left is serving icons and their colors. Woohoo! 2011-01-27 19:05:50 -05:00
Samuel Clay
36a960b13b Cleaning up request image function. 2011-01-26 23:41:20 -05:00
Samuel Clay
c74388e137 Woohoo! Got favicon downloading and parsing working. Still need to: a) handle transparency b) discard ugly colors (black, white) c) save the image d) pass the image/color e) render the image/color 2011-01-26 23:38:36 -05:00
Samuel Clay
1478d7371b Merge branch 'river' into favicon
Conflicts:
	utils/feed_functions.py
2011-01-26 22:02:23 -05:00
Samuel Clay
fa46f47639 Refactoring folder creation. This could be done a lot more abstractly as to make sense to new functions I build which include folder subscription creating. Let this be a reminder as to how shoddy code is born. And let this be quickly remedied. 2011-01-23 02:15:02 -05:00
Samuel Clay
a31717b7ca Refactoring folder creation. This could be done a lot more abstractly as to make sense to new functions I build which include folder subscription creating. Let this be a reminder as to how shoddy code is born. And let this be quickly remedied. 2011-01-23 02:13:55 -05:00