Commit graph

1742 commits

Author SHA1 Message Date
Samuel Clay
5e2020f402 Fixing tests. 2016-04-22 20:48:08 -07:00
Samuel Clay
1243060820 Handling poorly structure dates that result in an overflow error. 2016-04-18 16:20:16 -07:00
Samuel Clay
594e677357 Fix somewhat long-standing error logging bug that spits out a ton of data on feeds that don't work with requests lib. 2016-03-18 18:30:01 -07:00
Samuel Clay
ac8920e98b Fixing feed finder to allow feeds with <html> tags, just not those right at the beginning. 2016-03-17 21:10:03 -07:00
Samuel Clay
f534b2bd2a Cleaning up disk usage monitor. 2016-03-16 12:20:16 -07:00
Samuel Clay
7264b6a91d No longer need psutil on monitor. 2016-03-16 11:42:18 -07:00
Samuel Clay
21e5da0ecf Moving to more accurate disk usage monitor. 2016-03-16 11:40:11 -07:00
Samuel Clay
f901f583a3 Sanity check for broken mtime. 2016-03-08 13:33:16 -08:00
Samuel Clay
586ff3f572 Fixing unicode issues in feed fetcher. Also fixing broken last-modified cache header. 2016-03-08 13:26:34 -08:00
Samuel Clay
744d8bb08e Feedfinder user agent is presenting problems. Changing to 'NewsBlur Feed Finder' 2016-02-18 11:50:38 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
4ed51e880a Handling bunk feeds better by forcing a sub recount and ignoring if not subscribed. 2016-02-09 16:34:59 -08:00
Samuel Clay
39b29bfd27 Splitting feed error codes. 2016-02-09 16:22:34 -08:00
Samuel Clay
f243f424ae Usage monitor needs correct virtualenv python. 2016-02-09 11:11:19 -08:00
Samuel Clay
3b3d76dcd2 Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken. 2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
307083fb98 Handling logging with virtualenv. 2016-02-04 21:07:28 -08:00
Samuel Clay
72e8d1265d -pdb 2016-02-04 17:52:19 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
d88ebec119 Handling missing page links. 2016-02-03 13:13:31 -08:00
Samuel Clay
92f36821a9 Typo in feed parser log entry. 2016-02-03 12:55:39 -08:00
Samuel Clay
7c4410226f Some feeds are really broken. 2016-02-03 12:54:34 -08:00
Samuel Clay
3134866414 Fixing address issue when updating page link. 2016-02-03 12:38:18 -08:00
Samuel Clay
0bf0bb02e2 Only remove cache busting query parameter when added. 2016-02-03 12:29:16 -08:00
Samuel Clay
4bda8ff0f0 Adding qurl library to better add and remove cache buster while maintain url query string order. 2016-02-03 12:18:35 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Samuel Clay
0f279cc534 Adding manage menu to dashboard. Moving around stats. 2016-02-03 10:26:45 -08:00
Samuel Clay
66aadc45a1 Adding soft time limit to celery tasks. 2016-02-01 23:06:04 -08:00
Samuel Clay
988bcd7aee Fixing redirect behavior by saving redirect history for 25 fetches when one 400+ error is found. 2016-01-13 12:42:39 -08:00
Samuel Clay
81bc426eeb Better handling youtube feed errors. 2016-01-07 20:04:29 -08:00
Samuel Clay
125e903040 Fixing tlnb logging viewer. 2015-12-22 19:45:50 -08:00
Samuel Clay
d845e151d0 Upgrading api/share_story to newer required_params api. 2015-12-22 19:28:31 -08:00
Samuel Clay
d2456c4fee Adding new task db profiling times to munin. 2015-12-16 17:34:43 -08:00
Samuel Clay
4a12c220fe Risky business: now capturing db times (sql/mongo/redis) for 1% of all tasks. Also updating munin to recognize new db profiling times. 2015-12-16 17:31:41 -08:00
Samuel Clay
24e4bae08d Merge pull request #839 from sv0/unicode_fixes
Unicode fixes
2015-12-10 13:43:47 -07:00
Samuel Clay
7cab8cc0e6 Using https as a scheme for all preview embeds. 2015-12-09 17:47:19 -08:00
Samuel Clay
9420924c1d Adding instagram, twitter, and imgur story embeds. 2015-12-09 15:11:32 -08:00
Slavik Svyrydiuk
48a493bf86 convert log messages to unicode with smart_unicode 2015-12-02 07:31:50 +01:00
Slavik Svyrydiuk
007da98f9d replaced 'unicode' with 'smart_unicode' in json_encode. added some PEP8 fixes. 2015-12-02 07:20:50 +01:00
Slavik Svyrydiuk
650b2aabb1 deprecated function 'utf8encode'. It's better to use django.utils.encoding.smart_unicode instead. 2015-12-02 06:49:05 +01:00
Slavik Svyrydiuk
753d5fc018 use django.utils.encoding.smart_unicode instead of utils.feed_functions.utf8encode 2015-12-02 06:46:18 +01:00
Samuel Clay
101e8477e0 Handling feeds that go missing. 2015-11-28 13:54:21 -08:00
Samuel Clay
f8775f8d54 Handling more errors when fetching feeds. 2015-11-28 13:48:20 -08:00
Samuel Clay
da5c895eea Noscript is causing issues (specifically http://seattle.curbed.com/atom.xml). 2015-10-23 16:29:35 -07:00
Samuel Clay
c72d0d4c06 Turning off annotations on Youtube videos by default. 2015-10-23 15:58:55 -07:00
Samuel Clay
0371bdffff Moving to latest digitalocean API. 2015-09-21 16:13:09 -07:00
Samuel Clay
16674eb8d0 Fixing favicon and feed title gradients in ios app. 2015-09-16 20:24:11 -07:00
Samuel Clay
2275a4ba6c Sanity check for years. 2015-09-02 15:26:55 -07:00
Samuel Clay
3d92dfd0ad Handling YouTube client errors gracefully. 2015-08-24 14:51:01 -07:00
Samuel Clay
b6e1e03bd5 Upgrading feedparser, cleaing up logging on feed fetch. 2015-08-24 14:27:01 -07:00