Commit graph

1133 commits

Author SHA1 Message Date
Samuel Clay
744d8bb08e Feedfinder user agent is presenting problems. Changing to 'NewsBlur Feed Finder' 2016-02-18 11:50:38 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
4ed51e880a Handling bunk feeds better by forcing a sub recount and ignoring if not subscribed. 2016-02-09 16:34:59 -08:00
Samuel Clay
39b29bfd27 Splitting feed error codes. 2016-02-09 16:22:34 -08:00
Samuel Clay
f243f424ae Usage monitor needs correct virtualenv python. 2016-02-09 11:11:19 -08:00
Samuel Clay
3b3d76dcd2 Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken. 2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
307083fb98 Handling logging with virtualenv. 2016-02-04 21:07:28 -08:00
Samuel Clay
72e8d1265d -pdb 2016-02-04 17:52:19 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
d88ebec119 Handling missing page links. 2016-02-03 13:13:31 -08:00
Samuel Clay
92f36821a9 Typo in feed parser log entry. 2016-02-03 12:55:39 -08:00
Samuel Clay
7c4410226f Some feeds are really broken. 2016-02-03 12:54:34 -08:00
Samuel Clay
3134866414 Fixing address issue when updating page link. 2016-02-03 12:38:18 -08:00
Samuel Clay
0bf0bb02e2 Only remove cache busting query parameter when added. 2016-02-03 12:29:16 -08:00
Samuel Clay
4bda8ff0f0 Adding qurl library to better add and remove cache buster while maintain url query string order. 2016-02-03 12:18:35 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Samuel Clay
0f279cc534 Adding manage menu to dashboard. Moving around stats. 2016-02-03 10:26:45 -08:00
Samuel Clay
66aadc45a1 Adding soft time limit to celery tasks. 2016-02-01 23:06:04 -08:00
Samuel Clay
988bcd7aee Fixing redirect behavior by saving redirect history for 25 fetches when one 400+ error is found. 2016-01-13 12:42:39 -08:00
Samuel Clay
81bc426eeb Better handling youtube feed errors. 2016-01-07 20:04:29 -08:00
Samuel Clay
125e903040 Fixing tlnb logging viewer. 2015-12-22 19:45:50 -08:00
Samuel Clay
d845e151d0 Upgrading api/share_story to newer required_params api. 2015-12-22 19:28:31 -08:00
Samuel Clay
d2456c4fee Adding new task db profiling times to munin. 2015-12-16 17:34:43 -08:00
Samuel Clay
4a12c220fe Risky business: now capturing db times (sql/mongo/redis) for 1% of all tasks. Also updating munin to recognize new db profiling times. 2015-12-16 17:31:41 -08:00
Samuel Clay
24e4bae08d Merge pull request #839 from sv0/unicode_fixes
Unicode fixes
2015-12-10 13:43:47 -07:00
Samuel Clay
7cab8cc0e6 Using https as a scheme for all preview embeds. 2015-12-09 17:47:19 -08:00
Samuel Clay
9420924c1d Adding instagram, twitter, and imgur story embeds. 2015-12-09 15:11:32 -08:00
Slavik Svyrydiuk
48a493bf86 convert log messages to unicode with smart_unicode 2015-12-02 07:31:50 +01:00
Slavik Svyrydiuk
007da98f9d replaced 'unicode' with 'smart_unicode' in json_encode. added some PEP8 fixes. 2015-12-02 07:20:50 +01:00
Slavik Svyrydiuk
650b2aabb1 deprecated function 'utf8encode'. It's better to use django.utils.encoding.smart_unicode instead. 2015-12-02 06:49:05 +01:00
Slavik Svyrydiuk
753d5fc018 use django.utils.encoding.smart_unicode instead of utils.feed_functions.utf8encode 2015-12-02 06:46:18 +01:00
Samuel Clay
101e8477e0 Handling feeds that go missing. 2015-11-28 13:54:21 -08:00
Samuel Clay
f8775f8d54 Handling more errors when fetching feeds. 2015-11-28 13:48:20 -08:00
Samuel Clay
da5c895eea Noscript is causing issues (specifically http://seattle.curbed.com/atom.xml). 2015-10-23 16:29:35 -07:00
Samuel Clay
c72d0d4c06 Turning off annotations on Youtube videos by default. 2015-10-23 15:58:55 -07:00
Samuel Clay
0371bdffff Moving to latest digitalocean API. 2015-09-21 16:13:09 -07:00
Samuel Clay
16674eb8d0 Fixing favicon and feed title gradients in ios app. 2015-09-16 20:24:11 -07:00
Samuel Clay
2275a4ba6c Sanity check for years. 2015-09-02 15:26:55 -07:00
Samuel Clay
3d92dfd0ad Handling YouTube client errors gracefully. 2015-08-24 14:51:01 -07:00
Samuel Clay
b6e1e03bd5 Upgrading feedparser, cleaing up logging on feed fetch. 2015-08-24 14:27:01 -07:00
Samuel Clay
508864b4cc Adding roles to zgrep util. 2015-08-21 13:12:12 -07:00
Samuel Clay
0ea8da6ce6 Adding log tail to redis bgsave monitor. 2015-08-18 09:00:40 -07:00
Samuel Clay
7e679cdf7a a+x on redis bgsave monitor. 2015-08-18 08:52:37 -07:00
Samuel Clay
80cd1e5a3b Adding redis bgsave monitor. 2015-08-18 08:51:49 -07:00
Samuel Clay
a774cddcb3 Fixing broken sub counts when reids sub count expires. 2015-08-05 13:59:26 -07:00
Samuel Clay
6a20478a7f Renaming redis feed pool to redis feed update pool in prep for redis feed sub pool. 2015-07-27 18:35:25 -07:00
Samuel Clay
9cd8124419 Combing through all updates to feeds table when fetching feed. 2015-07-22 13:53:20 -07:00
Samuel Clay
da26ecdb46 1/2 Cleaning up feed fetcher's updates to feeds table. Still need to find 6 dupes. 2015-07-22 13:18:54 -07:00
Samuel Clay
34d008d600 Adding color to postgres slowlogs. Making login a bit less heavy on the db. And fixing feed count munin. 2015-07-21 15:53:37 -07:00