Commit graph

468 commits

Author SHA1 Message Date
Samuel Clay
6698967021 Handling twitter issues. 2016-11-21 13:15:50 -08:00
Samuel Clay
d9676d64e7 Fixing tweepy error handling. 2016-11-20 13:43:49 -08:00
Samuel Clay
b3aba908d7 Handling twitter fetch issues. 2016-11-18 10:54:46 -08:00
Samuel Clay
9ffa63ec2b Max os 3 stories sent per notification group. Also limiting notifications to staff for live test. 2016-11-16 18:29:13 -08:00
Samuel Clay
8f6bfa1c55 Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser. 2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a Adding in push notifications for web. Needs filtering. 2016-11-15 20:45:59 -08:00
Samuel Clay
982d1c9589 Handling twitter user not found error. 2016-11-11 15:12:13 -08:00
Samuel Clay
fde0c6caef Higher random weight for quick fetch. 2016-11-09 09:00:30 -08:00
Samuel Clay
a616ad50a5 Adding support for tweets that start with '@' to be categorized as a reply. 2016-09-22 15:54:39 -07:00
Julien Rottenberg
bf2e2258b8 Simplify onboarding
missed some from "Upgrading tweepy, hoping it fixes auth issues w/ twitter."
2016-09-15 20:24:34 -07:00
Samuel Clay
7ecf37b8c3 Temporarily locked = suspended on twitter. 2016-06-28 17:11:22 -07:00
Samuel Clay
a7ceebcb0f Adding exception handling for twitter feeds. 2016-06-28 16:09:14 -07:00
Samuel Clay
76b48a5525 Fixing twitter status permalink. 2016-06-14 21:36:30 -07:00
Samuel Clay
0a86563321 Checking for links in tweet, adding link tag. 2016-05-26 15:52:41 -07:00
Samuel Clay
453f9d67eb Handling insta-fetching twitter feeds. 2016-05-26 15:36:20 -07:00
Samuel Clay
bab64e0447 Disconnecting twitter connection if user has broken token. 2016-05-26 15:33:02 -07:00
Samuel Clay
c7420dc888 Retrying twitter fetch with any access token that works. 2016-05-26 15:21:12 -07:00
Samuel Clay
0b33889881 Adding retweet tag, changing likes and retweets to liked and retweeted. 2016-05-26 15:12:22 -07:00
Samuel Clay
2895fc398d Adding photo category to tweets. 2016-05-26 15:09:24 -07:00
Samuel Clay
aa397194a1 Allowing twitter URL to not have https/http in it. 2016-05-26 15:06:52 -07:00
Samuel Clay
5db1138cdf Tweets now have enclosed images. 2016-05-26 15:05:04 -07:00
Samuel Clay
7ad8dd89db Better match for twitter.com/username 2016-05-26 14:41:44 -07:00
Samuel Clay
ac9f286dbe Correcting twitter status link. 2016-05-26 14:34:47 -07:00
Samuel Clay
e3445bb134 Native Twitter support for converting the Twitter API to RSS. If you're reading this, you can test it by subscribing to twitter usernames like so: https://twitter.com/newsblur 2016-05-26 14:30:26 -07:00
Samuel Clay
8795c46204 Wrong feed_id 2016-05-20 16:15:18 -07:00
Samuel Clay
679e2ddfd3 Using get_by_id when refreshing feed. 2016-05-20 16:13:51 -07:00
Samuel Clay
c1d1534d67 Sanitizing text/plain stories. 2016-05-11 12:01:27 -07:00
Samuel Clay
594e677357 Fix somewhat long-standing error logging bug that spits out a ton of data on feeds that don't work with requests lib. 2016-03-18 18:30:01 -07:00
Samuel Clay
f901f583a3 Sanity check for broken mtime. 2016-03-08 13:33:16 -08:00
Samuel Clay
586ff3f572 Fixing unicode issues in feed fetcher. Also fixing broken last-modified cache header. 2016-03-08 13:26:34 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
39b29bfd27 Splitting feed error codes. 2016-02-09 16:22:34 -08:00
Samuel Clay
3b3d76dcd2 Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken. 2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
d88ebec119 Handling missing page links. 2016-02-03 13:13:31 -08:00
Samuel Clay
92f36821a9 Typo in feed parser log entry. 2016-02-03 12:55:39 -08:00
Samuel Clay
7c4410226f Some feeds are really broken. 2016-02-03 12:54:34 -08:00
Samuel Clay
3134866414 Fixing address issue when updating page link. 2016-02-03 12:38:18 -08:00
Samuel Clay
0bf0bb02e2 Only remove cache busting query parameter when added. 2016-02-03 12:29:16 -08:00
Samuel Clay
4bda8ff0f0 Adding qurl library to better add and remove cache buster while maintain url query string order. 2016-02-03 12:18:35 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Samuel Clay
66aadc45a1 Adding soft time limit to celery tasks. 2016-02-01 23:06:04 -08:00
Samuel Clay
988bcd7aee Fixing redirect behavior by saving redirect history for 25 fetches when one 400+ error is found. 2016-01-13 12:42:39 -08:00
Samuel Clay
81bc426eeb Better handling youtube feed errors. 2016-01-07 20:04:29 -08:00
Slavik Svyrydiuk
753d5fc018 use django.utils.encoding.smart_unicode instead of utils.feed_functions.utf8encode 2015-12-02 06:46:18 +01:00
Samuel Clay
101e8477e0 Handling feeds that go missing. 2015-11-28 13:54:21 -08:00
Samuel Clay
f8775f8d54 Handling more errors when fetching feeds. 2015-11-28 13:48:20 -08:00
Samuel Clay
c72d0d4c06 Turning off annotations on Youtube videos by default. 2015-10-23 15:58:55 -07:00
Samuel Clay
3d92dfd0ad Handling YouTube client errors gracefully. 2015-08-24 14:51:01 -07:00