Samuel Clay
b5e0870fa8
Merge pull request #958 from da2x/patch-1
...
HTTP feed fetcher improvements
2016-11-25 13:02:44 -06:00
Samuel Clay
0f7c17eb9f
Fixing twitter error message.
2016-11-21 17:23:53 -08:00
Samuel Clay
6698967021
Handling twitter issues.
2016-11-21 13:15:50 -08:00
Samuel Clay
d9676d64e7
Fixing tweepy error handling.
2016-11-20 13:43:49 -08:00
Samuel Clay
b3aba908d7
Handling twitter fetch issues.
2016-11-18 10:54:46 -08:00
Samuel Clay
9ffa63ec2b
Max os 3 stories sent per notification group. Also limiting notifications to staff for live test.
2016-11-16 18:29:13 -08:00
Samuel Clay
8f6bfa1c55
Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser.
2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a
Adding in push notifications for web. Needs filtering.
2016-11-15 20:45:59 -08:00
Samuel Clay
982d1c9589
Handling twitter user not found error.
2016-11-11 15:12:13 -08:00
Samuel Clay
fde0c6caef
Higher random weight for quick fetch.
2016-11-09 09:00:30 -08:00
Daniel Aleksandersen
2f7bdd1672
HTTP feed fetcher improvements
...
* Send an Accept header asking for feed formats (instead of the current */*)
* Don’t send A-IM without an If-None-Match or If-Modified-Since header.
* Fixed Train-Case in one HTTP header.
2016-10-28 01:25:08 +02:00
Samuel Clay
a616ad50a5
Adding support for tweets that start with '@' to be categorized as a reply.
2016-09-22 15:54:39 -07:00
Julien Rottenberg
bf2e2258b8
Simplify onboarding
...
missed some from "Upgrading tweepy, hoping it fixes auth issues w/ twitter."
2016-09-15 20:24:34 -07:00
Samuel Clay
7ecf37b8c3
Temporarily locked = suspended on twitter.
2016-06-28 17:11:22 -07:00
Samuel Clay
a7ceebcb0f
Adding exception handling for twitter feeds.
2016-06-28 16:09:14 -07:00
Samuel Clay
76b48a5525
Fixing twitter status permalink.
2016-06-14 21:36:30 -07:00
Samuel Clay
0a86563321
Checking for links in tweet, adding link tag.
2016-05-26 15:52:41 -07:00
Samuel Clay
453f9d67eb
Handling insta-fetching twitter feeds.
2016-05-26 15:36:20 -07:00
Samuel Clay
bab64e0447
Disconnecting twitter connection if user has broken token.
2016-05-26 15:33:02 -07:00
Samuel Clay
c7420dc888
Retrying twitter fetch with any access token that works.
2016-05-26 15:21:12 -07:00
Samuel Clay
0b33889881
Adding retweet tag, changing likes and retweets to liked and retweeted.
2016-05-26 15:12:22 -07:00
Samuel Clay
2895fc398d
Adding photo category to tweets.
2016-05-26 15:09:24 -07:00
Samuel Clay
aa397194a1
Allowing twitter URL to not have https/http in it.
2016-05-26 15:06:52 -07:00
Samuel Clay
5db1138cdf
Tweets now have enclosed images.
2016-05-26 15:05:04 -07:00
Samuel Clay
7ad8dd89db
Better match for twitter.com/username
2016-05-26 14:41:44 -07:00
Samuel Clay
ac9f286dbe
Correcting twitter status link.
2016-05-26 14:34:47 -07:00
Samuel Clay
e3445bb134
Native Twitter support for converting the Twitter API to RSS. If you're reading this, you can test it by subscribing to twitter usernames like so: https://twitter.com/newsblur
2016-05-26 14:30:26 -07:00
Samuel Clay
8795c46204
Wrong feed_id
2016-05-20 16:15:18 -07:00
Samuel Clay
679e2ddfd3
Using get_by_id when refreshing feed.
2016-05-20 16:13:51 -07:00
Samuel Clay
c1d1534d67
Sanitizing text/plain stories.
2016-05-11 12:01:27 -07:00
Samuel Clay
594e677357
Fix somewhat long-standing error logging bug that spits out a ton of data on feeds that don't work with requests lib.
2016-03-18 18:30:01 -07:00
Samuel Clay
f901f583a3
Sanity check for broken mtime.
2016-03-08 13:33:16 -08:00
Samuel Clay
586ff3f572
Fixing unicode issues in feed fetcher. Also fixing broken last-modified cache header.
2016-03-08 13:26:34 -08:00
Samuel Clay
3c7717aff5
Updating newsletter icon.
2016-02-09 16:59:58 -08:00
Samuel Clay
39b29bfd27
Splitting feed error codes.
2016-02-09 16:22:34 -08:00
Samuel Clay
3b3d76dcd2
Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken.
2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae
Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared).
2016-02-05 14:43:31 -08:00
Samuel Clay
19902ec7bf
Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat.
2016-02-04 12:28:55 -08:00
Samuel Clay
d88ebec119
Handling missing page links.
2016-02-03 13:13:31 -08:00
Samuel Clay
92f36821a9
Typo in feed parser log entry.
2016-02-03 12:55:39 -08:00
Samuel Clay
7c4410226f
Some feeds are really broken.
2016-02-03 12:54:34 -08:00
Samuel Clay
3134866414
Fixing address issue when updating page link.
2016-02-03 12:38:18 -08:00
Samuel Clay
0bf0bb02e2
Only remove cache busting query parameter when added.
2016-02-03 12:29:16 -08:00
Samuel Clay
4bda8ff0f0
Adding qurl library to better add and remove cache buster while maintain url query string order.
2016-02-03 12:18:35 -08:00
Samuel Clay
ee2573ee75
Cleaning cache buster from feed and page urls.
2016-02-03 12:11:22 -08:00
Samuel Clay
66aadc45a1
Adding soft time limit to celery tasks.
2016-02-01 23:06:04 -08:00
Samuel Clay
988bcd7aee
Fixing redirect behavior by saving redirect history for 25 fetches when one 400+ error is found.
2016-01-13 12:42:39 -08:00
Samuel Clay
81bc426eeb
Better handling youtube feed errors.
2016-01-07 20:04:29 -08:00
Slavik Svyrydiuk
753d5fc018
use django.utils.encoding.smart_unicode instead of utils.feed_functions.utf8encode
2015-12-02 06:46:18 +01:00
Samuel Clay
101e8477e0
Handling feeds that go missing.
2015-11-28 13:54:21 -08:00