Samuel Clay
d84e2af636
New experimental data collector for debugging feeds over time.
2017-04-12 19:13:33 -07:00
Samuel Clay
557438008b
Fixing a couple Twitter and YouTube fetch issues.
2017-04-12 11:19:42 -07:00
Samuel Clay
461c1c4b65
Changing feed log format to include id at the beginning. Also normalizing all feed titles in logs for better searchability.
2017-03-31 19:52:24 -07:00
Samuel Clay
937a67f67c
Only using active twitter accounts.
2017-03-24 13:04:38 -07:00
Samuel Clay
4f8a1c43b3
Fixing attribution in twitter RTs.
2017-03-15 19:40:43 -07:00
Samuel Clay
a6fdf45d33
Adding support for native RTs in Twitter.
2017-03-15 19:26:39 -07:00
Samuel Clay
937a1fa999
Faking user agent when rss bans NewsBlur.
2017-02-17 12:19:55 -08:00
Samuel Clay
255b30f3c1
Better recording of non-200/300 status codes on feed fetch.
2017-02-17 12:05:27 -08:00
Samuel Clay
2954ef7318
Adding new debug to feed fetcher.
2017-02-17 11:45:43 -08:00
Samuel Clay
c5d5ea5001
Attempting to fix dashboard stories by no longer relying on full river reloads when a new story comes in but to fetch that story if it is newer (or older) than last visible dashboard story.
2016-12-13 16:29:42 -08:00
Samuel Clay
046f97558b
Checking for memory errors while feed fetching.
2016-12-11 18:59:02 -08:00
Samuel Clay
d1e2e3e1d9
Handling MemoryError while feed fetching.
2016-12-11 18:29:00 -08:00
Samuel Clay
b5e0870fa8
Merge pull request #958 from da2x/patch-1
...
HTTP feed fetcher improvements
2016-11-25 13:02:44 -06:00
Samuel Clay
0f7c17eb9f
Fixing twitter error message.
2016-11-21 17:23:53 -08:00
Samuel Clay
6698967021
Handling twitter issues.
2016-11-21 13:15:50 -08:00
Samuel Clay
d9676d64e7
Fixing tweepy error handling.
2016-11-20 13:43:49 -08:00
Samuel Clay
b3aba908d7
Handling twitter fetch issues.
2016-11-18 10:54:46 -08:00
Samuel Clay
9ffa63ec2b
Max os 3 stories sent per notification group. Also limiting notifications to staff for live test.
2016-11-16 18:29:13 -08:00
Samuel Clay
8f6bfa1c55
Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser.
2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a
Adding in push notifications for web. Needs filtering.
2016-11-15 20:45:59 -08:00
Samuel Clay
982d1c9589
Handling twitter user not found error.
2016-11-11 15:12:13 -08:00
Samuel Clay
fde0c6caef
Higher random weight for quick fetch.
2016-11-09 09:00:30 -08:00
Daniel Aleksandersen
2f7bdd1672
HTTP feed fetcher improvements
...
* Send an Accept header asking for feed formats (instead of the current */*)
* Don’t send A-IM without an If-None-Match or If-Modified-Since header.
* Fixed Train-Case in one HTTP header.
2016-10-28 01:25:08 +02:00
Samuel Clay
a616ad50a5
Adding support for tweets that start with '@' to be categorized as a reply.
2016-09-22 15:54:39 -07:00
Julien Rottenberg
bf2e2258b8
Simplify onboarding
...
missed some from "Upgrading tweepy, hoping it fixes auth issues w/ twitter."
2016-09-15 20:24:34 -07:00
Samuel Clay
7ecf37b8c3
Temporarily locked = suspended on twitter.
2016-06-28 17:11:22 -07:00
Samuel Clay
a7ceebcb0f
Adding exception handling for twitter feeds.
2016-06-28 16:09:14 -07:00
Samuel Clay
76b48a5525
Fixing twitter status permalink.
2016-06-14 21:36:30 -07:00
Samuel Clay
0a86563321
Checking for links in tweet, adding link tag.
2016-05-26 15:52:41 -07:00
Samuel Clay
453f9d67eb
Handling insta-fetching twitter feeds.
2016-05-26 15:36:20 -07:00
Samuel Clay
bab64e0447
Disconnecting twitter connection if user has broken token.
2016-05-26 15:33:02 -07:00
Samuel Clay
c7420dc888
Retrying twitter fetch with any access token that works.
2016-05-26 15:21:12 -07:00
Samuel Clay
0b33889881
Adding retweet tag, changing likes and retweets to liked and retweeted.
2016-05-26 15:12:22 -07:00
Samuel Clay
2895fc398d
Adding photo category to tweets.
2016-05-26 15:09:24 -07:00
Samuel Clay
aa397194a1
Allowing twitter URL to not have https/http in it.
2016-05-26 15:06:52 -07:00
Samuel Clay
5db1138cdf
Tweets now have enclosed images.
2016-05-26 15:05:04 -07:00
Samuel Clay
7ad8dd89db
Better match for twitter.com/username
2016-05-26 14:41:44 -07:00
Samuel Clay
ac9f286dbe
Correcting twitter status link.
2016-05-26 14:34:47 -07:00
Samuel Clay
e3445bb134
Native Twitter support for converting the Twitter API to RSS. If you're reading this, you can test it by subscribing to twitter usernames like so: https://twitter.com/newsblur
2016-05-26 14:30:26 -07:00
Samuel Clay
8795c46204
Wrong feed_id
2016-05-20 16:15:18 -07:00
Samuel Clay
679e2ddfd3
Using get_by_id when refreshing feed.
2016-05-20 16:13:51 -07:00
Samuel Clay
c1d1534d67
Sanitizing text/plain stories.
2016-05-11 12:01:27 -07:00
Samuel Clay
594e677357
Fix somewhat long-standing error logging bug that spits out a ton of data on feeds that don't work with requests lib.
2016-03-18 18:30:01 -07:00
Samuel Clay
f901f583a3
Sanity check for broken mtime.
2016-03-08 13:33:16 -08:00
Samuel Clay
586ff3f572
Fixing unicode issues in feed fetcher. Also fixing broken last-modified cache header.
2016-03-08 13:26:34 -08:00
Samuel Clay
3c7717aff5
Updating newsletter icon.
2016-02-09 16:59:58 -08:00
Samuel Clay
39b29bfd27
Splitting feed error codes.
2016-02-09 16:22:34 -08:00
Samuel Clay
3b3d76dcd2
Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken.
2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae
Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared).
2016-02-05 14:43:31 -08:00
Samuel Clay
19902ec7bf
Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat.
2016-02-04 12:28:55 -08:00
