Commit graph

481 commits

Author SHA1 Message Date
Samuel Clay
461c1c4b65 Changing feed log format to include id at the beginning. Also normalizing all feed titles in logs for better searchability. 2017-03-31 19:52:24 -07:00
Samuel Clay
937a67f67c Only using active twitter accounts. 2017-03-24 13:04:38 -07:00
Samuel Clay
4f8a1c43b3 Fixing attribution in twitter RTs. 2017-03-15 19:40:43 -07:00
Samuel Clay
a6fdf45d33 Adding support for native RTs in Twitter. 2017-03-15 19:26:39 -07:00
Samuel Clay
937a1fa999 Faking user agent when rss bans NewsBlur. 2017-02-17 12:19:55 -08:00
Samuel Clay
255b30f3c1 Better recording of non-200/300 status codes on feed fetch. 2017-02-17 12:05:27 -08:00
Samuel Clay
2954ef7318 Adding new debug to feed fetcher. 2017-02-17 11:45:43 -08:00
Samuel Clay
c5d5ea5001 Attempting to fix dashboard stories by no longer relying on full river reloads when a new story comes in but to fetch that story if it is newer (or older) than last visible dashboard story. 2016-12-13 16:29:42 -08:00
Samuel Clay
046f97558b Checking for memory errors while feed fetching. 2016-12-11 18:59:02 -08:00
Samuel Clay
d1e2e3e1d9 Handling MemoryError while feed fetching. 2016-12-11 18:29:00 -08:00
Samuel Clay
b5e0870fa8 Merge pull request #958 from da2x/patch-1
HTTP feed fetcher improvements
2016-11-25 13:02:44 -06:00
Samuel Clay
0f7c17eb9f Fixing twitter error message. 2016-11-21 17:23:53 -08:00
Samuel Clay
6698967021 Handling twitter issues. 2016-11-21 13:15:50 -08:00
Samuel Clay
d9676d64e7 Fixing tweepy error handling. 2016-11-20 13:43:49 -08:00
Samuel Clay
b3aba908d7 Handling twitter fetch issues. 2016-11-18 10:54:46 -08:00
Samuel Clay
9ffa63ec2b Max os 3 stories sent per notification group. Also limiting notifications to staff for live test. 2016-11-16 18:29:13 -08:00
Samuel Clay
8f6bfa1c55 Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser. 2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a Adding in push notifications for web. Needs filtering. 2016-11-15 20:45:59 -08:00
Samuel Clay
982d1c9589 Handling twitter user not found error. 2016-11-11 15:12:13 -08:00
Samuel Clay
fde0c6caef Higher random weight for quick fetch. 2016-11-09 09:00:30 -08:00
Daniel Aleksandersen
2f7bdd1672 HTTP feed fetcher improvements
* Send an Accept header asking for feed formats (instead of the current */*)

* Don’t send A-IM without an If-None-Match or If-Modified-Since header.

* Fixed Train-Case in one HTTP header.
2016-10-28 01:25:08 +02:00
Samuel Clay
a616ad50a5 Adding support for tweets that start with '@' to be categorized as a reply. 2016-09-22 15:54:39 -07:00
Julien Rottenberg
bf2e2258b8 Simplify onboarding
missed some from "Upgrading tweepy, hoping it fixes auth issues w/ twitter."
2016-09-15 20:24:34 -07:00
Samuel Clay
7ecf37b8c3 Temporarily locked = suspended on twitter. 2016-06-28 17:11:22 -07:00
Samuel Clay
a7ceebcb0f Adding exception handling for twitter feeds. 2016-06-28 16:09:14 -07:00
Samuel Clay
76b48a5525 Fixing twitter status permalink. 2016-06-14 21:36:30 -07:00
Samuel Clay
0a86563321 Checking for links in tweet, adding link tag. 2016-05-26 15:52:41 -07:00
Samuel Clay
453f9d67eb Handling insta-fetching twitter feeds. 2016-05-26 15:36:20 -07:00
Samuel Clay
bab64e0447 Disconnecting twitter connection if user has broken token. 2016-05-26 15:33:02 -07:00
Samuel Clay
c7420dc888 Retrying twitter fetch with any access token that works. 2016-05-26 15:21:12 -07:00
Samuel Clay
0b33889881 Adding retweet tag, changing likes and retweets to liked and retweeted. 2016-05-26 15:12:22 -07:00
Samuel Clay
2895fc398d Adding photo category to tweets. 2016-05-26 15:09:24 -07:00
Samuel Clay
aa397194a1 Allowing twitter URL to not have https/http in it. 2016-05-26 15:06:52 -07:00
Samuel Clay
5db1138cdf Tweets now have enclosed images. 2016-05-26 15:05:04 -07:00
Samuel Clay
7ad8dd89db Better match for twitter.com/username 2016-05-26 14:41:44 -07:00
Samuel Clay
ac9f286dbe Correcting twitter status link. 2016-05-26 14:34:47 -07:00
Samuel Clay
e3445bb134 Native Twitter support for converting the Twitter API to RSS. If you're reading this, you can test it by subscribing to twitter usernames like so: https://twitter.com/newsblur 2016-05-26 14:30:26 -07:00
Samuel Clay
8795c46204 Wrong feed_id 2016-05-20 16:15:18 -07:00
Samuel Clay
679e2ddfd3 Using get_by_id when refreshing feed. 2016-05-20 16:13:51 -07:00
Samuel Clay
c1d1534d67 Sanitizing text/plain stories. 2016-05-11 12:01:27 -07:00
Samuel Clay
594e677357 Fix somewhat long-standing error logging bug that spits out a ton of data on feeds that don't work with requests lib. 2016-03-18 18:30:01 -07:00
Samuel Clay
f901f583a3 Sanity check for broken mtime. 2016-03-08 13:33:16 -08:00
Samuel Clay
586ff3f572 Fixing unicode issues in feed fetcher. Also fixing broken last-modified cache header. 2016-03-08 13:26:34 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
39b29bfd27 Splitting feed error codes. 2016-02-09 16:22:34 -08:00
Samuel Clay
3b3d76dcd2 Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken. 2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
d88ebec119 Handling missing page links. 2016-02-03 13:13:31 -08:00
Samuel Clay
92f36821a9 Typo in feed parser log entry. 2016-02-03 12:55:39 -08:00