Commit graph

515 commits

Author SHA1 Message Date
Samuel Clay
8f6bfa1c55 Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser. 2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a Adding in push notifications for web. Needs filtering. 2016-11-15 20:45:59 -08:00
Samuel Clay
982d1c9589 Handling twitter user not found error. 2016-11-11 15:12:13 -08:00
Samuel Clay
fde0c6caef Higher random weight for quick fetch. 2016-11-09 09:00:30 -08:00
Daniel Aleksandersen
2f7bdd1672 HTTP feed fetcher improvements
* Send an Accept header asking for feed formats (instead of the current */*)

* Don’t send A-IM without an If-None-Match or If-Modified-Since header.

* Fixed Train-Case in one HTTP header.
2016-10-28 01:25:08 +02:00
Samuel Clay
a616ad50a5 Adding support for tweets that start with '@' to be categorized as a reply. 2016-09-22 15:54:39 -07:00
Julien Rottenberg
bf2e2258b8 Simplify onboarding
missed some from "Upgrading tweepy, hoping it fixes auth issues w/ twitter."
2016-09-15 20:24:34 -07:00
Samuel Clay
7ecf37b8c3 Temporarily locked = suspended on twitter. 2016-06-28 17:11:22 -07:00
Samuel Clay
a7ceebcb0f Adding exception handling for twitter feeds. 2016-06-28 16:09:14 -07:00
Samuel Clay
76b48a5525 Fixing twitter status permalink. 2016-06-14 21:36:30 -07:00
Samuel Clay
0a86563321 Checking for links in tweet, adding link tag. 2016-05-26 15:52:41 -07:00
Samuel Clay
453f9d67eb Handling insta-fetching twitter feeds. 2016-05-26 15:36:20 -07:00
Samuel Clay
bab64e0447 Disconnecting twitter connection if user has broken token. 2016-05-26 15:33:02 -07:00
Samuel Clay
c7420dc888 Retrying twitter fetch with any access token that works. 2016-05-26 15:21:12 -07:00
Samuel Clay
0b33889881 Adding retweet tag, changing likes and retweets to liked and retweeted. 2016-05-26 15:12:22 -07:00
Samuel Clay
2895fc398d Adding photo category to tweets. 2016-05-26 15:09:24 -07:00
Samuel Clay
aa397194a1 Allowing twitter URL to not have https/http in it. 2016-05-26 15:06:52 -07:00
Samuel Clay
5db1138cdf Tweets now have enclosed images. 2016-05-26 15:05:04 -07:00
Samuel Clay
7ad8dd89db Better match for twitter.com/username 2016-05-26 14:41:44 -07:00
Samuel Clay
ac9f286dbe Correcting twitter status link. 2016-05-26 14:34:47 -07:00
Samuel Clay
e3445bb134 Native Twitter support for converting the Twitter API to RSS. If you're reading this, you can test it by subscribing to twitter usernames like so: https://twitter.com/newsblur 2016-05-26 14:30:26 -07:00
Samuel Clay
8795c46204 Wrong feed_id 2016-05-20 16:15:18 -07:00
Samuel Clay
679e2ddfd3 Using get_by_id when refreshing feed. 2016-05-20 16:13:51 -07:00
Samuel Clay
c1d1534d67 Sanitizing text/plain stories. 2016-05-11 12:01:27 -07:00
Samuel Clay
594e677357 Fix somewhat long-standing error logging bug that spits out a ton of data on feeds that don't work with requests lib. 2016-03-18 18:30:01 -07:00
Samuel Clay
f901f583a3 Sanity check for broken mtime. 2016-03-08 13:33:16 -08:00
Samuel Clay
586ff3f572 Fixing unicode issues in feed fetcher. Also fixing broken last-modified cache header. 2016-03-08 13:26:34 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
39b29bfd27 Splitting feed error codes. 2016-02-09 16:22:34 -08:00
Samuel Clay
3b3d76dcd2 Relative URI handling in feedparser changes when it doesn't have the URL of the feed. Thank goodness I caught this early, otherwise a bunch of sites' images would have been mysteriously broken. 2016-02-05 18:43:08 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
d88ebec119 Handling missing page links. 2016-02-03 13:13:31 -08:00
Samuel Clay
92f36821a9 Typo in feed parser log entry. 2016-02-03 12:55:39 -08:00
Samuel Clay
7c4410226f Some feeds are really broken. 2016-02-03 12:54:34 -08:00
Samuel Clay
3134866414 Fixing address issue when updating page link. 2016-02-03 12:38:18 -08:00
Samuel Clay
0bf0bb02e2 Only remove cache busting query parameter when added. 2016-02-03 12:29:16 -08:00
Samuel Clay
4bda8ff0f0 Adding qurl library to better add and remove cache buster while maintain url query string order. 2016-02-03 12:18:35 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Samuel Clay
66aadc45a1 Adding soft time limit to celery tasks. 2016-02-01 23:06:04 -08:00
Samuel Clay
988bcd7aee Fixing redirect behavior by saving redirect history for 25 fetches when one 400+ error is found. 2016-01-13 12:42:39 -08:00
Samuel Clay
81bc426eeb Better handling youtube feed errors. 2016-01-07 20:04:29 -08:00
Slavik Svyrydiuk
753d5fc018 use django.utils.encoding.smart_unicode instead of utils.feed_functions.utf8encode 2015-12-02 06:46:18 +01:00
Samuel Clay
101e8477e0 Handling feeds that go missing. 2015-11-28 13:54:21 -08:00
Samuel Clay
f8775f8d54 Handling more errors when fetching feeds. 2015-11-28 13:48:20 -08:00
Samuel Clay
c72d0d4c06 Turning off annotations on Youtube videos by default. 2015-10-23 15:58:55 -07:00
Samuel Clay
3d92dfd0ad Handling YouTube client errors gracefully. 2015-08-24 14:51:01 -07:00
Samuel Clay
a774cddcb3 Fixing broken sub counts when reids sub count expires. 2015-08-05 13:59:26 -07:00
Samuel Clay
9cd8124419 Combing through all updates to feeds table when fetching feed. 2015-07-22 13:53:20 -07:00
Samuel Clay
da26ecdb46 1/2 Cleaning up feed fetcher's updates to feeds table. Still need to find 6 dupes. 2015-07-22 13:18:54 -07:00