Samuel Clay
d37ca03d07
Adding twitter lists to feed fetcher.
2020-06-04 16:57:04 -04:00
Samuel Clay
15d393cc26
No story title and no content means no story.
2018-08-02 11:32:24 -04:00
Samuel Clay
f2c1585da0
Fixing facebook pages match.
2018-04-03 12:38:49 -07:00
Samuel Clay
7fe5b63bdf
Merge branch 'master' into facebook
...
* master:
Faking user agent shouldnt use a randomized URL.
Adding authed api url add.
2018-03-27 12:01:38 -07:00
Samuel Clay
1321cd40aa
Faking user agent shouldnt use a randomized URL.
2018-03-27 12:01:31 -07:00
Samuel Clay
471d5434c6
Facebook pages feed gets the correct favicon.
2018-03-26 19:05:22 -07:00
Samuel Clay
da4741a3fa
Adding videos to facebook posts. Seems to work pretty well.
2018-03-26 17:31:12 -07:00
Samuel Clay
364ff9dc85
Fixing YouTube to not verify SSL certs.
2018-03-09 09:44:05 -08:00
Daniel Aleksandersen
19a24d8b7e
Support HTTP 308 from RFC 7238
2017-08-16 09:17:23 +02:00
Samuel Clay
3bcfba0a9b
Fixing YouTube Playlists.
2017-07-27 17:14:15 -07:00
Samuel Clay
c1834703d9
Adding support for JSON Feeds.
2017-05-22 16:46:56 -07:00
Samuel Clay
6bc9a55bfc
Rewriting twitter fetching. Now fetching truncated text, embedding quoted tweets, and fixing URLs so that they show the display url (and not t.co) and link to the expanded url.
2017-05-06 19:38:36 -07:00
Samuel Clay
85355a5c9c
Tweets now show full, untruncated text. They also expand all URLs.
2017-05-06 17:52:31 -07:00
Samuel Clay
44de405195
Only fetch as many guidas as there are stories in the feed. No need to get everything assuming the feed has the latest N stories.
2017-05-01 12:06:56 -07:00
Samuel Clay
08c897e5a1
This is it, the big kahuna of fixes. This corrects for messed up guids that are causing lots of read stories to become unread.
2017-05-01 11:39:24 -07:00
Samuel Clay
b753cf6819
This won't fix it but in the event of missing guids on feed fetch, check for stories within the mark read period.
2017-05-01 10:51:04 -07:00
Samuel Clay
c9326a6f02
Perhaps this is the way to find the missing story hashes. Shouldn't cause an issue, but logic for dates may be backwards.
2017-05-01 09:27:31 -07:00
Samuel Clay
ffeeb170e0
Finally have a test case for the Google Blog duping.
2017-04-30 18:47:10 -07:00
Samuel Clay
9d9a5accbd
Better handling of tweepy errors.
2017-04-13 11:43:39 -07:00
Samuel Clay
d84e2af636
New experimental data collector for debugging feeds over time.
2017-04-12 19:13:33 -07:00
Samuel Clay
557438008b
Fixing a couple Twitter and YouTube fetch issues.
2017-04-12 11:19:42 -07:00
Samuel Clay
461c1c4b65
Changing feed log format to include id at the beginning. Also normalizing all feed titles in logs for better searchability.
2017-03-31 19:52:24 -07:00
Samuel Clay
937a67f67c
Only using active twitter accounts.
2017-03-24 13:04:38 -07:00
Samuel Clay
4f8a1c43b3
Fixing attribution in twitter RTs.
2017-03-15 19:40:43 -07:00
Samuel Clay
a6fdf45d33
Adding support for native RTs in Twitter.
2017-03-15 19:26:39 -07:00
Samuel Clay
937a1fa999
Faking user agent when rss bans NewsBlur.
2017-02-17 12:19:55 -08:00
Samuel Clay
255b30f3c1
Better recording of non-200/300 status codes on feed fetch.
2017-02-17 12:05:27 -08:00
Samuel Clay
2954ef7318
Adding new debug to feed fetcher.
2017-02-17 11:45:43 -08:00
Samuel Clay
c5d5ea5001
Attempting to fix dashboard stories by no longer relying on full river reloads when a new story comes in but to fetch that story if it is newer (or older) than last visible dashboard story.
2016-12-13 16:29:42 -08:00
Samuel Clay
046f97558b
Checking for memory errors while feed fetching.
2016-12-11 18:59:02 -08:00
Samuel Clay
d1e2e3e1d9
Handling MemoryError while feed fetching.
2016-12-11 18:29:00 -08:00
Samuel Clay
b5e0870fa8
Merge pull request #958 from da2x/patch-1
...
HTTP feed fetcher improvements
2016-11-25 13:02:44 -06:00
Samuel Clay
0f7c17eb9f
Fixing twitter error message.
2016-11-21 17:23:53 -08:00
Samuel Clay
6698967021
Handling twitter issues.
2016-11-21 13:15:50 -08:00
Samuel Clay
d9676d64e7
Fixing tweepy error handling.
2016-11-20 13:43:49 -08:00
Samuel Clay
b3aba908d7
Handling twitter fetch issues.
2016-11-18 10:54:46 -08:00
Samuel Clay
9ffa63ec2b
Max os 3 stories sent per notification group. Also limiting notifications to staff for live test.
2016-11-16 18:29:13 -08:00
Samuel Clay
8f6bfa1c55
Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser.
2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a
Adding in push notifications for web. Needs filtering.
2016-11-15 20:45:59 -08:00
Samuel Clay
982d1c9589
Handling twitter user not found error.
2016-11-11 15:12:13 -08:00
Samuel Clay
fde0c6caef
Higher random weight for quick fetch.
2016-11-09 09:00:30 -08:00
Daniel Aleksandersen
2f7bdd1672
HTTP feed fetcher improvements
...
* Send an Accept header asking for feed formats (instead of the current */*)
* Don’t send A-IM without an If-None-Match or If-Modified-Since header.
* Fixed Train-Case in one HTTP header.
2016-10-28 01:25:08 +02:00
Samuel Clay
a616ad50a5
Adding support for tweets that start with '@' to be categorized as a reply.
2016-09-22 15:54:39 -07:00
Julien Rottenberg
bf2e2258b8
Simplify onboarding
...
missed some from "Upgrading tweepy, hoping it fixes auth issues w/ twitter."
2016-09-15 20:24:34 -07:00
Samuel Clay
7ecf37b8c3
Temporarily locked = suspended on twitter.
2016-06-28 17:11:22 -07:00
Samuel Clay
a7ceebcb0f
Adding exception handling for twitter feeds.
2016-06-28 16:09:14 -07:00
Samuel Clay
76b48a5525
Fixing twitter status permalink.
2016-06-14 21:36:30 -07:00
Samuel Clay
0a86563321
Checking for links in tweet, adding link tag.
2016-05-26 15:52:41 -07:00
Samuel Clay
453f9d67eb
Handling insta-fetching twitter feeds.
2016-05-26 15:36:20 -07:00
Samuel Clay
bab64e0447
Disconnecting twitter connection if user has broken token.
2016-05-26 15:33:02 -07:00
