Commit graph

3586 commits

Author SHA1 Message Date
Samuel Clay
20b42fb1c1 Stripping quotes out of newsletter sender names. 2016-02-22 11:51:18 -08:00
Samuel Clay
534609cc20 Scrubbing newsletters. 2016-02-18 10:21:24 -08:00
Samuel Clay
2eca5c7258 Handling missing OAuth token for twitter. 2016-02-16 19:40:00 -08:00
Samuel Clay
d56a1c8ea9 Fixing PuSH issue with urls for hubs that look like: '//alert-hub.appspot.com' 2016-02-16 19:34:34 -08:00
Samuel Clay
e1cf12888a Handling mis-shapen icons. 2016-02-16 13:24:09 -08:00
Samuel Clay
61fb9f1719 Handling IncompleteRead from requests during icon fetch. 2016-02-16 13:22:11 -08:00
Samuel Clay
7ca5a7b25f Handling missing rss URLs when checking site from bookmarklet. 2016-02-16 13:19:59 -08:00
Samuel Clay
959fc368e9 Better handling of PuSH errors. 2016-02-16 13:12:31 -08:00
Samuel Clay
043c03e763 Fixing add url when searching for rss feeds. 2016-02-16 11:48:35 -08:00
Samuel Clay
cac784be54 Can't use 'sender' as it's gets mucked up with forwarding rules. Switching to reconstructing email from 'from' field. 2016-02-10 15:01:28 -08:00
Samuel Clay
9d03293345 Better formatting of plaintext newsletters. 2016-02-09 17:46:40 -08:00
Samuel Clay
a610ac03c9 Handling plain text email newsletters. 2016-02-09 17:44:33 -08:00
Samuel Clay
eb6c574c33 Pretty printing newsletter debug. 2016-02-09 17:40:07 -08:00
Samuel Clay
5f2c2d9a6f Pretty printing newsletter debug. 2016-02-09 17:39:28 -08:00
Samuel Clay
7225678c8f Redis needs settings. 2016-02-09 17:31:57 -08:00
Samuel Clay
3c7dbb9ae1 Reloading user feeds in relatime when new newsletter comes in. 2016-02-09 17:31:03 -08:00
Samuel Clay
6d9f254268 Adding redis realtime pubsub for newsletters. 2016-02-09 17:29:30 -08:00
Samuel Clay
7b4b250ac7 Logging newsletter pushes. 2016-02-09 17:26:57 -08:00
Samuel Clay
f42b6514b0 Fetching newsletter feed icon on subscribe. 2016-02-09 17:24:33 -08:00
Samuel Clay
d127d1094c Fixing author in newsletters. 2016-02-09 17:22:07 -08:00
Samuel Clay
7c8f85c24a Newsletter icons now work. Time to try it out on prod. 2016-02-09 17:14:59 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
bb964648df Merge branch 'master' into newsletters
* master:
  Handling bunk feeds better by forcing a sub recount and ignoring if not subscribed.
  Splitting feed error codes.
2016-02-09 16:37:06 -08:00
Samuel Clay
4ed51e880a Handling bunk feeds better by forcing a sub recount and ignoring if not subscribed. 2016-02-09 16:34:59 -08:00
Samuel Clay
802e9a10b0 Newsletters partially work. Still need to handle them during feed fetching. 2016-02-09 16:22:22 -08:00
Samuel Clay
f7bdd5b8c8 Logging sample mailgun requests. 2016-02-09 13:47:54 -08:00
Samuel Clay
08b5e0dcad Stubbing in /newsletters receive endpoint for mailgun routes. 2016-02-09 13:43:57 -08:00
Samuel Clay
94d981cfac Fixing issue with missing feed urls on original feed pages. 2016-02-05 14:46:56 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
6edbf67a50 Fix to scipy and the icon importer credited entirely to the work of @sbilly. 2016-02-04 21:31:49 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Samuel Clay
e3df276232 Trying to save S3 saving if only color is different. k-means clustering is non-deterministic, so this led to a ton of multi-uploads. 2016-02-02 18:54:34 -08:00
Samuel Clay
66aadc45a1 Adding soft time limit to celery tasks. 2016-02-01 23:06:04 -08:00
Samuel Clay
bb2557377f Adding include_inactive=true to flat feeds to only give inactive feeds. I hope this doesn't break someday. 2016-01-28 16:23:38 -08:00
Samuel Clay
ae5bca50bb Separating flat_folders and flat_folders_with_inactive. 2016-01-28 16:17:25 -08:00
Samuel Clay
88f45552e4 Adding inactive feeds to flat folders. This shouldn't break anything, since clients should be able to handle missing feeds anyhow. 2016-01-28 15:46:27 -08:00
Samuel Clay
2f650b3da1 Adding to /reader/feeds?flat=true (for @dejal). 2016-01-28 15:07:37 -08:00
Samuel Clay
474c381d26 I cannot believe it was a string-to-int type conversion that wasn't happening when deleting feeds. *smacks forehead* Stupid json.decode. Sorry to 85136323e2. 2016-01-28 12:31:39 -08:00
Samuel Clay
34228e3b77 Handling search queries with just spaces in them. 2016-01-28 11:41:01 -08:00
Samuel Clay
2c875a3d01 Handling update_fields=[] when saving feeds. 2016-01-28 11:35:11 -08:00
Samuel Clay
1621c40da8 Premium accounts get feeds fetched at least once every 12 hours (for feeds that publish nothing). 2016-01-23 15:04:05 -08:00
Samuel Clay
310204fe70 Flat feeds also gets user_id. 2016-01-22 12:47:31 -08:00
Samuel Clay
b064576101 Adding user_id to /reader/feeds. 2016-01-22 12:46:41 -08:00
Samuel Clay
6f44ea2efa Adding MX DNS check on new users. 2016-01-21 13:37:38 -08:00
Samuel Clay
0a001881cf Fixing valuerror when trimming on feeds that have bogus dates. 2016-01-20 13:32:56 -08:00
Samuel Clay
103a8993e8 Counting shared stories when deleting old feeds. 2016-01-19 11:30:13 -08:00
Samuel Clay
ce5d1c815e Updating story trimmer to look for unread feeds that may be actively subscribed. 2016-01-19 11:28:35 -08:00
Samuel Clay
eb5520a118 Rotating feed stats hours based on user's timezone preference. 2016-01-14 16:01:00 -08:00
Samuel Clay
988bcd7aee Fixing redirect behavior by saving redirect history for 25 fetches when one 400+ error is found. 2016-01-13 12:42:39 -08:00