Commit graph

1933 commits

Author SHA1 Message Date
Samuel Clay
c25dfd2503 May have found the last subscriber count glitch due to branched feeds. 2016-05-23 19:45:45 -07:00
Samuel Clay
d0a191e556 Allowing youtube feeds to be added directly. 2016-05-23 11:58:46 -07:00
Samuel Clay
c3dee67c29 Only swap dupe feed with original feed if not both branched. 2016-05-21 06:13:35 -07:00
Samuel Clay
7caa5fa99a Wrong log in feeddata. 2016-05-20 16:40:46 -07:00
Samuel Clay
90e3036eaf Handling feeddata update with no updates. 2016-05-20 16:22:47 -07:00
Samuel Clay
9e4b16e74b Correcting subscriber counts. 2016-05-20 16:19:57 -07:00
Samuel Clay
fa92383ec8 Checking hash dupes before link+address dupes. 2016-05-20 15:59:32 -07:00
Samuel Clay
eae2a14364 Adding logging. 2016-05-20 15:55:37 -07:00
Samuel Clay
6a543c980c IntegrityError is a subclass of DatabaseError, so feeds weren't being merged properly. 2016-05-20 15:52:42 -07:00
Samuel Clay
8a3563766f Reintroducing correct subscriber counts. 2016-05-16 17:57:02 -07:00
Samuel Clay
1497412133 Attempting to correct sub counts for branched feeds. 2016-05-05 19:37:02 +08:00
Samuel Clay
432d40094e Correct feedfinder. 2016-04-18 16:36:40 -07:00
Samuel Clay
bf5107d5d8 Only branch feed if feed is OK on page and feed. 2016-04-18 16:35:49 -07:00
Samuel Clay
a22a3fe1f7 Ignoring feedsportal. 2016-04-18 16:17:15 -07:00
Samuel Clay
44e9b131a0 Fixing icon saving to s3 bug. 2016-04-06 17:06:32 -07:00
Samuel Clay
0da1ed6692 Stubbing in saved searches. Still need to add in saved seaches and then display the search feeds. 2016-03-10 18:33:04 -05:00
Samuel Clay
61397dab49 Saved stories have no changes. 2016-03-01 10:13:33 -05:00
Samuel Clay
1effb5b9cf Finally allowing switching between showing and hiding story changes. Ready to ship? 2016-02-26 20:39:18 -08:00
Samuel Clay
8879a6eb95 Correctly determining if there are story changes. 2016-02-26 20:16:26 -08:00
Samuel Clay
dcc942c9c6 Undoing story change preference. Now story changes are loading through ajax. 2016-02-26 20:01:41 -08:00
Samuel Clay
3499950353 Clearing a story's Text view cache when the story is updated. 2016-02-25 15:45:32 -08:00
Samuel Clay
5dcfc20a84 Rate limiting insta-fetching to 10 fetches per 10 minutes. 2016-02-25 14:15:05 -08:00
Samuel Clay
326dfa91c6 Trimming feeds down to 10 stories (from 25) when going two months unread. 2016-02-25 11:50:14 -08:00
Samuel Clay
cdad31ec92 Only auth users may search feeds. 2016-02-24 12:31:45 -08:00
Samuel Clay
07306152b7 Only search aggressively if authenticated. 2016-02-24 12:14:41 -08:00
Samuel Clay
8c9ac47131 Adding IP logging to feed searching. 2016-02-24 12:11:41 -08:00
Samuel Clay
803e5e970d Adding find_feed logging to diagnose postgres issues. 2016-02-24 12:05:40 -08:00
Samuel Clay
e1cf12888a Handling mis-shapen icons. 2016-02-16 13:24:09 -08:00
Samuel Clay
61fb9f1719 Handling IncompleteRead from requests during icon fetch. 2016-02-16 13:22:11 -08:00
Samuel Clay
7ca5a7b25f Handling missing rss URLs when checking site from bookmarklet. 2016-02-16 13:19:59 -08:00
Samuel Clay
043c03e763 Fixing add url when searching for rss feeds. 2016-02-16 11:48:35 -08:00
Samuel Clay
d127d1094c Fixing author in newsletters. 2016-02-09 17:22:07 -08:00
Samuel Clay
7c8f85c24a Newsletter icons now work. Time to try it out on prod. 2016-02-09 17:14:59 -08:00
Samuel Clay
3c7717aff5 Updating newsletter icon. 2016-02-09 16:59:58 -08:00
Samuel Clay
bb964648df Merge branch 'master' into newsletters
* master:
  Handling bunk feeds better by forcing a sub recount and ignoring if not subscribed.
  Splitting feed error codes.
2016-02-09 16:37:06 -08:00
Samuel Clay
4ed51e880a Handling bunk feeds better by forcing a sub recount and ignoring if not subscribed. 2016-02-09 16:34:59 -08:00
Samuel Clay
802e9a10b0 Newsletters partially work. Still need to handle them during feed fetching. 2016-02-09 16:22:22 -08:00
Samuel Clay
94d981cfac Fixing issue with missing feed urls on original feed pages. 2016-02-05 14:46:56 -08:00
Samuel Clay
2d6343b7ae Fixing feedfinder beautifulsoup issues, unicode issues in feed, and unicode comparisons issues with page_data (since it wasnt being decompressed when compared). 2016-02-05 14:43:31 -08:00
Samuel Clay
6edbf67a50 Fix to scipy and the icon importer credited entirely to the work of @sbilly. 2016-02-04 21:31:49 -08:00
Samuel Clay
19902ec7bf Attempting to fix SNI issues by using new feedfinder and using requests instead of feedparser. This needs virtualenv, stat. 2016-02-04 12:28:55 -08:00
Samuel Clay
ee2573ee75 Cleaning cache buster from feed and page urls. 2016-02-03 12:11:22 -08:00
Samuel Clay
e3df276232 Trying to save S3 saving if only color is different. k-means clustering is non-deterministic, so this led to a ton of multi-uploads. 2016-02-02 18:54:34 -08:00
Samuel Clay
66aadc45a1 Adding soft time limit to celery tasks. 2016-02-01 23:06:04 -08:00
Samuel Clay
474c381d26 I cannot believe it was a string-to-int type conversion that wasn't happening when deleting feeds. *smacks forehead* Stupid json.decode. Sorry to 85136323e2. 2016-01-28 12:31:39 -08:00
Samuel Clay
2c875a3d01 Handling update_fields=[] when saving feeds. 2016-01-28 11:35:11 -08:00
Samuel Clay
1621c40da8 Premium accounts get feeds fetched at least once every 12 hours (for feeds that publish nothing). 2016-01-23 15:04:05 -08:00
Samuel Clay
0a001881cf Fixing valuerror when trimming on feeds that have bogus dates. 2016-01-20 13:32:56 -08:00
Samuel Clay
103a8993e8 Counting shared stories when deleting old feeds. 2016-01-19 11:30:13 -08:00
Samuel Clay
ce5d1c815e Updating story trimmer to look for unread feeds that may be actively subscribed. 2016-01-19 11:28:35 -08:00