Commit graph

1933 commits

Author SHA1 Message Date
Samuel Clay
7cb2213509 Ignoring feedsportal. 2017-02-24 16:46:58 -08:00
Samuel Clay
63fea1feeb Fixing icon saving to s3 bug. 2017-02-24 16:46:54 -08:00
Samuel Clay
937a1fa999 Faking user agent when rss bans NewsBlur. 2017-02-17 12:19:55 -08:00
Samuel Clay
255b30f3c1 Better recording of non-200/300 status codes on feed fetch. 2017-02-17 12:05:27 -08:00
Samuel Clay
2954ef7318 Adding new debug to feed fetcher. 2017-02-17 11:45:43 -08:00
Samuel Clay
aee018f39c Upgrading Readability and forcing images to remain. THis should add a bunch of images back to the Text view. 2017-01-25 17:35:48 -08:00
Samuel Clay
a7fcd82d6d Handling missing feed urls. 2017-01-08 18:14:48 -08:00
Samuel Clay
1f8f1db9e9 Simplifying the conditional formatting. 2017-01-08 18:13:00 -08:00
Samuel Clay
9e69db2590 Fixing broken feed urls on keyword popularity xls. 2017-01-08 17:54:51 -08:00
Samuel Clay
0f2c90ee2a Can't believe .write_column() is a thing. 2017-01-05 19:20:03 -08:00
Samuel Clay
72ffa295e8 Cleaning up popularity query. 2017-01-05 19:13:55 -08:00
Samuel Clay
ea713d011a Adding comments to popularity query xlsx. 2017-01-05 19:06:45 -08:00
Samuel Clay
1523f115fe Turning off feed stats that are unecessarily slowing down collection. 2017-01-05 18:39:01 -08:00
Samuel Clay
0235cb38b0 Adding popularity query email. 2017-01-05 18:26:50 -08:00
Samuel Clay
52a76e7811 Updating popularity xls to include share counts and classifiers. Refactored xls creation to better handle new columns. 2017-01-05 16:44:19 -08:00
Samuel Clay
c5d5ea5001 Attempting to fix dashboard stories by no longer relying on full river reloads when a new story comes in but to fetch that story if it is newer (or older) than last visible dashboard story. 2016-12-13 16:29:42 -08:00
Samuel Clay
4dc17b751b Handling error when fetching icn for bad feed link. 2016-12-11 18:32:37 -08:00
Samuel Clay
c4830e3e95 Handling unicode encode errors in page/text handling. Also adding upgrade command for fabric when pip is non-trivial. 2016-12-05 22:09:05 -08:00
Samuel Clay
3ed96e338c Fixing page and text importer to correctly handling non-breaking spaces. 2016-12-05 17:40:39 -08:00
Samuel Clay
3a93ad7248 Fixing original page server. 2016-11-30 17:17:40 -08:00
Samuel Clay
a40ebc3940 Adding linebreaks back into iOS story notifications. 2016-11-20 14:18:13 -08:00
Samuel Clay
56b3dfa659 More aggregation changes. 2016-11-20 13:11:56 -08:00
Samuel Clay
8f6bfa1c55 Notifications now support hidden stories and focus stories. Web also all done. Just need to build iOS push and iOS notification chooser. 2016-11-16 17:49:43 -08:00
Samuel Clay
0284793b3a Adding in push notifications for web. Needs filtering. 2016-11-15 20:45:59 -08:00
Samuel Clay
1be440c407 DynamicDocument allows starred stories to work with stories that have more fields. 2016-11-10 18:02:34 -08:00
Samuel Clay
afb93fd26d Turning off strict feed validation for mongoengine. 2016-11-10 17:56:08 -08:00
Samuel Clay
cc62d23b00 Adding unused fields on MStarredStory to compensate for new mongoengine requirements. 2016-11-10 17:36:40 -08:00
Samuel Clay
5d2c1026ba Adding work/search to maintenance. Adding index to starred stories. 2016-11-10 17:24:31 -08:00
Samuel Clay
7dee3ae771 Upgrading to mongo 3.0. Still needs fixes for mongoengine. 2016-11-10 10:11:46 -08:00
Samuel Clay
3702c2ca6b Moving reach score 2016-11-01 15:16:59 -07:00
Samuel Clay
09cab80fa8 Limiting permalinks when looking at query popularity. 2016-10-28 17:04:12 -07:00
Samuel Clay
b7eb330eea New reach score 2016-10-06 20:33:52 -07:00
Samuel Clay
9098e6797d Adding # readers and switching to faster way of finding readers. 2016-10-06 20:13:53 -07:00
Samuel Clay
44e59c2b63 Read percentages 2016-10-06 19:33:09 -07:00
Samuel Clay
88d0a58d40 Handling dupe stories 2016-10-06 18:10:52 -07:00
Samuel Clay
6a53d127d9 Handling dupe stories 2016-10-06 18:09:46 -07:00
Samuel Clay
7e6aad7b6d Concating dupe stories 2016-10-06 18:06:58 -07:00
Samuel Clay
74bb1ebd4b Reducing dupe feeds. 2016-10-06 17:26:50 -07:00
Samuel Clay
3ebf31334e Minting xlsx spreadsheet from queries. 2016-10-06 17:20:30 -07:00
Samuel Clay
19a4a02754 Handling missing feeds. 2016-10-06 15:42:54 -07:00
Samuel Clay
fbfa7920fc Adding story titles to global queries. 2016-10-06 15:34:53 -07:00
Samuel Clay
4a334a50b0 Rudimentary sorting of global keywords based on subscribers. 2016-10-06 15:24:53 -07:00
Samuel Clay
57d8b3fd12 Removing feed address change due to exceptions. Only branches allowed now. 2016-08-15 18:17:15 -07:00
Samuel Clay
e43733ce30 Handling lxml parser errors for original text. 2016-06-28 16:11:46 -07:00
Samuel Clay
025dd065fe Handling YouTube playlists. 2016-06-13 22:54:52 -07:00
Samuel Clay
aa397194a1 Allowing twitter URL to not have https/http in it. 2016-05-26 15:06:52 -07:00
Samuel Clay
2c149a728d Sanity check on youtube urls. 2016-05-26 14:50:07 -07:00
Samuel Clay
7ad8dd89db Better match for twitter.com/username 2016-05-26 14:41:44 -07:00
Samuel Clay
e3445bb134 Native Twitter support for converting the Twitter API to RSS. If you're reading this, you can test it by subscribing to twitter usernames like so: https://twitter.com/newsblur 2016-05-26 14:30:26 -07:00
Samuel Clay
66066a28e5 Checking for youtube when searching for a feed. If this grows one more, this needs to be refactored. 2016-05-23 20:00:15 -07:00