public-mirrors/NewsBlur
1
0
Fork 0
mirror of https://github.com/samuelclay/NewsBlur.git synced 2025-08-29 20:46:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
12370 commits 16 branches 14 tags 926 MiB
Commit graph

74 commits

Author SHA1 Message Date
Samuel Clay
471d5434c6 Facebook pages feed gets the correct favicon. 2018-03-26 19:05:22 -07:00
Diego Elio Pettenò
4ff8ed7798 favicon fetcher: provide an Accept header on requests. 
This makes the fetcher work with the default ModSecurity ruleset, and would also avoid providing unsupported favicon formats (e.g. webp), by explictly preferring PNG and
x-icon formats.
 2017-08-16 18:21:14 +00:00
Samuel Clay
78568f0914 Handling broken URL for icons. 2017-03-31 20:30:43 -07:00
Samuel Clay
461c1c4b65 Changing feed log format to include id at the beginning. Also normalizing all feed titles in logs for better searchability. 2017-03-31 19:52:24 -07:00
Samuel Clay
440d2c5841 Fixing broken S3 names. 2017-03-28 21:17:11 -07:00
Samuel Clay
9f15958c0e Only connect to S3 when needed. 2017-03-28 10:43:31 -07:00
Samuel Clay
4dc17b751b Handling error when fetching icn for bad feed link. 2016-12-11 18:32:37 -08:00
Samuel Clay
44e9b131a0 Fixing icon saving to s3 bug. 2016-04-06 17:06:32 -07:00
Samuel Clay
e1cf12888a Handling mis-shapen icons. 2016-02-16 13:24:09 -08:00
Samuel Clay
61fb9f1719 Handling IncompleteRead from requests during icon fetch. 2016-02-16 13:22:11 -08:00
Samuel Clay
7c8f85c24a Newsletter icons now work. Time to try it out on prod. 2016-02-09 17:14:59 -08:00
Samuel Clay
6edbf67a50 Fix to scipy and the icon importer credited entirely to the work of @sbilly. 2016-02-04 21:31:49 -08:00
Samuel Clay
e3df276232 Trying to save S3 saving if only color is different. k-means clustering is non-deterministic, so this led to a ton of multi-uploads. 2016-02-02 18:54:34 -08:00
Samuel Clay
6be803a08f Icon importer needs to actually be different, not just forced. 2016-01-03 15:55:22 -08:00
Slavik Svyrydiuk
017170cbb4 PEP8 fixes 2015-12-02 12:15:56 +01:00
Samuel Clay
11ec92f9f0 Fixing yet another requests error on icon fetching. 2015-11-28 13:52:18 -08:00
Samuel Clay
d1cb93433c Handling another requests error when fetching icons. 2015-11-28 13:28:28 -08:00
Samuel Clay
da26ecdb46 1/2 Cleaning up feed fetcher's updates to feeds table. Still need to find 6 dupes. 2015-07-22 13:18:54 -07:00
Samuel Clay
82fbccd1c2 Handling invalid urls for icons. 2015-07-07 13:35:00 -07:00
Samuel Clay
94ce13183b Handling requests issue with too many redirects. 2015-07-07 13:30:46 -07:00
Samuel Clay
5b99ab01ec Adding error handling for new icon feed link fetcher. 2015-05-19 16:31:25 -07:00
Samuel Clay
e1f31b9277 Attempting to fetch Tumblr feed icons. 2015-05-18 17:51:23 -07:00
Samuel Clay
b746dda72d Fixing massive icon problems by removing support for Windows ICO files. 2014-05-16 12:33:06 -07:00
Samuel Clay
403a4ced90 Converting from PIL to Pillow. 2014-05-16 12:18:59 -07:00
Samuel Clay
07c5f95c36 Fixing a couple small bugs. 2013-10-07 16:16:38 -07:00
Samuel Clay
d3fa017cd9 Fixing broken icon bug. 2013-08-21 12:40:04 -07:00
Samuel Clay
5f7ae25fc4 Normaling user agents between feed/page/icon fetchers. Adding full site permalink. 2013-07-10 14:14:55 -07:00
Samuel Clay
8d9da758fd Better handling of busted favicons. 2013-07-05 17:43:14 -07:00
Samuel Clay
2408156024 Reverting most PIL cleanup. 2013-06-21 13:15:04 -07:00
Samuel Clay
bb95ea8984 Cleaning up PIL. 2013-06-21 13:11:54 -07:00
Samuel Clay
cc33a3e663 Fixing icon fetch for images > 500KB. 2013-06-04 16:30:21 -07:00
Samuel Clay
4de16b77f8 Adding expires header to icons. 2013-03-22 18:29:54 -07:00
Samuel Clay
279041249e Fixing missing scipy import missing form PILlow. 2013-03-22 15:33:26 -07:00
Samuel Clay
acb1efd3ea Last imports for pillow. 2013-03-22 15:27:10 -07:00
Samuel Clay
4a7516cb83 Fixing a bunch of feed fetch errors. 2012-10-01 19:31:33 -07:00
Samuel Clay
1252819c8c Fixing issue when opening feed in Story view but second story gets selected instead of first. 2012-09-21 11:36:27 -07:00
Samuel Clay
838cabbd42 Typo in s3 icon. 2012-09-20 12:44:41 -07:00
Samuel Clay
a8975a3bc4 Forcing icon save if the icon is not yet in s3. 2012-09-20 12:43:34 -07:00
Samuel Clay
1ace793648 Completing feed icon migration to S3. 2012-09-20 12:29:52 -07:00
Samuel Clay
88c86e273a S3 icons. Untested. 2012-09-19 16:33:23 -07:00
Samuel Clay
00ba259c66 Migrating to S3 for feed pages. 2012-09-18 17:09:07 -07:00
Samuel Clay
2e42cd3e8f Encoding utf-8 strings into bytecodes so lxml doesn't choke. 2012-08-29 23:16:23 -07:00
Samuel Clay
15df6b6b47 Making the icon importer a bit faster and more slave lag resilient by using page fetch data. Also fixing title on blurblogs. 2012-07-30 11:12:58 -07:00
Samuel Clay
febd0ae0a3 Lots of little bugs: avatar images, icon importer, page importer, adding analytics tracking to intro. 2012-07-12 12:57:35 -07:00
Samuel Clay
cd589951c9 Adding etags (304's) to feed icons. 2012-03-29 16:03:06 -07:00
Samuel Clay
53efae20ff Fixing a few bugs introduced with feed_id conversions. 2012-01-27 15:29:14 -08:00
Samuel Clay
2b9ad97b51 Switching a ton of feed and user fetches to simple ID matches. ".user.pk -> .user_id" 2012-01-26 09:32:24 -08:00
Samuel Clay
6a68181974 Fixing image processing issue and updating to latest feedparser. 2011-08-27 13:27:21 -07:00
Samuel Clay
130196e6e0 Adding attribution on favicon .ico handling. 2011-07-13 17:45:43 -07:00
Samuel Clay
bb18f3e284 Icon importer now saves to both mongo and psql for icons. 2011-04-26 19:43:19 -04:00