Commit graph

1179 commits

Author SHA1 Message Date
Jonathan Math
d37f2286b1 fix syntax errors and import issue for compat 2020-06-19 02:35:30 -04:00
Jonathan Math
8adad94f47 use dict in apps/rss_feeds/models.py instead of zip object 2020-06-19 02:31:33 -04:00
Jonathan Math
e46b2495ce update all models.py files to python3 and django2.0 2020-06-17 00:17:32 -04:00
jmath1
6021afaec3 2to3 apps/rss_feeds 2020-06-15 02:54:37 -04:00
jmath1
3a88b5210a Add on_delete argument to ForeignKeyField and OneToOneField fields 2020-06-11 05:45:48 -04:00
Samuel Clay
d37ca03d07 Adding twitter lists to feed fetcher. 2020-06-04 16:57:04 -04:00
Samuel Clay
ff4eac73bb 6 hour min 2020-04-06 09:43:18 -04:00
Samuel Clay
27096549a9 6 hour minimum for craigslist 2020-04-06 09:42:11 -04:00
Samuel Clay
be04239f8a Secure image thumbnails are default 192px (for #1162). 2020-01-23 20:34:32 -05:00
Samuel Clay
ed81559e4e Adding imageproxy and switching from camo. Built for #1162. 2019-12-25 18:13:36 -05:00
Samuel Clay
c7091e6772 Adding back in types 2019-12-25 16:06:34 -05:00
Samuel Clay
9ca17dd3b3 Undoing commit that changed story dates. 2019-12-25 15:59:38 -05:00
Samuel Clay
da1a1531dc Don't fetch if feed_fetcher import warning. 2019-12-21 09:49:41 -05:00
Samuel Clay
ebd13d9487 Drop tags with CDATA. 2019-11-06 16:10:56 -05:00
Samuel Clay
e52fb89abe Handling ImportError 2019-10-13 09:31:45 -04:00
Samuel Clay
f7e9280668 Turning on old feedfinder which won't timeout. 2019-08-28 10:43:02 -07:00
Samuel Clay
d4178cd57f Bumping feedfinder time for #1232. 2019-08-28 10:40:29 -07:00
Samuel Clay
6949b7c328 Adding feedfinder old to handle some sticky urls. Addresses #1232. 2019-08-28 10:36:49 -07:00
Samuel Clay
74e8fd4606 Deploying camo https proxy for images. 2019-08-11 14:44:15 -07:00
Samuel Clay
cbd324ea14 Not counting saved stories among thousands of feeds. 2019-06-10 15:14:09 -04:00
Samuel Clay
364a05febb Removing subscriptions when feed not found. 2019-06-07 14:45:42 -04:00
Samuel Clay
646fcb0819 Moving to 3 hour min for premium sub feed fetch intervals (from 6 hours). This is for feeds with no activity. 2019-05-28 10:23:42 -04:00
Samuel Clay
416ac32536 Interactive debug feed 2019-05-12 16:47:20 -04:00
Samuel Clay
4083d5dec3 Adding logging 2019-05-12 16:44:40 -04:00
Samuel Clay
74f46686e3 Double checking for image urls. 2019-02-18 15:38:44 -05:00
Samuel Clay
3e06b96221 Moving extract image urls into saving for all new stories. 2019-02-04 11:49:01 -05:00
Samuel Clay
9d7fc6827a Enforcing secure image urls when replacing image from text extraction. 2019-02-01 11:55:10 -05:00
Samuel Clay
5865c23e7c Moving feedburner images to the back of the image list to highlight original images where possible. 2019-01-20 14:53:39 -05:00
Samuel Clay
80ee4fd814 Securing images through Text view. Now need to fix shared stories and saved stories. 2019-01-20 13:55:40 -05:00
Samuel Clay
da969804fb Upgrading nginx, adding secure_image_urls to all stories. 2019-01-19 15:37:20 -05:00
Samuel Clay
800d56bb0b Merge branch 'master' into camo
* master:
  Proxy all story view.
  iOS: #1137 (full screen reading)
  Forget the original page for saved stories.
  Fetch original page for saved stories.
  Fixing saved stories inline.
  Adding logging
  Wrong split story hash
  Fidning duplicate feeds in saved stories.
  iOS: #1137 (full screen reading)
  Fix: build postgres container without error
2019-01-19 14:15:23 -05:00
Samuel Clay
a47a026435 Forget the original page for saved stories. 2019-01-18 13:45:32 -05:00
Samuel Clay
52a8e1e2e5 Fetch original page for saved stories. 2019-01-18 13:44:32 -05:00
Samuel Clay
e5c4726932 Creating sgined urls for camo. 2019-01-17 15:05:32 -05:00
Samuel Clay
c6abff0492 Adding to easily make it so feeds never get trimmed of stories. Fixes #1141. 2018-11-04 12:00:14 -05:00
Jordan
bd702371f8 Attempt to fix fetching tumblr rss feeds. 2018-10-26 09:12:00 +00:00
Samuel Clay
7c6594f820 Increasing timeout on feedfinder, just in case (see https://blog.dbrgn.ch/). 2018-08-21 09:58:11 -04:00
Samuel Clay
4a695fd710 Boosting feed fetches due to faster feed ingestion. 2018-08-02 09:59:43 -04:00
Samuel Clay
54a0da95bd On stories with unmarked dates, add a random number of seconds (under a minute) to give stories their own timestamp. Makes feed timelines more deterministic once the stories are injested. 2018-07-26 10:45:09 -04:00
Samuel Clay
692d3f3085 Incorrectly skipping title-less stories. 2018-07-16 10:10:31 -04:00
Samuel Clay
cc615e6d04 Fixing handling of invalid feed url on share story feed finding. 2018-07-13 11:23:56 -04:00
Samuel Clay
ab939f72fe Adding a 'story_title_blank' field to stories to signify that the story title was originally ommitted (even though NewsBlur added one in). Thanks to @jbrayton for the suggestion. 2018-07-12 14:19:14 -04:00
Samuel Clay
9223000139 Adding timeout to feed finder on initial feed add. 2018-06-28 13:38:56 -04:00
Samuel Clay
da4741a3fa Adding videos to facebook posts. Seems to work pretty well. 2018-03-26 17:31:12 -07:00
Samuel Clay
3d31ed2507 Handling connection error when finding feed. 2018-01-18 16:15:17 -08:00
Samuel Clay
8421f667d7 Fixing broken image handling from Mercury Reader that was causing image urls with a srcset to be concat'd together. This one's for @yesthatjwz. 2018-01-17 16:51:06 -08:00
Samuel Clay
b99ccd7045 YouTube feeds now have an auto extracted title. Thank you Bruno! 2017-12-18 21:48:26 -08:00
Samuel Clay
ef96f59c2c Only count months that have stories for the average count. 2017-12-15 17:12:14 -08:00
Samuel Clay
f2ab8145c5 Adding options to control infrequency of infrequent site stories feed. 2017-11-05 14:01:25 -08:00
Samuel Clay
6a27023e12 Merge branch 'master' into infrequent
* master:
  Handling no original doc returning in text importer.
  Assets for icons.
  No longer finding the largest image in a story if the text view already successfully found one. Also using Mercury's builtin image finder.
  Fixing warnings.
  Removing ESPN from original pages.
2017-11-03 14:46:02 -07:00