Commit graph

81 commits

Author SHA1 Message Date
Samuel Clay
ab939f72fe Adding a 'story_title_blank' field to stories to signify that the story title was originally ommitted (even though NewsBlur added one in). Thanks to @jbrayton for the suggestion. 2018-07-12 14:19:14 -04:00
Samuel Clay
e11c26d05b Adding video enclosures. 2018-07-08 16:24:33 -04:00
Samuel Clay
8e63c14267 Switching away from Get Satisfaction and to Discourse. forum.newsblur.com is the new support forum. 2018-04-17 16:50:34 -07:00
Samuel Clay
d1e9571093 Future dated stories get forced to current date. This fixed multiple issues: makring as read on oldest first only marks stories older than current date as read. Also fixes issues with publishers gaming the dates. 2017-08-04 13:31:03 -07:00
Samuel Clay
de59c9471c Don't add images in media enclosures if the URL is found in the story already. 2017-04-21 11:42:38 -07:00
Samuel Clay
9f64fcb572 Undoing mistaken date correct. 2016-11-14 08:18:31 -08:00
Samuel Clay
7dee3ae771 Upgrading to mongo 3.0. Still needs fixes for mongoengine. 2016-11-10 10:11:46 -08:00
Samuel Clay
43b90a6ab3 Handling missing rel attr. 2016-08-15 14:58:45 -07:00
Samuel Clay
2de794f6a6 Accepting media:content attachments using a 'medium' attribute instead of a 'type' attribute. Useful for images in deviantart. 2016-08-12 20:43:52 -07:00
Samuel Clay
3ef5071a61 Allowing unicode encode errors for text/plain. 2016-05-11 13:37:35 -07:00
Samuel Clay
73160e0faf Properly decoding text/plain. 2016-05-11 13:28:48 -07:00
Samuel Clay
c1d1534d67 Sanitizing text/plain stories. 2016-05-11 12:01:27 -07:00
Samuel Clay
1243060820 Handling poorly structure dates that result in an overflow error. 2016-04-18 16:20:16 -07:00
Samuel Clay
d845e151d0 Upgrading api/share_story to newer required_params api. 2015-12-22 19:28:31 -08:00
Samuel Clay
7cab8cc0e6 Using https as a scheme for all preview embeds. 2015-12-09 17:47:19 -08:00
Samuel Clay
9420924c1d Adding instagram, twitter, and imgur story embeds. 2015-12-09 15:11:32 -08:00
Samuel Clay
2275a4ba6c Sanity check for years. 2015-09-02 15:26:55 -07:00
Samuel Clay
9539228e20 Fixing stories with no title and only html for content (no text, just an image). Using permalink as title since a title cna't be extracted from content. 2014-09-05 10:38:29 -07:00
Samuel Clay
3b81c374d4 Rewriting search to use Elasticsearch across feeds. Much faster, just needs indexing. 2014-04-15 14:17:15 -07:00
Samuel Clay
ce434018fe Adding unread and focus API endpoints for IFTTT. Includes both feeds and folders. 2014-01-27 17:16:34 -08:00
Samuel Clay
f6b7a553be Merge branch 'master' into tagging
* master:
  Now forcing image sizing.
  Upgrading feedparser.
  Fixing RSS feed for blurblogs by using permalinks instead of guids.
  Treat 12:00am as occurring at the start of the day
  Adding monit for work server.
  Removing starred stories from mongo backups.
  Logic error.
  New algorithm for figuring out how long to renew.
2014-01-02 13:16:36 -08:00
Richard Fearn
4b84eddcd6 Treat 12:00am as occurring at the start of the day
Otherwise a story published at midnight today is displayed as
"Yesterday, 12:00am".
2013-12-27 16:53:49 +00:00
Samuel Clay
86131c5b3f Fixing timezone today/yesterday issue. 2013-11-22 11:15:16 -08:00
Samuel Clay
f6bd217eb3 Using timezone-aware relative dates (Today, Yesterdays). 2013-11-22 11:07:14 -08:00
Samuel Clay
a56f44cdef Rewriting short and long date formatting, both for server and ios. Also loading offline stories when server fails half-way through. 2013-11-22 11:06:24 -08:00
Samuel Clay
db74119842 Using timezone-aware relative dates (Today, Yesterdays). 2013-11-06 23:39:28 -08:00
Samuel Clay
496b6145bb Rewriting short and long date formatting, both for server and ios. Also loading offline stories when server fails half-way through. 2013-10-10 12:58:40 -07:00
Samuel Clay
88f2a69a93 Fixing a dozen text and feed fetching bugs. 2013-08-06 13:18:55 -07:00
Samuel Clay
fb710c870f Beginning of a long 16-day migration of feed's redis story ids into 30 day retention from 14 day retention. Once this migration is complete, can up the DAYS_OF_UNREAD to 30 day with no issues, except for updating scores. 2013-08-02 15:59:03 -07:00
Samuel Clay
4386b14beb Fixing broken content from RSS feed when summary is actually longer. 2013-07-16 11:59:52 -07:00
Samuel Clay
04442aa890 Fixing three random exceptions in feed fetching. 2013-05-31 17:14:17 -07:00
Samuel Clay
47c2257ef7 Using regular expressions for comment stripping, unless the feed has an error count, in which case switch to lxml. 2013-04-08 16:14:48 -07:00
Samuel Clay
639ad60ba1 Don't allow stories to come from more than 24 hours into the future. 2013-04-07 21:07:34 -07:00
Samuel Clay
681968033b Fixing broken JPG image sizer. 2013-04-04 17:49:38 -07:00
Samuel Clay
4cf2085ee7 Adding timeout to strip comments. 2013-04-03 18:16:52 -07:00
Samuel Clay
61fac02304 If requests.raw won't work, sut fudge it with a StringIO for now. 2013-03-19 17:49:56 -07:00
Samuel Clay
1854f719d3 Fixing Facebook image calculation. 2013-03-19 17:27:04 -07:00
Samuel Clay
63bd36212c Fixing feed fetcher to use updated date if the feed doesn't provide it otherwise. 2012-12-24 00:10:40 -08:00
Samuel Clay
2716d0c404 Cleaning up invalid story dates. 2012-12-10 15:48:05 -08:00
Samuel Clay
bea0b1da51 Fixing dateutil on broken dates. 2012-12-10 15:32:31 -08:00
Samuel Clay
a4267f423e Handling broken publish dates. 2012-12-10 15:31:39 -08:00
Samuel Clay
f33d46fe88 Better to push together than to spread apart. Diffing html is hard. 2012-11-20 09:54:23 -08:00
Samuel Clay
127d98b667 Experimental change to story diffing. Adding spaces back in. 2012-11-09 09:39:43 -08:00
Samuel Clay
68d12d8c24 Using a regex to remove comments. 2012-10-19 13:53:11 -07:00
Samuel Clay
e215082032 Handling invalid html when cleaning. 2012-10-19 13:36:57 -07:00
Samuel Clay
a23b830c06 Removing old lxml attr. 2012-10-19 13:35:05 -07:00
Samuel Clay
5ce475428f Stripping comments from all stories. This fixes the weird bug where '>more>' crap shows up. 2012-10-19 12:49:39 -07:00
Samuel Clay
4a7516cb83 Fixing a bunch of feed fetch errors. 2012-10-01 19:31:33 -07:00
Samuel Clay
ee72253695 Fixing these damn Link: text urls in story modifications. 2012-10-01 19:04:09 -07:00
Samuel Clay
668e78d5d2 Adding two new functions for stories: collect image sizes and grab original article text. Useful for future features. 2012-09-10 17:41:01 -07:00