Commit graph

91 commits

Author SHA1 Message Date
Samuel Clay
1065c964fd Fixing elasticsearch to allow consul to assume its OK. 2022-12-26 19:17:14 -05:00
Samuel Clay
926a3f0841 Another Elasticsearch More Like This implementation, but it still doesn't surface anything close to correct. 2022-05-05 14:26:00 -04:00
Samuel Clay
02472c959e Elasticsearch should ignore types by default. 2021-10-26 10:34:43 -04:00
Samuel Clay
c2ef587aa3 ES 7 uses a non-simple analyzer. 2021-09-12 14:46:55 -04:00
Samuel Clay
5d0639b0a8 Upgrading ES on staging. 2021-08-13 12:14:09 -04:00
Samuel Clay
8fe8885059 Removing boost from ES. 2021-08-13 12:07:02 -04:00
Samuel Clay
14e3d6dd25 Fixing broken requirements.txt, downgrading pymongo to 3.6, since monitoring was changed and we're not ready for it yet. 2021-07-02 12:42:02 -04:00
Samuel Clay
311d55a2b4 Fixing refresh_feeds to use GET/POST. Fixes issues with unread counts not updated. 2021-04-29 15:21:25 -04:00
Samuel Clay
46f2562631 Stories-type and story-type 2021-04-29 10:13:16 -04:00
Samuel Clay
5325ea57d1 Don't delete search stories without doc type on ES 1.7. 2021-04-29 10:08:01 -04:00
Samuel Clay
414d09c9b0 No doc type for stories on docker, which uses elasdticsearch 7, which no longer supports doc types. Prod still needs them because it's on ES 1.7. 2021-04-27 20:55:20 -04:00
Samuel Clay
34c9ee712c Fixing search on docker. Also setting up docker installs to always have active subscribers so feeds are never stale. 2021-04-27 20:49:10 -04:00
Samuel Clay
b89b599ae9 Fixing feed search 2021-04-27 20:10:21 -04:00
Samuel Clay
a22ce16a0e Attempting to handle mistaken week where stories were inserted with no doc type. 2021-04-27 15:25:46 -04:00
Samuel Clay
c1883dd366 Typo 2021-04-27 15:18:29 -04:00
Samuel Clay
68e23924af Adding doc type even for search deletes. 2021-04-27 15:17:42 -04:00
Samuel Clay
b700c0f85e Already indexed story warning. 2021-04-27 15:14:40 -04:00
Samuel Clay
cc0fe8bee1 Adding doc type for both stories and feeds. 2021-04-27 15:12:19 -04:00
Samuel Clay
5b7f981b52 Adding doc type to ES. 2021-04-27 15:10:48 -04:00
Samuel Clay
9466f336e4 Switching from pyelasticsearch to elasticsearch. 2021-04-27 15:00:52 -04:00
Samuel Clay
a33a123621 Handling elasticsearch timeout. 2021-04-09 22:38:21 -04:00
Samuel Clay
fc69c0c8b9 Dashboard shouldnt truncate stories. Also handling missing elasticsearch more gracefully. 2021-04-06 15:51:26 -04:00
Samuel Clay
02138db5ca Switching from elasticsearch and dsl to pyelasticsearch. Feed autocomplete still doesn't work yet. 2021-03-24 21:09:26 -04:00
Samuel Clay
3e61c5e907 Feed autocomplete is trnaslated to elasticsearch 7, but doesn't work quite yet. 2021-03-23 15:30:44 -04:00
Samuel Clay
fb322a6573 Querying works but returns wrong results. 2021-03-19 12:22:28 -04:00
Samuel Clay
f45b19ed77 Changing from static class var to instantiate once. 2021-03-19 11:28:47 -04:00
Samuel Clay
f797133943 Fixing indexing of documents on ES 7. Now just to get querying working. 2021-03-18 19:01:24 -04:00
Samuel Clay
e1b2583950 Swapping out pyes for elasticsearch-py. Half-way done, got indices and mappings in, now need to work on querying and storing. 2021-03-18 16:34:28 -04:00
Samuel Clay
05afdce691 Fixing search indexing. Also removing superfluous search_indexer_tasker queue. 2021-03-03 17:04:05 -05:00
Samuel Clay
f99ae77789 Fixing broken search indexer tasker and its synchronous subtasks. It's ok because MUserSearch.index_subscriptions_for_search is only called for a task itself. 2021-03-03 14:28:09 -05:00
Samuel Clay
a1f4d67d27 Changing how tasks are called. 2021-01-06 14:42:24 -05:00
Samuel Clay
05756155b1 Merge branch 'django3.0' into docker_django3.0
* django3.0: (184 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 13:04:39 -05:00
Samuel Clay
8371c635f7 Merge branch 'master' into django2.0
* master: (27 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 09:09:25 -05:00
Samuel Clay
fca0f68761 Fixing search indexer background task for new celery. 2020-12-07 16:36:17 -05:00
Jonathan Math
89e51a2937 change celery Task import and task initialization as per the new version of celery 2020-10-05 00:45:20 +07:00
jmath1
93b5b87ff6 2to3 apps/search/ 2020-06-15 05:23:10 -04:00
Samuel Clay
4f1fdbb8bf Allowing exact quoted searches. 2017-01-08 19:45:53 -08:00
Samuel Clay
a44fea12ff Merge branch 'mongo3'
* mongo3:
  Adding work/search to maintenance. Adding index to starred stories.
  Using new delete_many
  Upgrading to mongo 3.0. Still needs fixes for mongoengine.
2016-11-10 17:24:54 -08:00
Samuel Clay
ea4d0b9b48 Fixing InvalidQuery 2016-11-10 13:29:17 -08:00
Samuel Clay
7dee3ae771 Upgrading to mongo 3.0. Still needs fixes for mongoengine. 2016-11-10 10:11:46 -08:00
Samuel Clay
ce3cdd0919 Global search 2016-10-06 14:38:24 -07:00
Samuel Clay
da47ccfd16 Handling broken pyes search queries. 2016-05-26 14:52:42 -07:00
Samuel Clay
dccdbcba14 Fixing token errors on searches. 2016-01-07 19:16:39 -08:00
Samuel Clay
2eb3218094 Adding Add URL button to site search on dashboard. Thanks to Brian Johns for the suggestion. 2015-08-17 18:06:29 -07:00
Samuel Clay
dc21564e39 Easing UPDATE when recounting. Also updating hugepages in postgres. 2015-07-30 18:14:12 -07:00
Samuel Clay
cbf2bc6150 Upping search minimums. 2015-07-30 16:48:11 -07:00
Samuel Clay
9a06d44341 Matching full URLs when searching for a feed. 2015-07-30 16:36:06 -07:00
Samuel Clay
bb93d0bccd Dropping story search index first when clearing all user searches. 2015-07-30 13:30:53 -07:00
Samuel Clay
1bea85051c Speeding up user search feed removal. 2015-07-30 13:13:28 -07:00
Samuel Clay
b8547a6e40 Speeding up user search feed removal. 2015-07-30 13:10:42 -07:00