Commit graph

69 commits

Author SHA1 Message Date
Samuel Clay
02138db5ca Switching from elasticsearch and dsl to pyelasticsearch. Feed autocomplete still doesn't work yet. 2021-03-24 21:09:26 -04:00
Samuel Clay
3e61c5e907 Feed autocomplete is trnaslated to elasticsearch 7, but doesn't work quite yet. 2021-03-23 15:30:44 -04:00
Samuel Clay
fb322a6573 Querying works but returns wrong results. 2021-03-19 12:22:28 -04:00
Samuel Clay
f45b19ed77 Changing from static class var to instantiate once. 2021-03-19 11:28:47 -04:00
Samuel Clay
f797133943 Fixing indexing of documents on ES 7. Now just to get querying working. 2021-03-18 19:01:24 -04:00
Samuel Clay
e1b2583950 Swapping out pyes for elasticsearch-py. Half-way done, got indices and mappings in, now need to work on querying and storing. 2021-03-18 16:34:28 -04:00
Samuel Clay
05afdce691 Fixing search indexing. Also removing superfluous search_indexer_tasker queue. 2021-03-03 17:04:05 -05:00
Samuel Clay
f99ae77789 Fixing broken search indexer tasker and its synchronous subtasks. It's ok because MUserSearch.index_subscriptions_for_search is only called for a task itself. 2021-03-03 14:28:09 -05:00
Samuel Clay
a1f4d67d27 Changing how tasks are called. 2021-01-06 14:42:24 -05:00
Samuel Clay
05756155b1 Merge branch 'django3.0' into docker_django3.0
* django3.0: (184 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 13:04:39 -05:00
Samuel Clay
8371c635f7 Merge branch 'master' into django2.0
* master: (27 commits)
  Removing log override
  Moving logging over to the newsblur log.
  Fixing search indexer background task for new celery.
  Attempting to add gunicorn errors to console/log.
  Better handling of missing subs.
  Handling missing user sub on feed delete.
  Correct encoding for strings on systems that don't have utf-8 as default encoding.
  Writing in the real urllib3 dependency for requests.
  Upgrading requests due to urllib3 incompatibility.
  Login required should use the next parameter.
  Upgrading django oauth toolkit for django 1.11.
  Handling newsletters with multiple recipients.
  Extracting image urls sometimes fails.
  Handling ajax errors in json views.
  Adding timeouts to most outbound requests.
  Sentry SDK 0.19.4.
  Removing imperfect proxy warning for every story.
  Found four more GET/POST crosses.
  Feed unread count may need a POST.
  Namespacing settings.
  ...
2020-12-08 09:09:25 -05:00
Samuel Clay
fca0f68761 Fixing search indexer background task for new celery. 2020-12-07 16:36:17 -05:00
Jonathan Math
89e51a2937 change celery Task import and task initialization as per the new version of celery 2020-10-05 00:45:20 +07:00
jmath1
93b5b87ff6 2to3 apps/search/ 2020-06-15 05:23:10 -04:00
Samuel Clay
4f1fdbb8bf Allowing exact quoted searches. 2017-01-08 19:45:53 -08:00
Samuel Clay
a44fea12ff Merge branch 'mongo3'
* mongo3:
  Adding work/search to maintenance. Adding index to starred stories.
  Using new delete_many
  Upgrading to mongo 3.0. Still needs fixes for mongoengine.
2016-11-10 17:24:54 -08:00
Samuel Clay
ea4d0b9b48 Fixing InvalidQuery 2016-11-10 13:29:17 -08:00
Samuel Clay
7dee3ae771 Upgrading to mongo 3.0. Still needs fixes for mongoengine. 2016-11-10 10:11:46 -08:00
Samuel Clay
ce3cdd0919 Global search 2016-10-06 14:38:24 -07:00
Samuel Clay
da47ccfd16 Handling broken pyes search queries. 2016-05-26 14:52:42 -07:00
Samuel Clay
dccdbcba14 Fixing token errors on searches. 2016-01-07 19:16:39 -08:00
Samuel Clay
2eb3218094 Adding Add URL button to site search on dashboard. Thanks to Brian Johns for the suggestion. 2015-08-17 18:06:29 -07:00
Samuel Clay
dc21564e39 Easing UPDATE when recounting. Also updating hugepages in postgres. 2015-07-30 18:14:12 -07:00
Samuel Clay
cbf2bc6150 Upping search minimums. 2015-07-30 16:48:11 -07:00
Samuel Clay
9a06d44341 Matching full URLs when searching for a feed. 2015-07-30 16:36:06 -07:00
Samuel Clay
bb93d0bccd Dropping story search index first when clearing all user searches. 2015-07-30 13:30:53 -07:00
Samuel Clay
1bea85051c Speeding up user search feed removal. 2015-07-30 13:13:28 -07:00
Samuel Clay
b8547a6e40 Speeding up user search feed removal. 2015-07-30 13:10:42 -07:00
Samuel Clay
473bc3a6c1 Adding sub sort. Last fix and ready to deploy! 2015-07-30 12:52:55 -07:00
Samuel Clay
21771db8dc Removing minimum should match. 2015-07-30 12:47:44 -07:00
Samuel Clay
40a1692a09 Further refining feed search. Upgrading to elasticsearch 1.7.1. 2015-07-30 11:51:21 -07:00
Samuel Clay
1d39cca557 Fixed search indexing and querying for feeds. Finally! 2015-07-29 22:04:34 -07:00
Samuel Clay
0dda4d6e10 Cleaning up feed search, but still broken. 2015-07-17 14:47:22 -07:00
Samuel Clay
b51a054c1c Upgrading elasticsearch to 1.7.0, pyes to 0.99.5, and modern querying for stories. Needs a reindex. Still need to do feeds. 2015-07-17 14:01:38 -07:00
Samuel Clay
a856a21e7c Adding export csv. 2015-07-14 16:20:46 -07:00
Samuel Clay
76b93aa795 Removing dev from fabfile hosts. Also fixing db motd. 2015-06-14 22:20:47 -07:00
Samuel Clay
12ab79325a Turning off source:false in feed ES. 2015-05-06 22:36:43 -07:00
Samuel Clay
2171da62ef Handling deleted users on search removal. 2015-01-10 12:03:44 -08:00
Samuel Clay
4924840754 Updating search index removal to fix broken search server. 2015-01-10 12:01:29 -08:00
Samuel Clay
58d2bfdd64 Don't barf if no search server available. 2014-05-15 12:24:28 -07:00
Samuel Clay
fd030cd6b2 Limiting feed search to 1000 feeds. 2014-05-05 13:32:44 -07:00
Samuel Clay
eac58cdc22 Indexing newly added feeds for users who need it. 2014-04-23 16:12:30 -07:00
Samuel Clay
de4e6412c9 Launching search (quietly). 2014-04-23 15:05:47 -07:00
Samuel Clay
9067a22627 Blacking out search indexing. 2014-04-23 12:29:07 -07:00
Samuel Clay
74e7bfb2c9 Forcing read pref on user search check. 2014-04-23 11:33:56 -07:00
Samuel Clay
28d51309ce Blacking out search indexing again. 2014-04-23 11:26:42 -07:00
Samuel Clay
1f299eb941 Turning indexing on. 2014-04-22 18:37:32 -07:00
Samuel Clay
0d5eb96ade Parallelizing search indexing. Adding task to handle parallelization. 2014-04-22 18:33:08 -07:00
Samuel Clay
6290824422 Adding story tags to search index. 2014-04-22 15:16:00 -07:00
Samuel Clay
e2b94c6839 Blackout for new search, forcing non-staff to continue using old search. 2014-04-22 12:39:09 -07:00