epriestley 0e2e525bb4 Add a "terms" corpus to Ferret fields ... Summary: Ref T12819. Ferret currently does substring search, but this is not the default mode users expect: when you search for the "RICO" act, you do not expect to find documents containing "apRICOt" even though "RICO" is a substring. To support term search, index the corpus as a list of terms with puncutation removed and whitespace normalized so the engine can match against it. Test Plan: Ran `storage upgrade`, ran `search index`, saw sensible database results: ``` rawCorpus: This is the task description. Hark! Whom'st'dve eaten this "food" shall surely ~perish~?? #blessed normalCorpus: thi the task descript hark whom dve eaten food shall sure perish bless termCorpus: This is the task description Hark Whom'st'dve eaten this food shall surely perish blessed ``` Reviewers: chad Reviewed By: chad Maniphest Tasks: T12819 Differential Revision: https://secure.phabricator.com/D18498		2017-08-30 11:29:14 -07:00
..
__tests__	Add a "terms" corpus to Ferret fields	2017-08-30 11:29:14 -07:00
PhabricatorNgramEngine.php	Add a "terms" corpus to Ferret fields	2017-08-30 11:29:14 -07:00
PhabricatorSearchNgrams.php	Implement basic ngram search for Owners Package names	2015-12-22 08:00:33 -08:00