epriestley 0e2e525bb4 Add a "terms" corpus to Ferret fields ... Summary: Ref T12819. Ferret currently does substring search, but this is not the default mode users expect: when you search for the "RICO" act, you do not expect to find documents containing "apRICOt" even though "RICO" is a substring. To support term search, index the corpus as a list of terms with puncutation removed and whitespace normalized so the engine can match against it. Test Plan: Ran `storage upgrade`, ran `search index`, saw sensible database results: ``` rawCorpus: This is the task description. Hark! Whom'st'dve eaten this "food" shall surely ~perish~?? #blessed normalCorpus: thi the task descript hark whom dve eaten food shall sure perish bless termCorpus: This is the task description Hark Whom'st'dve eaten this food shall surely perish blessed ``` Reviewers: chad Reviewed By: chad Maniphest Tasks: T12819 Differential Revision: https://secure.phabricator.com/D18498		2017-08-30 11:29:14 -07:00
..
autopatches	Add a "terms" corpus to Ferret fields	2017-08-30 11:29:14 -07:00
patches	Migrate Project status to modular transactions	2017-05-18 11:36:13 -07:00
quickstart.sql	Regenrate Quickstart SQL	2017-04-23 11:04:02 -07:00
stopwords.txt
stopwords_myisam.txt	Show users how fulltext search queries are parsed and executed; don't query stopwords or short tokens	2017-04-12 19:07:54 -07:00