Split Ferret engine strings for tokenization on any sequence of whitespace

Summary:
Ref T12819. Currently, strings are split only on spaces, but newlines (and, if they exist, tabs) should also split strings.

Without this, we can fail to get the proper term boundary tokens for words which begin at the start of a line or end at the end of a line.

Test Plan: Reindexed a document with "xyz\nabc", saw `"yz "` and `" ab"` term boundary tokens generate properly.

Reviewers: chad

Reviewed By: chad

Maniphest Tasks: T12819

Differential Revision: https://secure.phabricator.com/D18579

src/applications/search/ferret/PhabricatorFerretEngine.php

@@ -75,7 +75,7 @@ abstract class PhabricatorFerretEngine extends Phobject {
 
   public function tokenizeString($value) {
     $value = trim($value, ' ');
-    $value = preg_split('/ +/', $value);
+    $value = preg_split('/\s+/u', $value);
     return $value;
   }