phorge-phorge/resources/sql/autopatches/20180223.log.04.linemap.sql

ALTER TABLE {$NAMESPACE}_harbormaster.harbormaster_buildlog
  ADD lineMap LONGTEXT NOT NULL COLLATE {$COLLATE_TEXT};
As Harbormaster logs are processed, build a sparse map of byte offsets to line numbers Summary: Depends on D19138. Ref T13088. When we want to read the last part of a logfile //and show accurate line numbers//, we need to be able to get from byte offsets to line numbers somehow. Our fundamental unit must remain byte offsets, because a test can emit an arbitrarily long line, and we should accommodate it cleanly if a test emits 2GB of the letter "A". To support going from byte offsets to line numbers, compute a map with periodic line markers throughout the offsets of the file. From here, we can figure out the line numbers for arbitrary positions in the file with only a constant amount of work. Test Plan: Added unit tests; ran unit tests. Subscribers: PHID-OPKG-gm6ozazyms6q6i22gyam Maniphest Tasks: T13088 Differential Revision: https://secure.phabricator.com/D19139 2018-02-23 16:10:18 +01:00			`ALTER TABLE {$NAMESPACE}_harbormaster.harbormaster_buildlog`
			`ADD lineMap LONGTEXT NOT NULL COLLATE {$COLLATE_TEXT};`