Methodology for incremental index and external sorting

[cmdcolin]

Potentially the streaming data could be combined with the existing index (ix file), re-sorted, and then outputted to the ix file, and then ixx created

The naive approach to do this all in memory would probably work in most cases but may not be uber scalable, but could be a good first approach