Patch excessive memory use in `to_ndarray`

to_ndarray was requesting the full volume in memory which should never be done.