Remove extraneous Allocations

[hv10]

If we make a copy of the input x first, we can then operate on that copy in-place using views.
I think the code I have written plays it too safe with the write-accesses to x - by creating the needed parts as new zero-initialized-arrays.

We may get away with not doing that and gaining some sizable speedups.