Loading "unaligned" models with proper alignment

[iacore]

It's possible to call mmap(2) on each tensor separately. This will make every tensors aligned no matter how they are placed in a file.

-- written in case this feature is needed in the future

[KerfuffleV2]

I actually had that idea too.

Unfortunately, the offset parameter in mmap generally has to be a multiple of the page size. Quoting the man page on Linux: "Most implementations require that off and addr are multiples of the page size as returned by sysconf()."

[iacore]

this is sad