Adding our own data to the PTH file or to the gglm BIN file

[FiveTechSoft]

I just asked this to chatGPT:

having an existing pytorch pth file that uses 32 layers, can we add the self attention values from a corpus of text with multiple sentences to it ?

chatGPT answered yes and provided the source code. Does that makes sense ? Is it a way to add our own data to the provided models ? could we do the same using the gglm BIN file ?

thanks