wargreymon@sh.itjust.works to Machine Learning@lemmy.ml · 23 days agoCan gpt generate a gpt model?message-squaremessage-square5fedilinkarrow-up18arrow-down13file-text
arrow-up15arrow-down1message-squareCan gpt generate a gpt model?wargreymon@sh.itjust.works to Machine Learning@lemmy.ml · 23 days agomessage-square5fedilinkfile-text
minus-squareAudalin@lemmy.worldlinkfedilinkEnglisharrow-up5·23 days agoYou can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that’s about it.
minus-squareBaldur Nil@programming.devlinkfedilinkarrow-up2·22 days agoYep, this is called model distillation.
You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that’s about it.
Yep, this is called model distillation.