It takes a lot of computing power to pretend to be human.

The specs on this are absolutely insane:

It has 528 GPU tensor cores, supports up to 480GB of CPU RAM and 96GB of GPU RAM, and boasts a GPU memory bandwidth of up to 4TB per second.

  • awoo@burggit.moeEnglish
    3·
    1 year ago

    Here is hope that all the advancement trickles down to consumer hardware so we can selfhost better models. A future where only the tech giant got “own” the AI is no better than what we have now :/