The specs on this are absolutely insane:
It has 528 GPU tensor cores, supports up to 480GB of CPU RAM and 96GB of GPU RAM, and boasts a GPU memory bandwidth of up to 4TB per second.
You must log in or register to comment.
Here is hope that all the advancement trickles down to consumer hardware so we can selfhost better models. A future where only the tech giant got “own” the AI is no better than what we have now :/
