Technically I could upgrade my desktop to 192GB of memory (4x48). That’s still only about half the amount required for the largest BLOOM model, for instance.
To go beyond that today, you’d need to move beyond the Intel Core or AMD Ryzen platforms and get something like a Xeon. At that point you’re spending 5 figures on hardware.
I know you’re just joking, but figured I’d add context for anyone wondering.
Wait, you guys don’t already have hundreds of gigabytes of memory?
Technically I could upgrade my desktop to 192GB of memory (4x48). That’s still only about half the amount required for the largest BLOOM model, for instance.
To go beyond that today, you’d need to move beyond the Intel Core or AMD Ryzen platforms and get something like a Xeon. At that point you’re spending 5 figures on hardware.
I know you’re just joking, but figured I’d add context for anyone wondering.
Don’t worry about the RAM. Worry about the VRAM.
Google drive is my swap space