• a1studmuffin 🇦🇺
    link
    fedilink
    arrow-up
    9
    ·
    11 months ago

    I’m surprised we haven’t seen TPU cards (think Coral AI but at a larger scale) being made and sold for this purpose, especially if they’re faster and more energy efficient at AI-oriented tasks than GPUs.

    • You999@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      11 months ago

      Well there is the asus AI Accelerator card but that’s just 8 coral TPUs. I think the real reason why we don’t see large TPUs is because nvidia cards has had tensor cores built into the architect since Volta and with a GPU you don’t have to worry about system memory speed since you have 80Gb of HBM.