My current PC specs:
- Dell Precision T1700 Motherboard
- Xeon E3 1275 v3
- 32GB DDR3 1600Mhz ECC
- 7900 XTX 24GB VRAM (Transferring to new PC)
What I want in my next PC:
- MSI Z790-P Motherboard (with Dasharo)
- i9-14900k
- DDR5 192GB 5600Mhz (Non-ECC)
- 7900 XTX 24GB VRAM
Will I see any performance increase? I’m also worried about not having ECC RAM, I will be coding a lot with my LLMs (firmware development), so part of me doesn’t want to make any mistakes and future proof. I heard DDR5 has some ECC-like features, but not the same as traditional ECC. Maybe I should buy a Dell Precision 3630 motherboard which has support for upto 128GB DDR4 ECC memory? This is a dedicated LLM PC, so, not too concerned about gaming or anything.
I would like to hear your suggestions!
Have you looked into specialized AI chips/accelerators at all if you really want to mess with it?
Way lower end than what you’re working with, but they have AI accelerator kits for something as small as a Raspberry Pi.
You are limited by bandwidth not compute with llm, so accelerator won’t change the interferance tp/s