cyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social · 2 days agoProposed bill to make it a crime to download DeepSeek in the USwww.congress.govexternal-linkmessage-square47fedilinkarrow-up1230arrow-down17
arrow-up1223arrow-down1external-linkProposed bill to make it a crime to download DeepSeek in the USwww.congress.govcyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social · 2 days agomessage-square47fedilink
minus-squaretrevor@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up2·17 hours agoNo worries. I’ve got some 20TB drives i can throw these on 😁 Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
minus-squarePup BirulinkfedilinkEnglisharrow-up1·11 hours agoyou can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)
No worries. I’ve got some 20TB drives i can throw these on 😁
Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
you can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)