Slow June, people voting with their feet amid this AI craze, or something else?

  • festus@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Look into llama.cpp - it’s a single C++ program that run quantified models (basically models with some less precision - don’t need a full 64 bits for a double, really). As for models to run on it, there’s so many but I think WizardLM is pretty good.