I wonder if higher quality datasets are the future rather than using tons of internet scraped texts. Either way, neat model!

  • Behohippy@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    Bad article title. This is the “Textbooks are all you need” paper from a few days ago. It’s programming focused and I think Python only. For general purpose LLM use, LLaMA is still better.