Ryzen 5900X, 64 gig DDR4-3200, 2tb ssd,10tb hdd and an RTX2070. Hosting Stable Diffusion, various llama.cpp instances with python bindings, jellyfin, sonarr, multiple modded minecraft servers, and a network file share.

  • Late_Settler@lemmy.ca
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    Certainly blows my collection of old junk out of the water.

    Has running Stable Diffusion had a big impact on the other stuff running? I’m thinking the Minecraft servers in particular.

    • Behohippy@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      SD mostly uses the GPU, so it’s pretty light on everything else. The largest process is probably web-chat-ui with Wizard-30b model running.

  • proycon@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    Nice, you must be into deep learning with such a setup, any particular reason the deep deep learning models and GPU run in your server rather than in a powerful desktop system? Maybe you’re actively offering AI services to the outside world?

    • azuth@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      It is a powerful desktop system as in it’s housed in a desktop case and uses a “non-server” CPU.

      Which like any computer can be a server. Being a server is more of a role than a form factor even if there are form factors specifically aimed at servers (rack mounted).

    • Behohippy@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      1 year ago

      Wow, a reply I made in another community ended up under this one. Yeah I’m doing a lot of work on local models and text embedding models for vector search.

    • Behohippy@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Yup, mostly running pretrained models for text embedding and some generative stuff. No real fine tuning.

  • Alpagu@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I’m very ignorant about it. I wonder if I can buy a cheap computer and turn it into a server that I can only use by keeping it on all the time?