• GenderNeutralBro@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    104
    arrow-down
    3
    ·
    3 months ago

    Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

    Hmm.

    >locally hosted

    >Google Cloud

    Hmmmmmmmmmmmmmmmm.

    • SzethFriendOfNimi@lemmy.world
      link
      fedilink
      arrow-up
      44
      arrow-down
      1
      ·
      edit-2
      3 months ago

      Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.

      As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.

      • sugar_in_your_tea@sh.itjust.works
        link
        fedilink
        arrow-up
        2
        ·
        3 months ago

        Yeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.

    • Bitrot@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      25
      ·
      edit-2
      3 months ago

      It’s a thing.

      Remember how the cloud is someone else’s server? Now you can buy it (or lease) and bring it home, and it becomes only sorta someone else’s.

      Amazon and Azure offer their own on-prem products.

      • GenderNeutralBro@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        1
        ·
        3 months ago

        “Locally hosted” means it’s running on the local host. In this case, that would mean on the same computer running Firefox.

        Calling something that is only accessible over the internet “locally hosted” is outrageous doublespeak.

            • Bitrot@lemmy.sdf.org
              link
              fedilink
              English
              arrow-up
              9
              ·
              edit-2
              3 months ago

              If they had said “locally hosted in our datacenter” would you be confused why they didn’t move a rack into your house?

              My question is why are you projecting your limited interpretation as a global truth?

              • Mr. Satan@monyet.cc
                link
                fedilink
                arrow-up
                6
                arrow-down
                1
                ·
                3 months ago

                In IT context local is a well establised term. It’s either hosted locally, i. e. on machine running the browser or not. A datacenter or cloud are remote machines also by the same well established definition.

              • LWD@lemm.ee
                link
                fedilink
                arrow-up
                4
                ·
                3 months ago

                The language is confusing, and Mozilla should fix it themselves.

                The important takeaway is: data is sent over an IP address controlled by Google, to a remote server, running Google software. No processing is taking place on someone’s local computer.

              • GenderNeutralBro@lemmy.sdf.org
                link
                fedilink
                English
                arrow-up
                3
                ·
                3 months ago

                If they had said “locally hosted in our datacenter”

                Then that would also be an oxymoron.

                Local is the opposite of remote. This is a remote server. Remote servers are not local. This is not a matter of interpretation.

                • Bitrot@lemmy.sdf.org
                  link
                  fedilink
                  English
                  arrow-up
                  3
                  arrow-down
                  1
                  ·
                  edit-2
                  3 months ago

                  It is, actually. It is local to them, it is remote to you. They are differentiating from a remote server in someone else’s datacenter. It is not that confusing.

                  • GenderNeutralBro@lemmy.sdf.org
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    edit-2
                    3 months ago

                    This is a FAQ for end users, about a feature in software running on end users’ computers.

                    It is absolutely doublespeak to call it “local”. Are we supposed to invent an entirely new term now to distinguish between remote and local? Please do not accept this usage. It will make meaningful communication much harder.

                    Edit: I mean seriously, by this token OpenAI, Google, Facebook, etc. could call their servers “locally hosted”. It is an utterly meaningless term if you accept this usage.

      • smpl@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 months ago

        lol, I think we’re giving too little credit to the marketing people in tech. I want to read their blogs!

      • LWD@lemm.ee
        link
        fedilink
        arrow-up
        1
        ·
        3 months ago

        Information We Share.

        We use third parties to provide the Service to you, and have contracted with these companies requiring them to protect your information (Third-Party Services):

        Google Cloud Platform. Google Cloud Platform (GCP) is a cloud-computing platform. We use GCP to manage services that facilitate responses to user prompts and page summarization.

        https://orbitbymozilla.com/privacy