Both Ubuntu and Fedora have made it official: support is coming soon for running local generative AI instances.

An epic and still-growing thread in the Fedora forums states one of the goals for the next version: the Fedora AI Developer Desktop Objective. It is causing some discontent, and at least one Fedora contributor, SUSE’s Fernando Mancera, has resigned.

  • SlicedPotato@feddit.dk
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    11
    ·
    16 hours ago

    Soooo, which distro to switch to next? Or are they all gonna go down this route eventually? Maybe I’ll try a *BSD for once.

      • woelkchen@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        12 hours ago

        Debian or anything based directly on it

        Debian can also run AI models. Pretty dumb reason to get mad about.

        • yessikg@fedia.io
          link
          fedilink
          arrow-up
          9
          arrow-down
          1
          ·
          12 hours ago

          Every linux distro can run AI models, there is 0 reason to support distros that ship with AI bullshit by default

          • woelkchen@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 hours ago

            It’s not by default there. It’s a dedicated spin to self host an LLM. That’s completely different from Windows does with Copilot.

    • rozodru@piefed.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      14 hours ago

      pretty much anything that is “you build it youself” so Arch, NixOS, Gentoo, etc

      but yeah I’m also tempted to finally give BSD a go.

        • badgermurphy@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          11 hours ago

          SystemD does something everyone uses, though. Many may prefer other methods, but systemD still does cover the need for init, logging, and system control, which everyone with a PC does need.

          LLMs are useful to only a subset of users, so including it in general distribution is waste, because many people will end up with this software that was downloaded, installed, and maintained by someone, but they never use at all. It may not be actively using their RAM, but it is still using their disk space and has dependencies that may load whether or not it is run.

          In a time of grievous constraint on hardware availability, that kind of waste is literally impossible to tolerate for many, and will force users to fewer distro choices, so they do have skin in the game and grounds to make their voices heard.

          • FauxLiving@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            9 hours ago

            LLMs are useful to only a subset of users, so including it in general distribution is waste, because many people will end up with this software that was downloaded, installed, and maintained by someone, but they never use at all.

            That’s absolutely untrue in this case.

            If you read the article (the headline text is a link to an article) you would see that they specifically address this:

            -AI tools will not be added to Fedora’s existing system images, Editions, etc, by the AI Desktop initiative.

            It won’t be included in the general distribution. They’re talking about a new system image that someone would have to choose to install.

            • badgermurphy@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              8 hours ago

              There seems an epidemic around here of this phenomenon where, when discussing an article or other set of information, additional context, even when already brought up or requested, is regarded as not germane to the discussion.

              I did read the article, as well as most of the other comments in this thread, some of which were referring to the “creep” effect of undesirable tools into other places once they get into some of the main places. That’s what I am referring to. If you don’t want to participate in that branch of the discussion, that’s an option, as is even a drive-by down vote.

              Scolding me for not rigidly sticking within the scope of the topic that started the conversation, even after the topic has drifted or broadened, seems not only counterproductive, but a waste of your time.

    • RedstoneValley@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      ·
      15 hours ago

      I switched from Kubuntu to CachyOS last week, after 10 years or so. CachyOS is based on Arch, and did not disappoint so far, extremely fast, makes Ubuntu look old and sluggish. It’s really impressive. The basic installation was easy. The GUI package manager isn’t as polished but works. A little bit of terminal tweaking was required to install some packages (VMM and KRDC gave me some trouble) but the documentation was ok. Absolutely can recommend.

      • ag10n@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        14 hours ago

        Cachy is a nice mix of latest and stable. Still recommend Debian for work, but Cachy is great if you want something that just works

        • rozodru@piefed.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          14 hours ago

          I’ve used PikaOS which is Debian based and IMHO it’s right up there with CachyOS. super fast install, fast distro, great package manager, and repos with the latest stuff. very stable too.