• 4 Posts
  • 152 Comments
Joined 1 year ago
cake
Cake day: September 24th, 2023

help-circle

  • RachelRodent@lemmy.dbzer0.comtoSelfhosted@lemmy.worldUses for local AI?
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    2
    ·
    edit-2
    3 months ago

    the answer is very spesific to ur pc and amount of vram you have availşble to you. But anything lama 3 even 8b models finetuned to DM or write stories should theoritically work. The other reply that reccomends connecting to another program to make sure rules are consistent sounds like a great idea whşch I have not tried. I use silly tavern as the ui whşch has lots of options and shit to mske thşngs wkrk well. I would reccomend goşng şnto the “KoboldAI” discord and askşng şn the support sectşon folk there are very helpfull sorry for not beşng able to gşve a strsight answer Also boost the context size way up that shit makes dşfference I habe like 16k or sumthin. good luck!



















  • First of all Fedora is a great distro and I do suggest it if you like it, otherwise I suggest Nobara(fedora based) or Pop_OS(ubuntu LTS based) as they both have iso’s that come with nvidia drivers pre installed. Nobara has steam pre installed too.

    (quick note about Nobara: beside pretty much being Fedora customized(and optimized) for gaming and made more user friendly it is maintained by only one devoloper. This person is the creator of the popular proton version ProtonGE and a Red Hat employee, “Glorious Eggroll” and it is still FOSS so trust shouldn’t be an issue BUT due to the small number of maintainers it is more likely to break and should be considered somewhat experimental, despite this it is my daily driver and fave distro)

    I use wayland just fine with an rtx 3060 but it js unstable for many othera and you can choose witch session you wanna boot into (x11 or wayland) on the login screen so that shouldn’t be problem to find which works the best for you

    I Mod FNV and FO4 using MO2 on linux it works fine but the initial set up was a little painfull.

    Steam should work fine both as native package and Flatpak. and proton works with any distro

    Many games with anticheat work with linux and many don’t you can check your games on areweanticheatyet.com