Every release from kobold has me hyped one of the nicest engines that balances cutting edge features with ease of use and optimization. This is gonna be a great year for LocalLLaMA Hype :)

https://github.com/LostRuins/koboldcpp/releases

  • projectmoon@forum.agnos.is
    link
    fedilink
    arrow-up
    1
    ·
    22 hours ago

    Is the KoboldCPP UI a bit better these days? Or maybe it’s best to hook it up as an OpenAI connection via OpenWebUI… I mostly use it with ollama.

    • SmokeyDope@lemmy.worldOPM
      link
      fedilink
      English
      arrow-up
      1
      ·
      17 hours ago

      I don’t know how old the last version of kobold you used was or what it looked like. The newest verion has a couple different web UI themes to pick from in settings, the basic one has more buttons for easier editing, the corpo one is pretty sleek for phones and tablets. They finally have a terminal mode if you are running on headless servers.

    • SmokeyDope@lemmy.worldOPM
      link
      fedilink
      English
      arrow-up
      8
      ·
      edit-2
      8 days ago

      What?? Nooo of course not. I mean who would even have things to awaken in the first place, that would be crazy am I right? Not you or me thats for sure. Anyways all im saying is that whatever happens between you and your local kobold stays between you two. Everyone is welcome to come now and join LocalLLaMA today!

      Ooops, looks like someone acidentally dropped all these unrelated pictures under my comment just now. Oh well, better leave them all here in case they come back for them.