Thx in advice.

  • kata1yst@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    3 months ago

    KobaldCPP or LocalAI will probably be the easiest way out of the box that has both image generation and LLMs.

    I personally use vllm and HuggingChat, mostly because of vllm’s efficiency and speed increase.

    • DarkThoughts@fedia.io
      link
      fedilink
      arrow-up
      3
      ·
      3 months ago

      It is probably dead but Easy Diffusion is imo the easiest for image generation.

      KoboldCPP can be a bit weird here and there but was the first thing that worked for me for local text gen + gpu support.