• Zeshade@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    11 months ago

    Well it depends what user experience and quality you are after. Some of Meta’s Llama 2 models require several GBs of GPU ram to run and be responsive.