I don’t get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit
I don’t get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit
Personally speaking, the issue isn’t I don’t want to rely on them, it’s that I can’t use them for my use case because it’d be a HIPPA violation.
The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.