help wanted
描述
This is a big undertaking. As a user, I'd like to be able to use my own local models to not be crippled by limitations of OpenAI models. The opensource model scene is getting huge and we want to support this as best as possible. The issue is, given we are a product first and foremost, connection to local models must work in both prod and dev and must be as simple as possible to setup.
One option is WindowAI: https://twitter.com/xanderatallah/status/1643356106670981122. This is an extension that will allow a site to connect to a model locally.
Before implementing anything, we should first investigate possibilities and report back in this issue.