I would be happy to, but all current local models are vastly inferior to GPT-3.5. The unfortunate reality is that if you want to create anything high quality, you must use the OpenAI API.
9
Simon Willison’s LLM CLI tool now supports self-hosted language models via plugins
(simonwillison.net)
It isn’t available outside the US and the UK, so I can’t try it yet, but I will as soon as I get access.
@AutoTLDR
Ethan Mollick has two recent articles related to this topic:
@AutoTLDR the other bot talks too much, please summarize this
@[email protected] could you please compare the advantages and disadvantages of having a general-purpose chatbot available in an online forum that can answer any questions, whether relevant to the conversation or not?
AFAIK it doesn’t. But I haven’t got access to it yet, so this is based on tweets by some people who have.
view more: next ›
It would summarize the link. Unfortunately that’s an edge case where the bot doesn’t do what you mean.