Strange that they don't just use an open weights model; there are several now that surpass ChatGPT 3.5, which is probably good enough for what they need.
this post was submitted on 16 Dec 2023
89 points (94.1% liked)
Technology
59416 readers
2765 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Might be that they started training before those open models were available. Or they were just lazy and OpenAI's API was easier.
What models have u foubd to surpass 3.5? Any outpaced gpt4 yet?
Mistral 7B and deepseek-ai are two open-weight models that surpass 3.5, though not 4, on several measures.
Mixtral 8x7B, just out. Codes better than ChatGPT in the few prompts I've done so far, and I can run it at 2 to 3 tokens per second on my GPU-less laptop.
This is the best summary I could come up with:
TikTok’s entrancing “For You” feed made its parent company, ByteDance, an AI leader on the world stage.
But that same company is now so behind in the generative AI race that it has been secretly using OpenAI’s technology to develop its own competing large language model, or LLM.
This practice is generally considered a faux pas in the AI world.
It’s also in direct violation of OpenAI’s terms of service, which state that its model output can’t be used “to develop any artificial intelligence models that compete with our products and services.” Microsoft, which ByteDance is buying its OpenAI access through, has the same policy.
Nevertheless, internal ByteDance documents shared with me confirm that the OpenAI API has been relied on to develop its foundational LLM, codenamed Project Seed, during nearly every phase of development, including for training and evaluating the model.
Employees involved are well aware of the implications; I’ve seen conversations on Lark, ByteDance’s internal communication platform for employees, about how to “whitewash” the evidence through “data desensitization.” The misuse is so rampant that Project Seed employees regularly hit their max allowance for API access.
The original article contains 187 words, the summary contains 187 words. Saved 0%. I'm a bot and I'm open source!