"Copying isn't stealing."

Their take on it, via Sam Altman, is that the AI is reading and learning from the internet and we can’t fault them for that, right? You don’t fault a human from using what they’ve learned, do you? Is the rationale… I don’t know what I think about it though

Ever since that paper about "model decay" this has been a common talking point and it's greatly misunderstood. Yes, if you just repeatedly cycle content through AI training over and over through successive generations, you get AIs that lose "fidelity." But that's not what any actual real world training regimen using synthetic data does. The helper AI is usually used to process input data. For example, if you're training an AI to respond in a chat-like format, you could take raw non-conversational text (like a book) and have the helper AI create a conversation about that content for the new AI to learn from. Or to take a real-world example, Dalle3 was trained by having a helper AI look at pictures and create detailed text descriptions of them to use as the caption to associate with the image when training.

OpenAI has put these restrictions in its TOS as a way of trying to "pull up the ladder behind them", preventing rivals from trying to build AIs as good as the ones they have already. Fortunately it's not going to work. There are already open LLMs that can be used as "helpers" without needing OpenAI at all. ByteDance was likely just being lazy here.

There is actually a whole subsection of AI focused on training one model with the output of another called knowledge distillation.

Works kinda neat with stable Diffusion tho

Depends how it's done. GAN (Generative Adversarial Network) training works with exactly that, having networks train against each other, each improving the other over time.

I've watched Multiplicity enough times to know you get a slightly less functional copy.

Like photocopying a picture of a terd

deleted

Not necessarily: there have been recent works that indicate that filtering effects of fine tuned LLMs greatly improves the data efficiency (e.g phi-1). Further, if you have e.g. human selection on top of LLM generated content you can get great results as the LLM generation can be used as a soft curriculum, with the human selection biasing towards higher quality.

Sounds like what you'd get if you ordered a ChatGPT off of Wish dot com. Cheap knock-offs that blatantly steal ideas/designs and somewhat work are kinda their thing.

Yes, honestly you have also been a subject of a lot of propaganda. The US and the US media are villifying a lot of Chinese companies while American companies are not much better if not worse.

I can't speak for every jurisdiction, but I'd be hard pressed to see why it wouldn't be legal in the US, especially in these circumstances. ByteDance is a massive legally sophisticated corporation, so they should've been expected to fully read and understand the terms and conditions before accepting them. They probably won't bring a legal challenge, because they know they don't have a particularly strong legal argument or a sympathetic angle to use.