Deepseek was around before Trump's announcement, I saw it on huggingface a week or two ago. Perhaps the timing of the announcement and launch of a consumer facing app were timed to do this. But really, silicon valley is a huge racket and AI is an even bigger one, so I welcome the exposure of the stupidity
Large ANN training need a terabytes of data and billions of epochs(iterations) to train one variant. If you have to apply some constraints (in math sense) on it, you have to do whole training thing many times, proportionally to number of constraints. Each adjustment change the whole ANN, so you need to train it completely from the ground after you made change to apply constraint. Mutually exclusive constraints makes things much worse, you need dozens of training cycles for it with little chance to succeed at all.
West need orders of magnitude more constraints than China.
F.e., for LLMs, Chineese constraints are just "don't mention CCP in negative sense" and "don't allow antichineese things". West on the other side have to care about tons of many mutually exclusive things.
So, few training passes will be enough for China, but West need thousands, if not millions training cycles and adjustments. China could do its LLM in a month on a moderate processing power, while West need orders of magnitude more power to fit ANN to all Western constraints in observable time.
Deepseek was around before Trump's announcement, I saw it on huggingface a week or two ago. Perhaps the timing of the announcement and launch of a consumer facing app were timed to do this. But really, silicon valley is a huge racket and AI is an even bigger one, so I welcome the exposure of the stupidity
Large ANN training need a terabytes of data and billions of epochs(iterations) to train one variant. If you have to apply some constraints (in math sense) on it, you have to do whole training thing many times, proportionally to number of constraints. Each adjustment change the whole ANN, so you need to train it completely from the ground after you made change to apply constraint. Mutually exclusive constraints makes things much worse, you need dozens of training cycles for it with little chance to succeed at all.
West need orders of magnitude more constraints than China. F.e., for LLMs, Chineese constraints are just "don't mention CCP in negative sense" and "don't allow antichineese things". West on the other side have to care about tons of many mutually exclusive things.
So, few training passes will be enough for China, but West need thousands, if not millions training cycles and adjustments. China could do its LLM in a month on a moderate processing power, while West need orders of magnitude more power to fit ANN to all Western constraints in observable time.
Something like that.
I'm here for it. The wheels were coming off anyway. AI was always skating on thin ice and promises of a highly unlikely AGI.
Another possibility is this will underscore the American need to invest in AI to stay ahead, and increase legal (Indian) immigration to do so
Yeah I don't think it will underscore anu actual need, but be used to push the theater. Only time will tell