Since 2022, America has had a solid lead in artificial intelligence thanks to advanced models from high-flying companies like OpenAI, Google DeepMind, Anthropic, and xAI. A growing number of experts, however, worry that the US is starting to fall behind when it comes to minting open-weight AI models that can be downloaded, adapted, and run locally.
Using the best models as synthetic data is mostly pointless. You’re just going to recreate all of its biases and failures in a degraded copy. The whole point of open source software is being able to analyze the source code to learn how it works and understand and ideally remove its weaknesses.
Open weights doesn’t let you do that, and what research it enables is mostly just tinkering around the edges. If someone trained a network, but it kept saying racist stuff, you can’t figure out why it’s racist or rebuild it without the racism from weights alone. Just the weights is like having a binary. Maybe nice to have a gratis app to use, but not really open.