AMD released a fully open source model 1B

Here is their blog post : https://www.amd.com/en/developer/resources/technical-articles/introducing-the-first-amd-1b-language-model.html