Researchers Develop Compressed 7B Parameter Language Model for European Languages
New paper details creation of Bielik-Minitron-7B, reducing parameters by 33.4% while maintaining 90% performance and achieving 50% inference speedup.
Sources · arxiv.org