Nvidia and Mistral AI have released a new small language model that purportedly features “state-of-the-art” accuracy in a tiny footprint. The new LM is known as the Mistral-NemMo-Minitron 8B, a miniaturized version of NeMo 12B that has been pruned from 12 billion to 8 billion parameters.

Source ->