Welcome Gemma - Google’s new open LLM

Back to Articles Welcome Gemma - Google’s new open LLM Published February 21, 2024 Update on GitHub Upvote 26 +20 Philipp Schmid philschmid Follow Omar Sanseviero osanseviero Follow Pedro Cuenca pcuenq Follow An update to the Gemma models was released two months after this post, see the latest versions in this collection. Gemma, a new family of state-of-the-art open LLMs, was released today by Google! It's great to see Google reinforcing its commitment to open-source AI, and we’re excited to fully support the launch with comprehensive integration in Hugging Face. Gemma comes in two sizes: 7B parameters, for efficient deployment and development on consumer-size GPU and TPU and 2B versions for CPU and on-device applications. Both come in base and instruction-tuned variants. We’ve collaborated with Google to ensure the best integration into the Hugging Face ecosystem. You can find the 4 open-access models (2 base models & 2 fine-tuned ones) on the Hub. Among the features and integrations being released, we have: Models on the Hub, with their model cards and licenses 🤗 Transformers integration Integration with Google Cloud Integration with Inference Endpoints An example of fine-tuning Gemma on a single GPU with 🤗 TRL Table of contents What is Gemma? Prompt format Exploring the Unknowns Demo Using 🤗 Transformers JAX Weights Integration with Google Cloud Integration with Inference Endpoints Fine-tuning with 🤗 TRL Additional Resources Acknowledgments What is Gemma? Gemma is a fam...