Data is better together: Enabling communities to collectively build better datasets together using Argilla and Hugging Face Spaces

Back to Articles Data is better together: Enabling communities to collectively build better datasets together using Argilla and Hugging Face Spaces Published March 4, 2024 Update on GitHub Upvote 8 +2 Daniel van Strien davanstrien Follow Daniel Vila dvilasuero Follow guest Recently, Argilla and Hugging Face launched Data is Better Together, an experiment to collectively build a preference dataset of prompt rankings. In a few days, we had: 350 community contributors labeling data Over 11,000 prompt ratings See the progress dashboard for the latest stats! This resulted in the release of 10k_prompts_ranked, a dataset consisting of 10,000 prompts with user ratings for the quality of the prompt. We want to enable many more projects like this! In this post, we’ll discuss why we think it’s essential for the community to collaborate on building datasets and share an invitation to join the first cohort of communities Argilla and Hugging Face will support to develop better datasets together! Data remains essential for better models Data continues to be essential for better models: We see continued evidence from published research, open-source experiments, and from the open-source community that better data can lead to better models. The question. A frequent answer. Why build datasets collectively? Data is vital for machine learning, but many languages, domains, and tasks still lack high-quality datasets for training, evaluating, and benchmarking — the community already shares thousa...