Machine Learning Research Scientist / Engineer, Reasoning

Scale AI is a leading AI data foundry focused on accelerating the development of AI applications. The role involves advancing reasoning within large language models, shaping data strategy, and collaborating on impactful research and real-world implementations. Responsibilities • Study the data types critical for advancing LLM-based agents, including browser and software engineering (SWE) agents • Identify the most effective data sources and methodologies for improving LLM reasoning • Contribute to impactful research on language model reasoning • Collaborate with external researchers • Work closely with engineering teams to bring state-of-the-art advancements into scalable, real-world solutions Skills • Practical experience working with LLMs, with proficiency in frameworks like PyTorch, JAX, or TensorFlow • Skilled at rapidly interpreting research literature and turning new ideas into working prototypes • A track record of published research in top ML and NLP venues (e.g., ACL, EMNLP, NAACL, NeurIPS, ICML, ICLR, CoLLM, etc.) • At least three years of experience solving complex ML challenges, either in a research setting or product development, particularly in areas related to LLM capabilities and reasoning • Strong written and verbal communication skills, along with the ability to work effectively across teams • Hands-on experience fine-tuning open-source LLMs or leading bespoke LLM fine-tuning projects using PyTorch/JAX • Research and practical experience in building applications and evaluations related to LLM-based agents, including tool-use, text-to-SQL, browser agents, coding agents, and GUI agents • Experience with agent frameworks such as OpenHands, Swarm, LangGraph, or similar • Familiarity with advanced agentic reasoning techniques such as STaR and PLANSEARCH • Proficiency in cloud-based ML development, with experience in AWS or GCP environments Benefits • Comprehensive health, dental and vision coverage • Retirement benefits • A learning and development stipend • Generous PTO • Commuter stipend Company Overview • Scale’s mission is to develop reliable AI systems for the world’s most important decisions. It was founded in 2016, and is headquartered in San Francisco, California, USA, with a workforce of 501-1000 employees. Its website is https://scale.com. Company H1B Sponsorship • Scale AI has a track record of offering H1B sponsorships, with 82 in 2025, 54 in 2024, 29 in 2023, 17 in 2022, 10 in 2021, 10 in 2020. Please note that this does not guarantee sponsorship for this specific role.