Senior Software Engineer

About Snorkel Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine platform technology with research-driven data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. Snorkel led the development of Senior SWE-Bench and launched Open Benchmarks Grants with a $3 million commitment to support open-source datasets, benchmarks, and evaluation research. Supported projects include Agents’ Last Exam, OSWorld 2.0, Terminal-Bench, Continual Learning Bench, and SlopCode Bench. About The Role We are seeking multiple Senior Software Engineers for a high-impact AI data development and benchmarking projects. Unlike typical task-based gig projects, this is a dedicated, hourly contract with potential for extension and placement on additional upcoming engineering projects across our platform. In this role, you will apply rigorous enterprise engineering standards to evaluate, document, and curate complex technical workflows, coding benchmarks, and technical evaluation rubrics. What You’ll Do Code & Architecture Review: Analyze, draft, and critique complex codebases, programmatic unit tests, and software engineering scenarios. Technical Writing & Specification: Create precise technical documentation, solution traces, edge-case analysis, and evaluation rubrics for frontier AI benchmarks. PR & Process Quality Assurance: Follow strict code review guidelines, PR submission workflows, and quality assurance processes consistent with top-tier tech organizations. Dataset & Benchmark Development: Collaborate on building environment-grounded benchmarks (e.g., repository navigation, CLI tasks, complex software engineering workflows) to test AI coding agents. What You’ll Bring Deep experience working as a Senior Software Engineer within large, tech-native companies or enterprise organizations. Proven familiarity with heavy software processes, including strict code review pipelines, multi-stage PR merges, detailed documentation requirements, and enterprise CI/CD workflows. Strong proficiency in modern programming languages (e.g., Python, TypeScript, Go, or C++). Ability to break down complex engineering tasks, write detailed rubrics, and document exact step-by-step technical workflows. Nice to Have Strong background in Technical Writing, developer documentation, or creating clear, structured technical specifications for engineering teams. *This job posting exists to fill a vacancy.

The role involves analyzing and critiquing complex codebases and developing technical evaluation rubrics for AI benchmarks. You will also create precise technical documentation and collaborate on building environment-grounded benchmarks for AI coding agents.

Candidates must have deep experience as a Senior Software Engineer in large enterprise organizations with proficiency in modern languages like Python, TypeScript, Go, or C++. Proven familiarity with strict code review pipelines and enterprise CI/CD workflows is required.

• CI/CDPreferred
• GoPreferred
• Quality assurancePreferred
• TypeScriptPreferred
• C++Preferred
• PythonPreferred

Identified from the job description. Confirm important requirements above.

• Code Review
• Technical Writing
• Python
• TypeScript
• Go
• C++
• CI/CD
• Benchmark Development
• Software Architecture
• Quality Assurance
• Technical Documentation
• Dataset Curation

• Software
• Technology
• Engineering
• Data & Analytics
• Consulting

Minimum experience

5+ years

Posting language

English

Working hours

40 hours per week

Seniority

Mid-Senior level