Data Engineer - AI Model Evaluation

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Data Engineer (Coding Agent Experience) Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems. Identify bugs, edge cases, scalability issues, and failure modes in model outputs. Compare outputs from multiple frontier models and assess their strengths and weaknesses. Apply professional engineering judgment to realistic data engineering scenarios. Qualifications Must-Have 2+ years of professional data engineering experience. Experience building ETL pipelines, data warehouses, analytics platforms, or distributed data systems. Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools. Ability to evaluate model-generated data infrastructure and pipeline implementations. Preferred Experience operating large-scale data platforms. Compensation & Legal $400 per accepted task. Compensation is tied to accepted work. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome For any help or support, reach out to: [email protected] PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,

Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review and assess model-generated implementations for ETL pipelines, data warehouses, and distributed systems to identify bugs and scalability issues.

Requires 2+ years of professional data engineering experience building data pipelines and analytics platforms. Must have regular experience using AI coding agents like Cursor, Claude Code, or Gemini CLI.

Identified from the job description. Confirm important requirements above.

• ETL Pipelines
• Data Warehousing
• Distributed Data Systems
• AI Coding Agents
• Model Evaluation
• Data Infrastructure
• Analytics Platforms
• Scalability Analysis
• Bug Identification
• Professional Engineering Judgment

• Data & Analytics
• Technology
• Engineering
• Software
• Science & Research

Minimum experience

2+ years

Apply by

Aug 29, 2026

Posting language

English

Working hours

40 hours per week

Location requirements

Country, Greater Montreal Metropolitan Area

Seniority

Not Applicable