Software Engineer - Python & TypeScript

Job summary

Design and refine rubrics for preference data, review and label data, and build or maintain pipelines and infrastructure for data generation, collection, and evaluation. Collaborate with researchers and engineers to scale qualitative judgment, address ambiguous technical problems, and communicate findings through clear technical updates and recommendations.

Job details

Senior Software Engineer - Python &TypeScript Work site: Canada- Remote- PST Time zone Part-time- About the Role As a Senior Software Engineer, you will contribute to AI-focused engineering and evaluation workflows. You will work closely with researchers and engineers to translate qualitative judgment into scalable processes and help maintain a high standard of quality across data and evaluation initiatives. Key Responsibilities Design, refine, and iterate on rubrics and evaluation criteria for preference data. Review and label data while maintaining a high standard of quality and identifying subtle issues. Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows. Synthesize findings from data-related work into clear and actionable technical write-ups, updates, and recommendations. Collaborate closely with researchers and engineers to convert qualitative judgment into scalable processes. Navigate complex and ambiguous technical problems and contribute to practical, high-quality solutions. Communicate technical concepts clearly and concisely to relevant stakeholders. Required Qualiffications 5+ years of professional experience with strong proficiency in: Python, particularly building and maintaining pipelines and infrastructure; or TypeScript, with experience contributing to or navigating large codebases such as VSCode being an advantage. Hands-on experience with preference data collection and/or rubric creation. Strong written and verbal communication skills. Ability to distill complex technical work into clear, structured, and actionable summaries. Strong quality-oriented judgment and the ability to explain why a particular output or approach meets a high-quality standard. Comfortable working in fast-moving and ambiguous environments. Ability to work independently while collaborating effectively with engineering and research teams. Preferred Background Experience working with large-scale or complex codebases. Experience building or maintaining data-generation, data-collection, or evaluation pipelines. Exposure to AI/ML, LLM, model evaluation, or preference-data workflows. What You Can Expect Fully remote working environment. Opportunity to contribute to cutting-edge AI projects. Exposure to projects involving AI evaluation, preference data, and large-scale engineering workflows. Collaboration with experienced researchers and engineers working on advanced AI initiatives.

What you’ll do

Design and refine rubrics for preference data, review and label data, and build or maintain pipelines and infrastructure for data generation, collection, and evaluation. Collaborate with researchers and engineers to scale qualitative judgment, address ambiguous technical problems, and communicate findings through clear technical updates and recommendations.

Requirements

Requires 5+ years of professional experience and strong proficiency in Python or TypeScript, along with hands-on experience in preference data collection or rubric creation. Candidates should have strong communication and quality judgment, be able to produce actionable summaries, and work independently and collaboratively in fast-moving, ambiguous environments.

Listed skills

• Problem solving · Preferred
• Pipeline Development · Preferred
• Communication · Preferred
• TypeScript · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• TypeScript
• Pipeline Development
• Infrastructure Maintenance
• Preference Data Collection
• Rubric Creation
• Data Labeling
• Data Evaluation
• AI/ML
• LLM Evaluation
• Technical Writing
• Quality Judgment
• Communication
• Problem-Solving
• Research Collaboration

Job areas

• Software
• Technology
• Engineering
• Data & Analytics
• Science & Research

More jobs from Epsilon Solutions Ltd.