Software Engineer (Remote)
The role involves building LLM evaluation and training datasets by analyzing GitHub issues and configuring code repositories. The engineer will evaluate test coverage and modify codebases to assess LLM performance in bug-fixing scenarios.
- Remote
- Canada
- Posted Jul 25, 2026
- 1 position
Job summary
Role: Software Engineer (Remote) Location: Remote (Work from Anywhere) Job Type: Part-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a Senior Software Engineer – C++ (LLM Evaluation & Repository Validation) to work on a part-time basis. The project involves building LLM evaluation and training datasets to train large language models on realistic software engineering problems. The role requires hands-on engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality. Key Responsibilities: • Analyze and triage GitHub issues across trending open-source libraries. • Set up and configure code repositories, including Dockerization and environment setup. • Evaluate unit test coverage and quality in public repositories. • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs. Required Skills & Qualifications: • Minimum 3+ years of overall software engineering experience. • Strong proficiency in C++ and experience with Git, Docker, and basic software pipeline setup. • Ability to understand and navigate complex codebases comfortably. • Experience running, modifying, and testing real-world projects locally. • Experience contributing to or evaluating open-source projects is a plus. More About the Opportunity: This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI-assisted software development. The work directly influences the future of how LLMs interact with real code. Equal Opportunity Employer: We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. Apply Now!
What you’ll do
The role involves building LLM evaluation and training datasets by analyzing GitHub issues and configuring code repositories. The engineer will evaluate test coverage and modify codebases to assess LLM performance in bug-fixing scenarios.
Requirements
Candidates must have at least 3 years of software engineering experience with strong proficiency in C++, Git, and Docker. Ability to navigate complex codebases and experience with real-world project testing is required.
Other relevant skills
Identified from the job description. Confirm important requirements above.
- C++
- Git
- Docker
- LLM Evaluation
- Software Pipeline Setup
- Issue Triaging
- Unit Testing
- Open Source Contribution
Job areas
- Software
- Technology
- Engineering
- Science & Research
- Data & Analytics
Additional details
- Minimum experience
- 2+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Associate