Software Developer (Content Integration & Data Pipelines)

Ottawa, Ontario, Canada
Remote
Posted Oct 24, 2026
1 position

$75,000–$110,000 / year

Opens an external site

Employment type: Full-time
Experience level: Mid-level · 2+ years
Minimum education: Bachelor’s degree
Posting language: English
Working hours: 40 hours per week

Job summary

You will design, build, and scale production-grade pipelines to collect, process, and deliver online news and web content. This involves developing web scrapers, managing event-driven services with Kafka, and ensuring data quality and system reliability.

Job details

About the Role As a Software Developer (Content Integration & Data Pipelines), you will design, build, and scale the production-grade pipelines that collect, process, and deliver online news and web content across our platform. You will play a key role in shaping how content flows from thousands of sources into our search and analytics systems — powering the monitoring, insights, and AI-driven features PR professionals rely on every day. This role goes beyond implementation. You will contribute to system design, architecture decisions, and data strategy, helping define how content is acquired, normalized, enriched, and indexed at scale using event-driven design. You’ll work across both: Content acquisition and integration (TypeScript, web scraping and crawling, source integrations) Backend and pipeline systems (Java, event-driven architecture with Kafka, search indexing with Solr) Agility PR Solutions is building next-generation media intelligence capabilities powered by AI. Your work will directly influence how customers extract insights, automate workflows, and make decisions from large-scale media data What you’ll do Build and maintain scalable web scrapers and crawlers that follow web scraping standards and best practices (robots.txt, rate limiting, polite crawling) Develop content integration and parsing logic using TypeScript Design and build event-driven services using Kafka to process, enrich, and route content in near real time Integrate with third-party content providers, feeds (RSS/Atom), and external APIs Design and implement RESTful services (Java) to support content processing and delivery Define and enforce best practices for: Scraping compliance and source management Pipeline reliability, error handling, and data quality Observability and monitoring of content pipelines Optimize performance, cost, and reliability of pipeline workloads Contribute to architectural decisions and technical direction Mentor junior developers and contribute to team knowledge sharing What You'll Bring Degree in Computer Science or related field (or equivalent experience) 3+ years of software development experience Proficiency in TypeScript / JavaScript Solid experience building backend services (Java or similar) Hands-on experience with web scraping and crawling in production environments, including adherence to web scraping standards (robots.txt, rate limiting, terms of use) You should have practical experience with: Event-driven architecture and message streaming (e.g., Kafka) HTML parsing, content extraction, and normalization techniques Designing high-volume, fault-tolerant data pipelines Experience with: SQL and data modeling Linux environments Git, and modern development workflows Kafka Maven Knowledge of Solr (indexing, schema design, query tuning) is an asset Strongly preferred: Experience building content ingestion pipelines for news or media data Understanding of system design and scalability tradeoffs Ability to work independently and take ownership of projects Strong problem-solving and system design thinking Effective communication across technical and non-technical stakeholders Passion for data, automation, and emerging technologies, including AI Why You'll Love It Here Fully remote work environment Collaborative culture – and key tools enabling it Competitive compensation package Health, Dental & Vision benefits RRSP matching Life Insurance Employee Assistance Program (EAP) Career Development & Progression opportunities Paid Vacation, Personal Days and Sick days Week off between Christmas and New Years' No Internal Meetings Fridays Compensation for this role is expected to fall within the range of $75,000 - 110,000 annually. The final offer will reflect each candidate’s experience, skills, and internal equity. This is for a vacant position. AI Usage We use technology to make hiring smarter, faster, and more personal, never less human. Artificial intelligence (AI) tools help us manage applications efficiently and highlight qualifications that align with each role, allowing our recruiters to focus more on meaningful conversations with candidates. AI does not make hiring decisions at Agility. Every decision is made by people, our hiring managers and recruitment professionals, who are trained to apply sound judgment and equitable practices at every stage. We believe technology exists to amplify human insight, not replace it. That belief shapes how we build relationships, tell stories, and grow our teams. At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation. Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future. If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at careers@agilitypr.com for us to make appropriate arrangements. At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation. Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future. If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at careers@agilitypr.com for us to make appropriate arrangements. Thank you for your time in reviewing this opportunity, and we hope to hear from you should you find this the right fit!

What you’ll do

Requirements

Candidates must have at least 3 years of software development experience with proficiency in TypeScript and Java. Practical experience in building high-volume data pipelines, web scraping, and event-driven architectures is required.

Benefits

Health insurance
Dental insurance
Vision insurance
RRSP matching
Life insurance
Employee assistance program
Career development opportunities
Paid vacation
Personal days
Sick days

Listed skills

SQL · Preferred
JavaScript · Preferred
TypeScript · Preferred
Linux · Preferred
Java · Preferred
Git · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

TypeScript
JavaScript
Java
Kafka
Solr
Web scraping
Data pipelines
Event-driven architecture
RESTful services
SQL
Data modeling
Linux
Git
Maven
System design
Automation
Influencing Skills
Workplace Inclusivity
Event Driven Architecture
Observability
Workflow Management
Git (Version Control System)
Effective Communication
Emerging Technologies
Data Strategy
Workflow Automation
HyperText Markup Language (HTML)
Java (Programming Language)
JavaScript (Programming Language)
Application Programming Interface (API)
Software Development
Management
Computer Science
Value-Added Services
Web Scraping
Data Modeling
Data Quality
Employee Assistance Programs
Exception Handling
Event-Driven Programming
Extensible Authentication Protocol
Fault Tolerance
Scalability
Problem Solving
Apache Maven
Parsing
Rate Limiting
RESTful API
Apache Solr
SQL (Programming Language)

Job areas

Software
Technology
Data & Analytics
Engineering
Creative & Media
Software Developer/Integrator
ETL Developer
Database Designers and Administrators
Database Administrators