Data Engineer (Databricks SME)
- Ontario, Canada, United States
- Remote
- Posted Oct 17, 2026
- 1 position
US$105,000–US$115,000 / year
Opens LinkedIn
- Employment type
- Full-time
- Experience level
- Senior · 5+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
Job summary
Design and implement scalable data solutions, pipelines, and architectures that support analytics, machine learning, and AI-ready data processing. Collaborate with stakeholders to translate business needs into technical solutions, support data governance and integration, and monitor data quality and system performance.
Job details
IDR is seeking a Data Engineer (Databricks SME) to join one of our top clients for a remote opportunity. This role involves designing and implementing scalable data solutions, supporting AI-ready data processing, and collaborating with cross-functional teams to enable data-driven decision-making. Position Overview for the Data Engineer (DatabricksSME): Assist in developing modern data pipelines and architectures to support analytics and machine learning initiatives. Collaborate with stakeholders to translate business requirements into technical data solutions. Support data governance, transformation, and integration efforts in a cloud environment, primarily using Azure Databricks. Develop and monitor metrics for data quality and system performance. Contribute to evolving enterprise data strategies and best practices. Requirements for the Data Engineer (Databricks SME): 5+ years of experience in data engineering and/or data warehousing. 4+ years of hands-on experience with Azure Databricks. Experience supporting AI-ready data solutions, including data preparation and transformation for analytics, machine learning, and generative AI. Proficiency in Python for data-related tasks and system integration. Mastery of TSQL and ANSI SQL, with experience using version control platforms like Git. What's in it for you? Competitive compensation package Full Benefits; Medical, Vision, Dental, and more! Opportunity to get in with an industry leading organization. Why IDR? 25+ Years of Proven Industry Experience in 4 major markets Employee Stock Ownership Program Dedicated Engagement Manager who is committed to you and your success. Medical, Dental, Vision, and Life Insurance ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row pay transparency: 105-115k/year in USA or 145-165k/year in Ontario, CAN
What you’ll do
Design and implement scalable data solutions, pipelines, and architectures that support analytics, machine learning, and AI-ready data processing. Collaborate with stakeholders to translate business needs into technical solutions, support data governance and integration, and monitor data quality and system performance.
Requirements
Requires at least five years of data engineering or data warehousing experience, including at least four years of hands-on Azure Databricks experience. Candidates should have experience preparing data for analytics, machine learning, and generative AI, proficiency in Python, mastery of T-SQL and ANSI SQL, and experience with Git.
Benefits
- Medical Insurance
- Vision Insurance
- Dental Insurance
- Life Insurance
- Employee Stock Ownership Program
Listed skills
- Machine learning · Preferred
- Git · Preferred
- Python · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Data Engineering
- Azure Databricks
- Python
- T-SQL
- ANSI SQL
- Git
- Data Warehousing
- Data Pipelines
- Data Architecture
- Data Governance
- Data Transformation
- Data Integration
- Data Quality
- Machine Learning
- Generative AI
- Cloud Computing
Job areas
- Data & Analytics
- Technology
- Software
- Engineering