Data Engineer

Job summary

Design and maintain robust data solutions using the Microsoft stack to optimize production scheduling in food manufacturing. Integrate data from ERP, SCADA, and sensor systems to create real-time insights and Power BI dashboards.

Job details

DESCRIPTION We seek a highly skilled Data Engineer with expertise in the Microsoft data stack to join our dynamic team. The ideal candidate will have strong data modeling, data visualization, and integration skills, proficiency in requirements gathering, and experience working in food manufacturing settings, including analyzing and optimizing production scheduling processes. The Data Engineer will be responsible for designing, implementing, and maintaining robust data-focused solutions that support our clients in the food manufacturing industry, with a strong emphasis on data integration, data modeling, data visualization, knowledge of the MS Fabric platform, proficiency in Power BI, and experience with JIRA for agile project management. RESPONSIBILITIES Data Modeling and Integration: Develop and implement data models using the Microsoft data stack (Azure, MS-SQL, Fabric, Power Automate, etc.). Integrate data from various sources, including ERP systems (CSB), SCADA systems, manufacturing equipment, and related systems, to create comprehensive datasets. Utilize APIs and ETL tools to facilitate data integration and acquisition across different systems and platforms. Work with production floor data, including sensor inputs and machine signals, to build real-time or near-real-time insights (preferably the Inductive Automation Ignition platform). Leverage event streaming platforms such as Apache Kafka for high-throughput data ingestion and processing from manufacturing systems Data Analysis and Optimization: Perform data analysis for clients' decision-making and process optimization. Develop and maintain Power BI reports and dashboards for data visualization. Partner with the business analysts and design a data infrastructure that supports strong data governance and security. Requirements Gathering and Documentation: Understand, document, and map current processes. Work with production and operations teams to gather requirements related to scheduling processes and constraints. Develop data models and analytical tools to support production scheduling optimization and decision-making. Gather and document business requirements. Collaborate with clients to understand and address their data and system needs. Create and maintain relevant technical documentation. Stay up-to-date with the latest IT industry trends and technologies in manufacturing. System Troubleshooting and Support: Troubleshoot and resolve data integration and modeling issues. Provide training and support to end-users on IT systems and data usage. Ensure data quality and integrity across all IT systems. Legacy Systems Digitization: Lead/support initiatives to digitize legacy or existing systems to improve efficiency and integration. Assess current systems and develop strategies to transition to modern digital solutions. Implement new digital systems and ensure seamless integration with existing IT infrastructure. Agile Project Management: Utilize JIRA for agile project management to plan, track, and manage project tasks and workflows. Support the Solution Team Lead by facilitating agile ceremonies such as sprint planning, daily stand-ups, and retrospectives. Ensure project milestones and deliverables are met on time and within scope. QUALIFICATIONS Education: MS Fabric Certification DP700 (required), Masters of Information Technology Architecture (or similar) (required) Experience: 5+years in a similar role (required) Technical Skills: Knowledge of manufacturing processes and systems, including experience with production scheduling analysis and optimization. Strong knowledge of data modeling techniques and best practices. Proficiency in SQL and other database management tools. Experience extracting and manipulating data from ERP systems. Excellent analytical and problem-solving skills. Familiarity with data visualization tools, particularly Power BI. Experience with API usage for data integration and acquisition. Knowledge of the Azure platform and its services. Familiarity with agile methodologies and project management using JIRA. Soft Skills: Problem solver: We are seeking an individual who can solve problems effectively. This requires experimentation, creative thinking, and a willingness to fail. Adaptable: Working in a fast-paced environment means things are constantly changing. We are seeking an individual who thrives on these challenges. Communication: You listen to understand and are genuine, sincere, and honest when providing your opinion. Ownership: We want someone who takes ownership, is proud of their work and team's success, and seeks more responsibility in high-accountability environments. You go deep: You understand technical problems deeply and aren’t satisfied with a surface-level understanding. You can leverage this understanding in your day-to-day work to build better, holistic solutions.

What you’ll do

Design and maintain robust data solutions using the Microsoft stack to optimize production scheduling in food manufacturing. Integrate data from ERP, SCADA, and sensor systems to create real-time insights and Power BI dashboards.

Requirements

Requires a Master's in IT Architecture, MS Fabric Certification DP700, and over 5 years of experience in a similar role. Must possess strong skills in SQL, Azure, and data modeling within a manufacturing context.

Listed skills

• Microsoft Azure · Preferred
• Data visualization · Preferred
• Technical Documentation · Preferred
• Power BI · Preferred
• Production Scheduling · Preferred
• SQL · Preferred
• ERP systems · Preferred
• Jira · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Microsoft Fabric
• Power BI
• Data Modeling
• SQL
• Azure
• ETL
• API Integration
• JIRA
• Agile Project Management
• Data Visualization
• Apache Kafka
• ERP Systems
• SCADA
• Production Scheduling
• Data Governance
• Technical Documentation

Job areas

• Data & Analytics
• Technology
• Manufacturing
• Engineering
• Consulting