Staff Data Engineer, Multiple Teams

About the role

Data is a crucial part of Shopify's mission to make commerce better for everyone. We organize and interpret petabytes of data to provide solutions for our merchants and stakeholders across the organization.

As a Data Engineer at Shopify, your primary responsibility will be to contribute to Shopify's Data Warehouse, while unlocking powerful insights to guide the development and improvement of Shopify's products. You'll operate as either an either an embedded capacity or on a central Data Engineering team at Shopify as part of the Data Insights organization (exclusive of Data Platform Engineering which is part of our Infrastructure organization).

As an embedded Data Engineer, you will work directly on building foundations for products that transform merchants' lives. You'll collaborate with a multidisciplinary team of professionals that can include Product Data Scientists, Machine Learning Engineers, Business Analysts, and Product Management. The data you shape will be used to power product analysis, dashboards, and reports, as well as your own product analysis, dashboard and report creation from time to time. Our product is designed to empower entrepreneurs and thus your work creates value for users, and contributes to global entrepreneurship.

As a central Data Engineer, you will sit amongst a team of Data Engineers focused on defining and up-leveling the craft and product of Data Engineering across all of Shopify. Your impact is seen at scale when you ship high quality data assets to Shopify's Data Warehouse, which is used by thousands of people to perform product analysis, make decisions to support our merchants, and steer strategic decisions of the business. You also achieve with others as you partner with Data Engineers embedded in product teams to share and gather standards and best practices, and perform data architecture duties to up-level and maintain the high quality of Data Engineering at Shopify.

To thrive in either role, you need to be dedicated to your craft and committed to constant development. You should be an independent thinker who can solve complex problems and handle a bit of chaos without breaking a sweat.

Example day-to-day responsibilities include:

• Designing, building, implementing, and documenting data models

• Working with business partners to understand business and product objectives, identify the data needed to support them, while influencing product and program decisions

• Writing data transformations using dbt or Spark

• Shipping data pipelines including real-time streaming and batch processing

• Optimizing data transformation pipelines to increase freshness or reduce computational time/cost

• Collaborating with other data engineers on tooling for automated tasks around consuming, validating raw/modeled data, updating modeled data

• Collaborating with sister disciplines (Engineering, Data Science) to establish best practices and evangelize the values and priorities of the Data Engineering craft

• Building production-quality dashboards and scalable data products

• Debating whether leading or trailing commas are better

• Fixing jobs that are broken in production (wrong data types returned, granularity not as expected, resourcing issues)

• Proven ability to provide leadership and guidance beyond one-on-one mentorship, and the ability to improve data engineering practices across teams

• Expert in data architecture and modeling concepts, and able to influence others to up-level the craft of Data Engineering

• Experience forging alignment with senior stakeholders on technical direction for ambiguous problem areas

• Commercial experience in Data Engineering, and/or Analytics Engineering, ​​​​​​building scalable data warehouses

• Dimensional Modeling (Star Schema, Kimball, Inmon)

• Advanced SQL skills (ease with window functions, defining UDFs)

• Exposure to Data Engineering tooling: ingesting, testing transformations, lineage, orchestration, publishing data, metric layers

• Hands-on experience implementing real-time and batch data pipelines with tight SLOs and complex transformation requirements

• Fantastic collaboration and communication skills, demonstrated by successful large-scale projects spanning multiple teams

• High proficiency for product analysis, dashboarding, and reporting

We know that looking for a new role can be both exciting and time-consuming, and we truly appreciate your effort. We look forward to hearing your response to the prompt associated with your application!

#LI-KO3 #LI-REMOTE #LI-AH1

Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look at our Sustainability Reports to learn more about Shopify's commitments to our communities, and our planet.

At Shopify, we understand that experience comes in many forms. We're dedicated to adding new perspectives to the team - so if your experience is this close to what we're looking for, please consider applying.