Staff Data Engineer / Tech Lead (Distribution Center)
Design and optimize robust ETL pipelines using PySpark and dbt to process large-scale customer datasets for distribution center products. Provide technical leadership by defining data architecture vision, mentoring engineers, and collaborating cross-functionally to deliver scalable data solutions.
- Remote
- Ontario, Canada
- Posted Sep 9, 2026
- Apply by Oct 9, 2026
- 1 position
Opens an external site
More jobs you can apply to directly
Similar opportunities posted by employers hiring on Jobs.ca, with no external application form.
Job summary
Back to jobs Staff Data Engineer / Tech Lead (Distribution Center) Remote - Ontario, Canada Afresh, the AI platform for grocery, began by tackling the most complex problem in the industry: fresh, and has evolved into the core AI platform for grocers. By leveraging proprietary AI designed for high-volatility environments, we empower partners like Albertsons, Meijer, and Wakefern to drive smarter decisions across their entire enterprise. Following record-breaking 70% revenue growth in 2025, we have scaled to 6 enterprise-grade solutions, with solutions live in over 10% of the U.S. grocery market. Our platform now orchestrates billions of decisions from the store floor to the distribution center and prevented over 200 million pounds of food waste last year alone. If you're looking for a role where your work directly translates into massive scale and social good, and you want to be part of the team that defines how the world eats, there is no better time to join us. About The Role As a Staff Data Engineer, on the Distribution Center (DC) Solutions team, you’ll play a technical lead role in building and scaling the data integrations needed to support our suite of DC products. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution. What You’ll Do Engineering & Data Pipelines: Design, build, and optimize robust ETLs using PySpark and dbt to process large-scale customer datasets while developing tools and frameworks to streamline data integrations and improve scalability. Technical Leadership & Strategy: Define the technical vision for DC data architecture, mentor engineers, and manage external contractors to ensure the team delivers high-quality, practical solutions for current and future needs. Cross-functional Collaboration: Partner with product, engineering, and applied science teams to scope work and deliver data solutions that address real-world challenges in customer data quality and product feature requirements. What Makes You a Great Fit We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification. Significant experience designing and maintaining ETLs that process large-scale datasets. Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or dbt. 2+ years of experience in a technical lead role (e.g. Tech Lead or Engineering Manager), with a willingness to mentor and help others grow. Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions. A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done. Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them. A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort. Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences. We’re looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we’d love to hear from you! This position is not eligible for immigration sponsorship Salary Range in CAD: $148K - $222K Why You’ll Love Working at Afresh At Afresh, our mission to eliminate food waste starts with investing in our people. We provide a comprehensive support system designed to help you do your best work while maintaining a healthy, balanced life. Comprehensive Health & Wellness: Comprehensive medical, dental, and vision coverage for you and your family, with the majority of premiums covered by Afresh. We also provide dedicated mental health support and counseling services. Invested in Your Future: Competitive base salary, meaningful equity (U.S. employees), and a 401(k) program with a generous company match. Flexible & Modern Workspace: Whether you work from home or a local office, we support your setup with a home office stipend and "Coworking Wallets" for flexible workspace access. Growth-Obsessed Culture: We believe in continuous learning. Every employee receives an annual professional development budget to master new skills and grow their career at Afresh. Holistic Monthly Stipends: Beyond your paycheck, we provide monthly stipends for "Betterment" (wellness/lifestyle) and telecommunications to ensure you have what you need to thrive. Time to Recharge: Flexible paid time off to take the time you need to recharge. Full-time U.S. employees are eligible for these benefits About Afresh Founded in 2017, Afresh is using AI to tackle the #1 solution to curb climate change: reducing food waste. By building AI specifically for the intricacies of grocery—from the fresh perimeter to the center store—we help grocers minimize waste and maximize sales. Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals, including ICML, and our investors include Al Gore’s Just Climate, former Whole Foods Market CEO Walter Robb, and Eric Schmidt's Innovation Endeavors. Grocery is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility. Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law. Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI. Create a Job Alert Interested in building your career at Afresh? Get future opportunities sent straight to your email. Create alert Apply for this job indicates a required field First Name* Last Name* Preferred First Name* Email* Phone Country* Phone* 244 results found No results found Afghanistan+93 Åland Islands+358 Albania+355 Algeria+213 American Samoa+1 Andorra+376 Angola+244 Anguilla+1 Antigua & Barbuda+1 Argentina+54 Armenia+374 Aruba+297 Ascension Island+247 Australia+61 Austria+43 Azerbaijan+994 Bahamas+1 Bahrain+973 Bangladesh+880 Barbados+1 Belarus+375 Belgium+32 Belize+501 Benin+229 Bermuda+1 Bhutan+975 Bolivia+591 Bosnia & Herzegovina+387 Botswana+267 Brazil+55 British Indian Ocean Territory+246 British Virgin Islands+1 Brunei+673 Bulgaria+359 Burkina Faso+226 Burundi+257 Cambodia+855 Cameroon+237 Canada+1 Cape Verde+238 Caribbean Netherlands+599 Cayman Islands+1 Central African Republic+236 Chad+235 Chile+56 China+86 Christmas Island+61 Cocos (Keeling) Islands+61 Colombia+57 Comoros+269 Congo - Brazzaville+242 Congo - Kinshasa+243 Cook Islands+682 Costa Rica+506 Côte d’Ivoire+225 Croatia+385 Cuba+53 Curaçao+599 Cyprus+357 Czechia+420 Denmark+45 Djibouti+253 Dominica+1 Dominican Republic+1 Ecuador+593 Egypt+20 El Salvador+503 Equatorial Guinea+240 Eritrea+291 Estonia+372 Eswatini+268 Ethiopia+251 Falkland Islands+500 Faroe Islands+298 Fiji+679 Finland+358 France+33 French Guiana+594 French Polynesia+689 Gabon+241 Gambia+220 Georgia+995 Germany+49 Ghana+233 Gibraltar+350 Greece+30 Greenland+299 Grenada+1 Guadeloupe+590 Guam+1 Guatemala+502 Guernsey+44 Guinea+224 Guinea-Bissau+245 Guyana+592 Haiti+509 Honduras+504 Hong Kong SAR China+852 Hungary+36 Iceland+354 India+91 Indonesia+62 Iran+98 Iraq+964 Ireland+353 Isle of Man+44 Israel+972 Italy+39 Jamaica+1 Japan+81 Jersey+44 Jordan+962 Kazakhstan+7 Kenya+254 Kiribati+686 Kosovo+383 Kuwait+965 Kyrgyzstan+996 Laos+856 Latvia+371 Lebanon+961 Lesotho+266 Liberia+231 Libya+218 Liechtenstein+423 Lithuania+370 Luxembourg+352 Macao SAR China+853 Madagascar+261 Malawi+265 Malaysia+60 Maldives+960 Mali+223 Malta+356 Marshall Islands+692 Martinique+596 Mauritania+222 Mauritius+230 Mayotte+262 Mexico+52 Micronesia+691 Moldova+373 Monaco+377 Mongolia+976 Montenegro+382 Montserrat+1 Morocco+212 Mozambique+258 Myanmar (Burma)+95 Namibia+264 Nauru+674 Nepal+977 Netherlands+31 New Caledonia+687 New Zealand+64 Nicaragua+505 Niger+227 Nigeria+234 Niue+683 Norfolk Island+672 North Korea+850 North Macedonia+389 Northern Mariana Islands+1 Norway+47 Oman+968 Pakistan+92 Palau+680 Palestinian Territories+970 Panama+507 Papua New Guinea+675 Paraguay+595 Peru+51 Philippines+63 Poland+48 Portugal+351 Puerto Rico+1 Qatar+974 Réunion+262 Romania+40 Russia+7 Rwanda+250 Samoa+685 San Marino+378 São Tomé & Príncipe+239 Saudi Arabia+966 Senegal+221 Serbia+381 Seychelles+248 Sierra Leone+232 Singapore+65 Sint Maarten+1 Slovakia+421 Slovenia+386 Solomon Islands+677 Somalia+252 South Africa+27 South Korea+82 South Sudan+211 Spain+34 Sri Lanka+94 St. Barthélemy+590 St. Helena+290 St. Kitts & Nevis+1 St. Lucia+1 St. Martin+590 St. Pierre & Miquelon+508 St. Vincent & Grenadines+1 Sudan+249 Suriname+597 Svalbard & Jan Mayen+47 Sweden+46 Switzerland+41 Syria+963 Taiwan+886 Tajikistan+992 Tanzania+255 Thailand+66 Timor-Leste+670 Togo+228 Tokelau+690 Tonga+676 Trinidad & Tobago+1 Tunisia+216 Turkey+90 Turkmenistan+993 Turks & Caicos Islands+1 Tuvalu+688 U.S. Virgin Islands+1 Uganda+256 Ukraine+380 United Arab Emirates+971 United Kingdom+44 United States+1 Uruguay+598 Uzbekistan+998 Vanuatu+678 Vatican City+39 Venezuela+58 Vietnam+84 Wallis & Futuna+681 Western Sahara+212 Yemen+967 Zambia+260 Zimbabwe+263 Resume/CV* Attach Enter manually Accepted file types: pdf, doc, docx, txt, rtf Education School* Select... Degree* Select... Do you have unrestricted work authorization in Canada?* Select... Will you now, or in the future, require immigration sponsorship for continued employment in Canada?* Select... In which Canadian province do you currently reside?* Do you have 2+ years of experience in a formal technical lead role (Tech Lead, Staff Engineer, or Engineering Manager)?* Select... Are you proficient with Python, PySpark, SQL, and do you have experience working on platforms/tools like Databricks, Snowflake, or DBT? * Select... Why Afresh? Tell us what makes you excited to join our team.* LinkedIn Profile / GitHub Link* Voluntary Self-Identification For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file. As set forth in Afresh’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law. Gender Select... Are you Hispanic/Latino? Select... Race & Ethnicity Definitions If You Believe You Belong To Any Of The Categories Of Protected Veterans Listed Below, Please Indicate By Making The Appropriate Selection. As a Government Contractor Subject To The Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), We Request This Information In Order To Measure The Effectiveness Of The Outreach And Positive Recruitment Efforts We Undertake Pursuant To VEVRAA. Classification Of Protected Categories Is As Follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985. Veteran Status Select... Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 07/31/2029 Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years. Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp. How do you know if you have a disability? A Disability Is a Condition That Substantially Limits One Or More Of Your “major Life Activities.” If You Have Or Have Ever Had Such a Condition, You Are a Person With a Disability. Disabilities Include, But Are Not Limited To: Alcohol or other substance use disorder (not currently using drugs illegally) Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS Blind or low vision Cancer (past or present) Cardiovascular or heart disease Celiac disease Cerebral palsy Deaf or serious difficulty hearing Diabetes Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders Epilepsy or other seizure disorder Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome Intellectual or developmental disability Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD Missing limbs or partially missing limbs Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS) Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities Partial or complete paralysis (any cause) Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema Short stature (dwarfism) Traumatic brain injury Disability Status Select... PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete. Afresh, the AI platform for grocery, began by tackling the most complex problem in the industry: fresh, and has evolved into the core AI platform for grocers. By leveraging proprietary AI designed for high-volatility environments, we empower partners like Albertsons, Meijer, and Wakefern to drive smarter decisions across their entire enterprise. Following record-breaking 70% revenue growth in 2025, we have scaled to 6 enterprise-grade solutions, with solutions live in over 10% of the U.S. grocery market. Our platform now orchestrates billions of decisions from the store floor to the distribution center and prevented over 200 million pounds of food waste last year alone. If you're looking for a role where your work directly translates into massive scale and social good, and you want to be part of the team that defines how the world eats, there is no better time to join us. What You’ll Do Engineering & Data Pipelines: Design, build, and optimize robust ETLs using PySpark and dbt to process large-scale customer datasets while developing tools and frameworks to streamline data integrations and improve scalability. Technical Leadership & Strategy: Define the technical vision for DC data architecture, mentor engineers, and manage external contractors to ensure the team delivers high-quality, practical solutions for current and future needs. Cross-functional Collaboration: Partner with product, engineering, and applied science teams to scope work and deliver data solutions that address real-world challenges in customer data quality and product feature requirements. What Makes You a Great Fit We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification. Significant experience designing and maintaining ETLs that process large-scale datasets. Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or dbt. 2+ years of experience in a technical lead role (e.g. Tech Lead or Engineering Manager), with a willingness to mentor and help others grow. Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions. A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done. Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them. A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort. Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences. We’re looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we’d love to hear from you! This position is not eligible for immigration sponsorship Salary Range in CAD: $148K - $222K Why You’ll Love Working at Afresh At Afresh, our mission to eliminate food waste starts with investing in our people. We provide a comprehensive support system designed to help you do your best work while maintaining a healthy, balanced life. Comprehensive Health & Wellness: Comprehensive medical, dental, and vision coverage for you and your family, with the majority of premiums covered by Afresh. We also provide dedicated mental health support and counseling services. Invested in Your Future: Competitive base salary, meaningful equity (U.S. employees), and a 401(k) program with a generous company match. Flexible & Modern Workspace: Whether you work from home or a local office, we support your setup with a home office stipend and "Coworking Wallets" for flexible workspace access. Growth-Obsessed Culture: We believe in continuous learning. Every employee receives an annual professional development budget to master new skills and grow their career at Afresh. Holistic Monthly Stipends: Beyond your paycheck, we provide monthly stipends for "Betterment" (wellness/lifestyle) and telecommunications to ensure you have what you need to thrive. Time to Recharge: Flexible paid time off to take the time you need to recharge. Full-time U.S. employees are eligible for these benefits About Afresh Founded in 2017, Afresh is using AI to tackle the #1 solution to curb climate change: reducing food waste. By building AI specifically for the intricacies of grocery—from the fresh perimeter to the center store—we help grocers minimize waste and maximize sales. Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals, including ICML, and our investors include Al Gore’s Just Climate, former Whole Foods Market CEO Walter Robb, and Eric Schmidt's Innovation Endeavors. Grocery is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility. Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law. Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI. 244 results found No results found Afghanistan+93 Åland Islands+358 Albania+355 Algeria+213 American Samoa+1 Andorra+376 Angola+244 Anguilla+1 Antigua & Barbuda+1 Argentina+54 Armenia+374 Aruba+297 Ascension Island+247 Australia+61 Austria+43 Azerbaijan+994 Bahamas+1 Bahrain+973 Bangladesh+880 Barbados+1 Belarus+375 Belgium+32 Belize+501 Benin+229 Bermuda+1 Bhutan+975 Bolivia+591 Bosnia & Herzegovina+387 Botswana+267 Brazil+55 British Indian Ocean Territory+246 British Virgin Islands+1 Brunei+673 Bulgaria+359 Burkina Faso+226 Burundi+257 Cambodia+855 Cameroon+237 Canada+1 Cape Verde+238 Caribbean Netherlands+599 Cayman Islands+1 Central African Republic+236 Chad+235 Chile+56 China+86 Christmas Island+61 Cocos (Keeling) Islands+61 Colombia+57 Comoros+269 Congo - Brazzaville+242 Congo - Kinshasa+243 Cook Islands+682 Costa Rica+506 Côte d’Ivoire+225 Croatia+385 Cuba+53 Curaçao+599 Cyprus+357 Czechia+420 Denmark+45 Djibouti+253 Dominica+1 Dominican Republic+1 Ecuador+593 Egypt+20 El Salvador+503 Equatorial Guinea+240 Eritrea+291 Estonia+372 Eswatini+268 Ethiopia+251 Falkland Islands+500 Faroe Islands+298 Fiji+679 Finland+358 France+33 French Guiana+594 French Polynesia+689 Gabon+241 Gambia+220 Georgia+995 Germany+49 Ghana+233 Gibraltar+350 Greece+30 Greenland+299 Grenada+1 Guadeloupe+590 Guam+1 Guatemala+502 Guernsey+44 Guinea+224 Guinea-Bissau+245 Guyana+592 Haiti+509 Honduras+504 Hong Kong SAR China+852 Hungary+36 Iceland+354 India+91 Indonesia+62 Iran+98 Iraq+964 Ireland+353 Isle of Man+44 Israel+972 Italy+39 Jamaica+1 Japan+81 Jersey+44 Jordan+962 Kazakhstan+7 Kenya+254 Kiribati+686 Kosovo+383 Kuwait+965 Kyrgyzstan+996 Laos+856 Latvia+371 Lebanon+961 Lesotho+266 Liberia+231 Libya+218 Liechtenstein+423 Lithuania+370 Luxembourg+352 Macao SAR China+853 Madagascar+261 Malawi+265 Malaysia+60 Maldives+960 Mali+223 Malta+356 Marshall Islands+692 Martinique+596 Mauritania+222 Mauritius+230 Mayotte+262 Mexico+52 Micronesia+691 Moldova+373 Monaco+377 Mongolia+976 Montenegro+382 Montserrat+1 Morocco+212 Mozambique+258 Myanmar (Burma)+95 Namibia+264 Nauru+674 Nepal+977 Netherlands+31 New Caledonia+687 New Zealand+64 Nicaragua+505 Niger+227 Nigeria+234 Niue+683 Norfolk Island+672 North Korea+850 North Macedonia+389 Northern Mariana Islands+1 Norway+47 Oman+968 Pakistan+92 Palau+680 Palestinian Territories+970 Panama+507 Papua New Guinea+675 Paraguay+595 Peru+51 Philippines+63 Poland+48 Portugal+351 Puerto Rico+1 Qatar+974 Réunion+262 Romania+40 Russia+7 Rwanda+250 Samoa+685 San Marino+378 São Tomé & Príncipe+239 Saudi Arabia+966 Senegal+221 Serbia+381 Seychelles+248 Sierra Leone+232 Singapore+65 Sint Maarten+1 Slovakia+421 Slovenia+386 Solomon Islands+677 Somalia+252 South Africa+27 South Korea+82 South Sudan+211 Spain+34 Sri Lanka+94 St. Barthélemy+590 St. Helena+290 St. Kitts & Nevis+1 St. Lucia+1 St. Martin+590 St. Pierre & Miquelon+508 St. Vincent & Grenadines+1 Sudan+249 Suriname+597 Svalbard & Jan Mayen+47 Sweden+46 Switzerland+41 Syria+963 Taiwan+886 Tajikistan+992 Tanzania+255 Thailand+66 Timor-Leste+670 Togo+228 Tokelau+690 Tonga+676 Trinidad & Tobago+1 Tunisia+216 Turkey+90 Turkmenistan+993 Turks & Caicos Islands+1 Tuvalu+688 U.S. Virgin Islands+1 Uganda+256 Ukraine+380 United Arab Emirates+971 United Kingdom+44 United States+1 Uruguay+598 Uzbekistan+998 Vanuatu+678 Vatican City+39 Venezuela+58 Vietnam+84 Wallis & Futuna+681 Western Sahara+212 Yemen+967 Zambia+260 Zimbabwe+263
What you’ll do
Design and optimize robust ETL pipelines using PySpark and dbt to process large-scale customer datasets for distribution center products. Provide technical leadership by defining data architecture vision, mentoring engineers, and collaborating cross-functionally to deliver scalable data solutions.
Requirements
Requires significant experience in large-scale ETL design and proficiency in Python, PySpark, SQL, and platforms like Databricks or Snowflake. Candidates must have at least 2 years of experience in a technical lead role and the ability to handle complex, unclean datasets.
Benefits
• Medical Insurance • Dental Insurance • Vision Insurance • Mental Health Support • Equity • 401k Match • Home Office Stipend • Coworking Wallets • Professional Development Budget • Wellness Stipend • Telecommunications Stipend • Flexible Paid Time Off
Listed skills
- SQLPreferred
- Problem solvingPreferred
- PythonPreferred
- Cross-Functional CollaborationPreferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- PySpark
- SQL
- Databricks
- Snowflake
- Dbt
- ETL Design
- Technical Leadership
- Data Architecture
- Mentoring
- Data Integration
- Problem Solving
- Automation
- Cross-functional Collaboration
Job areas
- Data & Analytics
- Engineering
- Technology
- Software
- Management & Leadership
Additional details
- Minimum experience
- 5+ years
- Apply by
- Oct 9, 2026
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level