Senior Data Engineer

Company Description

Tesco Technology is multi-functional and specialist team that drives operational excellence of services improves scale for our systems and processes globally and creates business leading capabilities.

We are an agile team of an industry-leading team of engineers. We create the future continuous integration and delivery tools for Colleague and Customer & Loyalty areas, solving problems, and developing new features through quality, scalable, performant, and maintainable technical solutions. The solutions that we are responsible for will have a global reach, impacting hundreds of thousands of Tesco colleagues worldwide.

We operate in a DevOps philosophy. We take responsibility for the software through its entire lifecycle. We practice continuous integration, delivery, and support of our code through to production and beyond.

As Tech Hub we cooperate within the group of Tesco Technology Hubs located in the UK, Poland, Hungary, and India.

Job Description

This job requires to be based in/close to Kraków. We currently work in a hybrid model and meet in our office 3 days a week.

The Fulfillment Data department at Tesco Technology is at the forefront of data processing and order fulfillment within the retail and technology industry. This vital department handles a range of responsibilities, including:

• Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.
• Managing critical data related to customer orders, suppliers, and products to ensure the seamless flow of our fulfillment operations.
• Upholding data integrity and security during the processing of order and delivery-related information.

We're expanding and actively seeking a skilled Data Engineer to enhance our data and pipeline architecture, optimizing data flow for cross-functional teams.

Our ideal candidate is an experienced data pipeline builder and enthusiast who enjoys optimizing data systems. As a Data Engineer, you'll collaborate closely with various teams, ensuring consistent, optimal data delivery across all projects.

This role requires self-direction and the ability to support data needs across teams, systems, and products. If you're excited about optimizing our data architecture for the future, we encourage you to apply and shape the future of our data operations.

Responsibilities:

• Problem Solving & Technical Strategy: Address business problems, devise technical strategies (push vs. pull, real-time vs. batch, sync vs. async), and lead high-level design and implementation
• Autonomous Collaboration: Work independently with minimal guidance and collaborate effectively with cross-functional Software Development Engineers (SDEs)
• Exemplary Work: Demonstrate exemplary work in design, delivery, and coding processes, setting examples for the team
• Influence & Communication: Influence the team's technical and business strategy, communicate ideas effectively with stakeholders, and drive convergence for desired outcomes
• Mentorship & Leadership: Proactively mentor the team, participate in hiring, and address design/architectural deficiencies
• Delivery & Process Improvement: Consistently lead the delivery of valuable features and propose/process improvements
• Requirements & Programming: Elaborate on requirements when necessary and showcase deep knowledge of the chosen programming language and toolset
• Code Proficiency: Implement critical components, optimize code, understand threading models, and comfortably use test-driven development (TDD) practices
• Diverse Knowledge: Display knowledge of various programming languages, paradigms, and debugging skills
• Design Skills: Apply appropriate design patterns, develop large features, and understand idempotence, cohesion, SOLID principles, and domain modelling
• Forward Thinking: Anticipate medium-term changes, understand simplicity and code removal, and apply design patterns like CQRS and eventual consistency
• Performance & Development Practices: Focus on automation, build CI/CD pipelines, automate security scanning, and performance testing
• Infrastructure Knowledge: Understand multiple operating systems, scripting techniques, databases, data storage paradigms, PaaS technologies, and infrastructure technologies
• Security Awareness: Write secure code, utilize security tools, and understand server hardening practices

Qualifications

Mandatory skills:

• Data Processing: Apache Spark - Scala or Python
• Data Architecture: ETL, ELT, Medalion Architecture, Data Modeling etc. 
• Data Storage: Apache HDFS or respective cloud alternative
• Lakehouse: Apache Hive/Kyuubi or alternative
• Messaging Middleware: Apache Kafka 
• Workflow Scheduler: Airflow or alternative 
• Resource Manager: Apache Yarn or respective cloud alternative
• DevOps: CI/CD, GitHub Actions or respective alternative

Nice to have skills:

• Kubernetes
• Stream processing
• Configuration management

Unsure if you fit all the criteria? Apply and give us the chance to evaluate your potential – you could be the perfect fit!

Additional information

Hybrid working

We’ve recently moved to hybrid working. We love working from home, but we also love connecting, collaborating, and innovating with our colleagues in person. We meet in our office in Kraków for 3 days a week.

Benefits

Tesco is a diverse and exciting employer, dedicated to being #aplacetogeton, providing career-defining opportunities to all of our colleagues. If you choose to join our business, we will provide you with (for all):

• Permanent contract from the go – as a sign of our trust in your abilities
• MacBook as your tool for work
• Learning opportunities - certified technical training and learning platforms like Udemy, Pluralsight and O’reily
• Referral Bonus
• Sports activities with a personal trainer in the office

Benefits for colleagues on employment of contract only:

• Additional 4 days of paid leave to support your well-being and family life
• Up to 20% yearly salary bonus – based on both individual and business performance
• Private healthcare (LuxMed)
• Cafeteria & Multisport
• Supporting those, who are not yet eligible for full holiday entitlement, by expanding their pool from 20 to 25 days
• Relocation Help
• IP Tax Deductible Costs

If that sounds exciting, then we'd love to hear from you.

Tesco is committed to celebrating diversity and everyone is welcome at Tesco. As a Disability Confident Employer, we’re committed to providing a fully inclusive and accessible recruitment process, allowing candidates the opportunity to thrive and inform us of any reasonable adjustments they may require.