AWS Data Engineer with Python

ROLE PROFILE:

Are you ready to take your engineering career to the next level? Join us as a Mid Lead Engineer and contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. Be part of a dynamic team, driving innovation and scalability for data solutions in a supportive and hybrid work environment.

ROLE SUMMARY:

This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will design, implement and optimize ETL workflows using Python and Spark, contributing to our robust data lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills and the ability to collaborate effectively within an agile team.

WHAT YOU'LL BE DOING:

• Design, build, and maintain robust, scalable and efficient ETL pipeline s using Python and Spark.
• Develop workflows leveraging AWS services such as EMR Serverless, Glue, Glue Data Catalog, Lambda and S3.
• Implement data quality frameworks and governance practices to ensure reliable data processing.
• Collaborate with cross-functional teams to gather requirements, provide technical insights and deliver high-quality solutions.
• Optimize existing workflows and drive migration to a modern data lakehouse architecture, integrating Apache Iceberg.
• Enforce coding standards, design patterns, and system architecture best practices.
• Monitor system performance and ensure data reliability through proactive optimizations.
• Contribute to technical discussions, mentor junior team members and foster a culture of learning and innovation.

WHAT YOU'LL BRING:

Essential Skills

• Expertise in Python and Spark, with proven experience in designing and implementing data workflo ws.
• Hands-on experience with AWS EMR Serverless, Glue, Glue Data Catalog, Lambda, S3, and EMR.
• Strong understanding of data quality frameworks, governance practices and scalable architectures.
• Practical knowledge of Apache Iceberg within data lakehouse solutions.
• Problem-solving skills and experience optimizing workflows for performance and cost-efficiency.
• Agile methodology experience, including sprint planning and retrospectives. Excellent communication skills for articulating technical solutions to diverse stakeholders.

Desirable Skills

• Familiarity with additional programming languages such as Java.
• Experience with serverless computing paradigms.
• Knowledge of visualization or reporting tools.

YOUR PACKAGE WHEN JOINING GDYNIA TEAM:

• Bonus: bonus plan assigned to every position
• Wellbeing: monthly wellness and work-from-home allowance, and employee assistance program
• Lunch card: meal allowance on personal lunch card provided monthly
• Healthcare: private medical care with Medicover, premium package fully covered by employer and life insurance with Generali
• Future: corporate pension plan supported by Fidelity International offering additional 5% of base salary to invest in selected funds, and LSEG Employee Share Purchase plan available
• Reward and Recognition: additional awards and vouchers available for extra achievements
• Referral: Bonus between 8,000 to 10,000 PLN for successful recommendation of a new colleague
• Development: E-learning platforms access with a range of training and certified courses
• LSEG Products: availability to access to real-time economic data through our flagship Workspace platform
• Diversity: Inclusive culture built by colleagues from over 40 countries representing various age, gender, race, and beliefs
• Charity: 2 additional days off for voluntary jobs
• Office: brand new, sustainable office with cafeteria and chillout space. Location 3T Office, Gdynia is less than 200m to PKM station and a walking distance to SKM station. Underground car park with 122 spaces for LSEG employees
• Activities: sport teams and social events to join e.g. weekly yoga classes in the office
• Company events: Annual Summer and Winter Parties for colleagues and Family Day for employees with partners and children

Proud to share LSEG in Poland is Great Place to Work certified (Feb ’24 – Feb ’25).

Learn more about life and purpose of our company directly from the Gdynia colleagues’ video: https://www.lseg.com/en/careers/where-we-work/gdynia-poland Follow us on Facebook, Carers at LSEG Gdynia

London Stock Exchange Group is acting as an Employment Agency in relation to this vacancy.