Data Engineer

Sunscrapers is a technology consultancy that empowers finance and healthcare leaders to succeed by leveraging cutting-edge software, data, and AI.

We combine world-class engineering, deep industry expertise, and proprietary know-how to deliver innovative, high-impact solutions. Specializing in software engineering, DevOps, data engineering, and data science, we design and build AI-powered data platforms and web applications tailored to each client’s unique needs.

Trusted by over 60 clients across the US, UK, and beyond, we consistently maintain a 4.9/5 client satisfaction rating, with partnerships averaging five years or more.

As a Data Engineer, you’ll play a pivotal role in building a robust data platform that drives engagement solutions for leading healthcare brands. Your work will directly support the development of omnichannel digital health experiences, empowering consumers to access the programs, benefits, and care they need.

In this role, you’ll leverage cutting-edge technologies such as Apache Spark, Databricks, and Delta Tables to design and implement scalable data solutions. You’ll enable actionable insights by integrating diverse data sources, building efficient pipelines, and supporting data-driven decision-making.

Your responsibilities will include:

• Design and optimize data infrastructure using Python, PySpark, Apache Spark, and Delta Spark,
• Implement strong data governance frameworks to ensure quality, security, and compliance,
• Connect Delta Tables to a SQL engine (like Databricks SQL) for efficient querying and analytics,
• Leverage strong DevOps expertise to deploy and maintain data systems in Azure,
• Create batch and streaming pipelines for data processing.

What's important for us?

• At least 3 years of professional experience as a data engineer,
• Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar,
• Excellent command of spoken and written English (at least C1),
• Experience in designing data infrastructure using Python, PySpark, Apache Spark, and Delta Spark,
• Experience in managing production level Databricks clusters,
• Proficiency in SQL and experience with Data Lakehouse,
• Great analytical skills and attention to detail - asking questions and proactively searching for answers,
• Creative problem-solving skills,
• Great customer service and troubleshooting skills.

You'll score extra points for:

• Familiarity with CI/CD pipelines, containerization (Docker) and orchestration (Kubernetes),
• Experience with real-time data tools like Kafka or Azure Event Grid, 
• Experience with BigQuery,
• Experience in managing data governance in the healthcare space.

What do we offer?

• Working alongside a talented team that’s changing the image of Poland abroad.
• Flexible working hours and remote work possibility.
• Comfortable office in a penthouse in central Warsaw equipped with all the necessary tools to conquer the universe (Macbook, external screen, ergonomic chairs).
• Fully equipped kitchen with fruit, hot and cold drinks.
• Multisport card & Private medical care.
• Culture of good feedback: evaluation meetings, mentoring.
• We value and appreciate our engineer's eagerness to learn and improve so we strongly encourage and support their growth!