Data Engineer

Important!

The requirement is that you will be available to work in a hybrid mode - 3 days at the office (Lęborska 3B, Gdańsk) and 2 days remote.

About our client

Our client is a digital solutions company helping organizations around the world achieve new thresholds of business performance. They work with clients in banking and financial services, hi-tech and manufacturing, insurance, consumer services, and more. They prepare their clients for sustainable success through experience design, cloud technology, advanced analytics, and business acceleration.

Our client product teams work with a range of Microsoft tools, including .NET, Azure DevOps, MS SQL Server, IIS, and the Microsoft 365 suite. Data Platform team specializes in cutting-edge big data solutions, leveraging the Databricks platform.

About the Role:

We are seeking a talented Data Engineer to join our data team! You will be responsible for designing, building, and optimizing robust data systems that drive our data insights and analytics. If you're passionate about leveraging the latest tools in big data, cloud technology, and machine learning, this role is for you.

Your Responsibilities:

• Design and build scalable data pipelines to support our analytics and machine learning initiatives.
• Develop and implement methods for data collection, transformation, and storage using Databricks and Azure Data Lake.
• Ensure data systems are secure, robust, and optimized for large-scale data processing.
• Build and fine-tune algorithms and predictive models for data processing and analytics.
• Collaborate with cross-functional teams to ensure data alignment and integration across the organization.
• Use SQL, Python, or other scripting languages for data transformation, modeling, and mining.

Requirements:

• 5+ years of experience as a Data Engineer or in a similar role.
• Proficiency with Databricks and Azure Data Lake for data processing and storage.
• Strong command of SQL for data querying and management.
• Experience with Python and related data libraries (e.g., Pandas, PySpark) for data manipulation and transformation.
• Familiarity with Azure Data Factory (ADF) for ETL workflows and data orchestration.
• Knowledge of Power BI for data visualization is a plus.
• Experience with Azure DevOps for version control and CI/CD pipelines is desirable.