Data Engineer

7+ years

Responsibilities:

• Design, develop, and maintain efficient and scalable data pipelines and ETL processes for processing large datasets.
• Collaborate with data scientists, analysts, and other teams to understand data requirements and ensure data availability and quality.
• Work with Snowflake to manage data warehousing solutions, ensuring optimal performance and storage efficiency.
• Develop and implement data models to support reporting, analytics, and machine learning applications.
• Write high-quality code in Java or Python to process, clean, and transform data.
• Manage data architecture and ensure effective integration of various data sources.
• Troubleshoot, optimize, and ensure the health of data pipelines and systems.
• Create and maintain documentation for data processes, ETL workflows, and data models.
• Stay up-to-date with emerging trends and technologies in data engineering to continuously improve our systems and processes.

Requirements:

• 7+ years of hands-on experience in data engineering, working with large-scale data systems and data warehousing.
• Extensive experience with Snowflake for data warehousing, data modeling, and performance tuning.
• Strong programming skills in Java or Python for building ETL processes and data pipelines.
• Experience in designing and implementing data models, ensuring efficient and scalable data storage solutions.
• Proficiency in ETL processes, including data extraction, transformation, and loading from multiple sources.
• Solid understanding of database management systems, data storage architectures, and data quality practices.
• Experience with cloud platforms (e.g., AWS, Azure, or Google Cloud).
• Strong problem-solving skills with the ability to troubleshoot complex data issues.
• Excellent communication skills and the ability to work collaboratively in a cross-functional team.

Preferred Qualifications:

• Experience with other data warehousing technologies such as Redshift, BigQuery, or similar.
• Knowledge of data governance, data security, and compliance practices.
• Familiarity with orchestration tools like Apache Airflow or similar.
• Experience with machine learning pipelines and frameworks.