Data Architect/Staff Engineer

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Data Architect/Staff Engineer

Responsibilities:

• Validate our proposal on Data Platform Architecture (ML Platform, DWH), which includes Databricks caps usage and integration with external Airflow (AWS MWAA) and other AWS native services.
• Help with developing governance policies around target organization and usage patterns (workspaces organization, IAM including programmatic access to S3 buckets, deeper understanding of data cataloging with Unity Catalog or similar).
• Help with defining granular Finops practices on top of the above-mentioned structure.
• Define architectural best practices using Databricks and data platforms in general, together with our DF team.
• Provide best practices and directional; thinking around Workspace & Infrastructure creation and Isolation guidelines. 

Requirements:

• Proven experience in building cloud-native data-intensive applications, Amazon Web Service experience is a must, and it is good to have experience in GCP
• Design and implement scalable, efficient, and secure data architectures, including data lakes, data warehouses, and data marts
• Experience with data mesh, data fabric, and other methodologies
• Define and enforce data architecture principles, standards, and best practices. Familiarity with modern cloud-native data stack
• Hands-on experience in building and maintaining Spark applications
• Fundamental understanding of various Parquet, Delta Lake, and other OTFs file formats
• English level: B2, C1 (proficient in communication with non-technical stakeholders)
• Extensive experience with Terraform and setting up platforms on Databricks

Offer:

• Private medical care
• Life insurance
• Co-financing for the sports card