We are looking for a specialist responsible for managing and developing data ingestion pipelines and Elasticsearch infrastructure. The role focuses on backend data management, including defining which data should be stored, processing information from various sources, managing data structures (adding, removing, modifying fields), and optimizing the ingestion process's performance and quality.
- Manage Elasticsearch environments and data ingestion pipelines.
- Create, modify, and optimize data ingestion pipelines.
- Verify data quality and document structures stored in Elasticsearch.
- Collaborate closely with project and operational teams.
- Monitor, diagnose, and resolve data processing issues.
- Provide expertise to customer service teams regarding data managed within Elasticsearch.
- Experience with Elasticsearch (cluster management, index management, data mapping).
- Ability to design and manage data ingestion pipelines.
- Knowledge of ETL and/or ELT technologies.
- Experience with data processing tools.
- Excellent teamwork and communication skills.
- Proactive and able to solve problems independently.
- Familiarity with the Cribl platform is a plus.
- Familiarity with cybersecurity