Junior Data Engineer

Mandatory Requirement

1. 2–4 years of data engineering or backend development experience Familiarity with Agile delivery
2. Working knowledge of SQL and Java or Scala
3. Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka
4. Familiarity with containerised deployment, Kubernetes and S3-compatible object storage
5. Experience implementing mappings, transformations, validation checks and scheduled workflows, and supporting pipeline monitoring and defect resolution under guidance
   

Preferred

1. Familiarity with the SAFe framework
2. Familiarity with Apache Kafka, Apache Spark, Apache Flink or comparable processing technologies, and
3. MinIO or equivalent S3-compatible object storage
4. Familiarity with relational databases, Git, CI/CD, Docker and automated testing
5. Equivalent Technologies : Apache Spark or equivalent data-processing frameworks; Apache Airflow or equivalent workfloworchestration tools; other S3-compatible object-storage platforms