Data Engineer - up to SGD15k

We are seeking a Senior Data Engineer. In this position, you will architect, develop, and fine‑tune high‑throughput data systems that power scalable analytics, network telemetry processing, and advanced AI/RAG solutions. You’ll work closely with data scientists, analysts, and system owners to translate complex business requirements into secure, automated, and resilient data pipelines.

Key Responsibilities:

• Build scalable ingestion, transformation, and serving capabilities across a hybrid cloud environment, ensuring reliability, security, and compliance with enterprise standards.
• Optimise batch and streaming workflows using Databricks and Kafka, applying best practices for performance, resilience, and maintainability.
• Deliver high‑quality, secure data to support reporting, machine learning, and GenAI use cases.
• Lead the setup and operationalisation of knowledge bases and retrieval‑augmented generation stacks for agentic AI applications.
• Perform cleansing and transformation using PySpark or SQL based on business requirements.
• Monitor, troubleshoot, and ensure pipeline reliability, while owning production readiness, observability, incident triage, and release coordination.
• Provide guidance on reusable components, code quality, deployment readiness, and production support practices.
• Connect diverse data sources (files, APIs, databases, streams), maintain metadata, and ensure transparency through documentation.
• Work with Microsoft Fabric, Databricks, Delta Lake, and other platform components.
• Drive CI/CD workflows, version control, and enforce data governance, security, and compliance policies.

Requirements:

• Bachelor’s degree in Computer Science, Engineering, or related field.
• At least 5 years of experience in data engineering or cloud‑scale analytics, with proven ownership of production pipelines.
• Strong ability to design, build, optimise, and operate production‑grade batch/streaming pipelines, including orchestration, error handling, and performance tuning.
• Hands‑on expertise in Python and SQL for data transformation and validation.
• Familiarity with Apache Spark (especially PySpark) and large‑scale data processing.
• Experience implementing knowledge bases and RAG solutions for AI use cases.
• Self‑starter with problem‑solving skills, attention to detail, and ability to work independently.
• Skilled at leading technical discussions with engineers, architects, product owners, and stakeholders.
• Solid understanding of enterprise data architecture, cloud security, CI/CD, release management, and production operations for data/AI platforms.

Interested candidates may apply through the application system or send it to [email protected]. Shortlisted candidates will be notified.

By sending us your personal data and curriculum vitae (CV), you are deemed to consent to Morgan Mckinley Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.morganmckinley.com/sg/privacy-policy. You acknowledge that you have read, understood, and agree with the Privacy Policy.

Morgan McKinley Pte Ltd
Koh Boon Sien
EA Licence No: 11C5502
EA Registration No. R1110345