Enterprise Data & AI Platform Engineer

Technical Skills

Core Skills (Must Have)

• Cloudera Data Platform (CDP)

• Cloudera Machine Learning (CML)

• Hadoop Ecosystem (HDFS, YARN, Hive, Impala, Ozone) Apache Spark

• Hybrid Cloud Architecture (AWS & On-Premises)

• AWS Core Services (EC2, EKS, IAM, S3, VPC, CloudWatch)

• AI/ML Infrastructure Support (GPU, Containers, Kubernetes)

• AI/ML Services: SageMaker/Bedrock/OpenSearch/Glue/Athena/EMR

Preferred Skills

• Vulnerability Management, Security Patching, Hardening & Compliance Management

• Platform Upgrade, Migration & Maintenance Activities

• Microservices Architecture & REST APIs

• Certificate & Secrets Management

• OpenShift / Kubernetes Administration

• Hybrid Infrastructure Operations (AWS & On-Prem)

• MLOps Platforms and AI Model Lifecycle Management

• Linux / Unix Administration

• OpenShift / Kubernetes Administration

• Platform Monitoring, Troubleshooting & Performance Tuning

Good to Have

• Cloudera Certifications (CDP, CML, Cloudera Administrator)

• Big Data Certifications (Spark, Iceberg, Hadoop)

• AWS Certifications:

  • AWS Certified Solutions Architect

  • AWS Certified AI Practitioner

• Experience with CI/CD Tools (Jenkins, GitLab CI/CD, GitHub Actions, ArgoCD)

• Infrastructure as Code (Terraform, Ansible, CloudFormation)

• Experience with SRE Practices, Observability & Monitoring Platforms

• Exposure to Data Lakehouse Architectures and Apache Iceberg

• Experience supporting Generative AI platforms and LLM workloads

• Knowledge of Vector Databases, RAG Architectures and AI Governance

• DevSecOps and Cloud Security Best Practices

• Multi-Cloud or Hybrid Cloud Platform Management

Why Join

Join a team that powers OCBC's enterprise Data, Analytics, and AI platforms across hybrid cloud environments. You'll work with leading technologies including Cloudera CDP/CML, AWS Cloud, Big Data, and AI/ML platforms, while driving innovation, reliability, and operational excellence.

How You Succeed

Success in this role comes from your ability to manage and optimize complex hybrid cloud data platforms, automate operations, resolve issues proactively, and collaborate effectively with Data, AI/ML, Infrastructure, Security, and SRE teams.

What You Do

• Administer and support Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Spark environments across AWS and on-premises infrastructure.

• Manage platform upgrades, security patching, vulnerability remediation, certificate management, and platform hardening activities.

• Support containerized platforms on Kubernetes, OpenShift, and AWS EKS, ensuring high availability and performance.

• Monitor, troubleshoot, and optimize Data, Analytics, AI/ML, and Generative AI platforms including AWS services such as SageMaker, Bedrock, EMR, and S3.

• Automate operational processes using Shell/Python scripting and collaborate with Infrastructure, Security, and SRE teams to improve platform reliability and scalability.

Who You Are

• A degree in Computer Science, Information Technology, or a related field

• At least 3 years of experience in software development, preferably in a banking or financial services environment

• Proficient in one or more programming languages, such as Java, Python, or C++

• Experience with Agile development methodologies and version control systems such as Git

• Strong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutions

• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams

• Diploma or Degree in Computer Science, Information Technology, Engineering, or a related discipline.

• 5-8 years of experience supporting enterprise Data, Analytics, or AI/ML platforms, with hands-on expertise in Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Apache Spark.

• Strong experience in hybrid cloud environments, including AWS services (EC2, EKS, IAM, S3, CloudWatch) and on-premises infrastructure, with knowledge of Kubernetes/OpenShift and Linux administration.

• Proven experience in platform operations, upgrade and maintenance activities, security patching, incident management, troubleshooting, and automation using Shell and/or Python scripting.