Data Engineer for AI Singapore

Job Description

As part of the data engineering team we work on overseeing and standardizing the data pipeline for our projects. 

We continuously evaluate and adapt industry data components in our pipeline so that the team is equipped with relevant knowledge in addition to working hand-in-hand with our Machine Learning Operations team-mates to provide our AI Engineers with the tools that they need in model training.

Duties & Responsibilities 
●    Build and maintain production infrastructure to be resilient, secure, and high-performing.
●    Build and maintain infrastructure as code to automate our systems’ configuration, 
●    Provision, deploy, and monitoring of infrastructure.
●    Build and maintain AISG platform and tooling stack.
●    Collaborate with AISG partners to design, implement, and deploy new systems 
●    Collaborate with AISG partners to recommend improvements to existing systems
●    Document and Investigate issues arising from our systems when they occur
●    Develop tools and software to improve and automate infrastructure
●    Propose and drive technical decisions to completion
●    Mentor AISG Apprentices and others
 

Qualifications

●    Excellent communication skills, including thoughtful listening skills and the ability to express complex ideas clearly and succinctly.
●    The ability to reason about engineering issues holistically using engineering fundamentals and knowledge about architecture.
●    Possess a systematic approach to development and engineering, such as debugging or object-oriented design, DevOps and MLOps practices, and agile software development.
●    Have held at least one engineering or infrastructure position for a minimum of 2 years.
●    Familiarity with data center environments and appreciation of data center operations.
●    Proficient in at least one commonly used programming language, such as Python, Ruby, Go, Rust, Javascript, Java, C#, etc.
●    Proficient in administering Linux systems.
●    Proficiency in at least one automation tool, such as Ansible, Chef, Puppet, Bash, PowerShell, etc.
●    Familiarity with virtualisation technologies such as KVM, VMWare, etc.
●    Familiarity with the container and container orchestration technologies such as Docker, rkt, Singularity, Kubernetes, Docker Swarm, Helm, etc.
●    Familiarity with AWS, Microsoft Azure, Google Cloud Platform, and cloud deployment tools.
●    Familiarity with distributed systems and related technologies and tools such as high-performance computing cluster systems, Delta Lake, Hive, Spark, Hadoop systems, job/workload schedulers, etc.
●    An aptitude for automated system design and implementation (automated deployments and automated testing).

 

AI Singapore

Company Website
https://aisingapore.org

Job type

Full time

Job location

Hybrid

Closing Date
March 31, 2023

Alternatively, you can send an email to careers@aisingapore.org


Are you an employer? Post your job here.