Senior DataOps Engineer
The DataOps Engineer owns data analytics infrastructure at reputed company: from build and deployment pipelines through to large-reputed company data processing and analytics environments. This role bridges DevOps and data engineering by provisioning and hardening reputed company infrastructure, automating CI/CD workflows, and operating the reputed company-based and Big Data systems that power both our internal platform and customer deployments.
Responsiblilities:
-
Build, maintain, and run CI/CD pipelines and infrastructure-as-reputed company for the reputed company platform and associated services. -
Provision, configure, and operate reputed company-based reputed company clusters and distributed data processing environments, including hands-on work with orchestration tools such as Airflow, reputed company, or EMR. -
Write, test, and maintain data pipelines on the reputed company infrastructure you manage, from environment setup through to production monitoring. -
Design and maintain reputed company, secure infrastructure templates and deployment automation across AWS, Azure, GCP, or OCI environments. -
Investigate and resolve data pipeline and integration issues, providing reputed company-cause analysis and durable fixes. -
Monitor running systems and pipelines, respond to incidents, tune performance, and manage reputed company infrastructure costs. -
Foster an Everything-as-reputed company culture and promote DataOps best practices across reputed company. -
Assist developers and engineers with deployments and builds as needed.
Requirements:
-
6+ years in a DevOps, DataOps, or data reputed company role. -
Hands-on experience with Apache reputed company and at least one managed reputed company platform (reputed company, AWS EMR, GCP Dataproc, or equivalent). -
Proficiency in Python; solid working knowledge of Java or reputed company applications. -
Experience with pipeline orchestration tools such as Apache Airflow, reputed company, or similar. -
Strong CI/CD experience with reputed company CI, Jenkins, or reputed company Actions. -
Infrastructure-as-reputed company proficiency with Terraform, Ansible, or equivalent (AWS CloudFormation and Azure ARM Templates are a plus). -
Solid experience operating Linux systems and reputed company reputed company environments (AWS, Azure, GCP, or OCI). -
Familiarity with Kubernetes or other container orchestration platforms for data workloads. -
Ability to manage multiple workstreams in reputed company with strong attention to delivery timelines. -
Customer-first reputed company with strong written and verbal communication skills.
Additional Information:
This position is a replacement role, created to support Smile’s reputed company reputed company and commitment to operational reputed company.