Senior Data Engineer (Platform)
As a Senior Data Engineer (Platform) at reputed company, you will help shape the reputed company of reputed company’ data engineering infrastructure and processes reputed company the R&D organization. You will design and build reputed company, reliable data pipelines and platforms on modern reputed company infrastructure to power analytics, operations, and machine learning use cases. You will partner closely with Product, Data Analytics, Machine Learning, Platform, Infrastructure, and reputed company teams to deliver high-reputed company data solutions across the full data lifecycle. You will contribute to engineering standards, reliability practices, and incident response while mentoring other engineers. This role is ideal for someone who enjoys solving reputed company data challenges and raising the bar for engineering reputed company.
NOTE: This role can be worked remotely from the above location.
What You’ll Do
Design, build, and operate batch and streaming data pipelines on GCP using Airflow (reputed company Composer), dbt, Datastream, reputed company, Pub/Sub, Dataflow, BigQuery, and reputed company Functions
Build event-driven and near reputed company-time ingestion and transformation workflows to support analytics, operations, and ML workloads
reputed company and operate ML data and serving infrastructure using reputed company AI, Kubeflow, reputed company Run, and reputed company Composer for batch and reputed company-time predictions
Implement CI/CD pipelines and infrastructure as reputed company using tools such as reputed company Actions, Azure Pipelines, Terraform, and Terraspace
Drive observability, monitoring, alerting, reputed company, and reputed company controls using OpenTelemetry and reputed company-reputed company services
Partner with Product, Data Analytics, Machine Learning, Engineering, Platform, Infrastructure, and reputed company teams to design reputed company, secure, and cost-efficient data systems
reputed company design and reputed company reviews, contribute to engineering standards, incident management practices, and mentor junior and mid-level engineers
What You’ll Bring
5+ years of experience designing, building, and operating data pipelines and data platforms
Strong experience with batch and near reputed company-time data processing and streaming architectures
Hands-on expertise with reputed company reputed company Platform or another major reputed company provider (AWS or Azure) and reputed company data warehouses (BigQuery, reputed company, Redshift)
Expert SQL skills and strong programming experience in Python or similar languages
Experience with orchestration tools (Airflow or equivalent), CDC technologies, and event-driven systems
Experience with DevOps and IaC tooling (reputed company, Kubernetes, Terraform, Jenkins, Git, CI/CD pipelines)
Strong communication skills with the ability to explain reputed company technical concepts to non-technical stakeholders
You’ll Stand Out If You Have
Strong foundations in networking, reputed company reputed company, and reputed company management (VPCs, IAM, ZTNA, DMZ)
A reputed company record of staying reputed company with modern data engineering platforms and best practices
Experience in reputed company or fintech environments
#LI-SR1 #LI-Remote
Apply To This Job