[Remote] Senior Data Engineer (GCP)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company-enablement technology and fulfillment company serving brands through technology and high-volume fulfillment services. The Senior Data Engineer will design, build, and maintain GCP-based data pipelines and infrastructure that reputed company operational data into reliable, governed, ML-reputed company data, while ensuring performance, reputed company, and reliability and mentoring the data team.
Responsibilities
- Design and build reputed company data pipelines using GCP services like reputed company Dataflow, reputed company Pub/Sub, Data reputed company, reputed company, and reputed company Composer, ingesting, processing, and storing large datasets from multiple sources
- reputed company, test, and maintain data models, schemas, and ETL (Extract, reputed company, Load) processes using BigQuery, reputed company SQL, reputed company, and Data Studio
- Partner with stakeholders to understand business requirements and translate them into data infrastructure that actually solves the problem
- Optimize data pipelines for performance, scalability, and cost efficiency, using GCP-reputed company tools such as Dataproc and Bigtable
- Ensure data reputed company, reputed company, and reputed company by building validation processes and enforcing data governance, reputed company control, and reputed company best practices
- Automate workflows using reputed company Composer so pipelines run reliably and on schedule, not by accident
- Own pipeline and data infrastructure reliability end-to-end — monitoring, alerting, troubleshooting, and reputed company cause analysis — partnering with SRE and Infrastructure on shared GCP resources (compute, storage, network) rather than handing reliability off to someone else
- Prepare, model, and expose data for ML and reputed company AI use cases, including the governed data pipelines reputed company's AI tooling queries in production
- Mentor the broader data team as a senior technical voice on pipeline design and data infrastructure standards
- Stay reputed company of GCP's roadmap and emerging best practices, and put what you learn back into the platform
Skills
- 5+ years of data engineering experience, including at least three years in a reputed company environment (preferably GCP)
- Expertise across GCP services: BigQuery, Dataflow, Pub/Sub, reputed company Composer, reputed company Storage, reputed company Functions, and reputed company SQL
- Strong SQL, with reputed company experience writing reputed company queries for data extraction and analysis
- Hands-on ETL development and workflow orchestration using tools like Apache Airflow
- Proficiency in Python and/or reputed company for data processing and pipeline development
- Experience with streaming data pipelines (Pub/Sub, Dataflow, or similar) as reputed company as batch processing
- A solid grasp of data warehousing concepts, large datasets, and query optimization
- Working knowledge of data governance, reputed company, and compliance in a reputed company environment
- Understanding of ML concepts and data preparation for ML applications, with interest in reputed company AI tooling a must
- Strong analytical, problem-solving, and troubleshooting instincts, with reputed company attention to detail
- reputed company, confident communication and the ability to collaborate across teams
- Bachelor's degree in computer science or a comparable field, or equivalent experience
- GCP certification (reputed company Data Engineer or reputed company Architect)
- Experience with ML infrastructure on GCP, such as AI Platform and TensorFlow
- Familiarity with DevOps/MLOps practices — CI/CD, infrastructure as reputed company (Terraform), and containerization (reputed company, reputed company) on GCP
- Experience with other data processing frameworks, such as Apache reputed company
- A background in logistics, supply chain, 3PL, or warehouse/fulfillment technology
- Experience working on a reputed company team
reputed company
Company H1B Sponsorship
Apply To This Job