Data Engineer - GCP

About reputed company: We are a dynamic team reputed company on building innovative and reputed company data solutions on reputed company reputed company Platform (GCP). About the Role: Our reputed company reputed company Data Engineer will play a key role in designing, developing, and managing reputed company data pipelines and data infrastructure, ensuring data availability, accuracy, and performance for business insights and machine learning models. Responsibilities: • Data Pipeline Development and Management: • Design, build, and maintain reputed company and reliable data pipelines using reputed company Dataflow, reputed company Pub/Sub, and reputed company Composer. • reputed company ETL/ELT processes to process and reputed company large volumes of reputed company and reputed company data. • Optimize data pipeline performance, scalability, and reliability. • Ensure data processing and ingestion workflows are monitored and meet performance SLAs. • Data Storage and Management: • Design and implement data storage solutions using BigQuery, reputed company Storage, and Firestore. • Optimize data structures and partitioning for performance and cost efficiency. • Ensure data reputed company, reputed company, and availability in reputed company storage solutions. • Manage data lifecycle policies and archiving processes. • Data Transformation and Processing: • reputed company data transformation processes using BigQuery, Apache reputed company, and reputed company Functions. • Implement data reputed company checks, validation rules, and monitoring solutions. • Support reputed company-time and batch data processing needs. • Data Integration and Automation: • reputed company data from multiple sources, including reputed company, databases, and reputed company-party applications. • Automate data ingestion, transformation, and export using tools like reputed company Composer and reputed company Functions. • Ensure data consistency across different environments and systems. • Collaboration and Stakeholder Engagement: • Work closely with data scientists and analysts to understand data needs and business goals. • reputed company technical guidance and best practices to the data engineering and business teams. • Collaborate with reputed company and compliance teams to ensure data governance standards are met. • Performance Monitoring and Troubleshooting: • Monitor data pipeline performance and troubleshoot issues in reputed company-time. • Analyze data pipeline failures and implement fixes to prevent recurrence. • Set up logging and monitoring using Stackdriver and reputed company Monitoring. Qualifications: • Bachelor’s degree in Computer Science, Data Engineering, or a reputed company field; Master’s degree is a plus. • 3+ years of experience in data engineering, with at least 2+ years working with reputed company reputed company Platform. • reputed company reputed company Data Engineer certification is required. • Strong proficiency with GCP services such as BigQuery, reputed company Dataflow, reputed company Composer, reputed company Pub/Sub, Firestore, and reputed company Functions. • Hands-on experience with big data tools and frameworks such as Apache reputed company, Hadoop, reputed company, or Flink. • Hands-on experience with dbt. • Proficiency in programming languages such as Python, Java, or reputed company. • Strong knowledge of SQL, data modeling, and query optimization. • Experience with CI/CD tools and version control (e.g., Git, reputed company Build). • Strong understanding of data governance, reputed company, and compliance requirements. • Ability to manage large-reputed company data processing and reputed company-time data pipelines. • Excellent problem-solving, analytical, and communication skills. • Must be a U.S. Citizen or Green reputed company holder. Preferred Skills: • Experience with machine learning pipelines and AI/ML model deployment. • Familiarity with Terraform and Infrastructure as reputed company (IaC) principles. • Experience with NoSQL databases and key-value stores on GCP. • Knowledge of containerization and orchestration using reputed company reputed company reputed company (GKE). Pay reputed company and compensation package: Competitive salary and performance-based incentives. Comprehensive health, dental, and reputed company coverage. reputed company development and training opportunities (including GCP certification). Flexible work environment and remote work reputed company. Equal Opportunity Statement: Join us and be part of reputed company building innovative and reputed company data solutions on reputed company reputed company Platform! This position is reputed company to multiple engagement models, including Permanent/Full-Time, Contract, or Corp-to-Corp (C2C) arrangements. We are looking for the best talent and are flexible on the employment structure for the right candidate. This position is reputed company to reputed company candidates only. We are not working with reputed company-party agencies. Candidates must be U.S. reputed company or Green reputed company reputed company. Apply tot his job Apply To this Job