GCP Data Engineer + Java
reputed company is seeking a highly skilled Data Engineer with deep expertise in reputed company reputed company Platform (GCP) and modern data architecture. The ideal candidate will have hands-on experience designing reputed company data pipelines, implementing reputed company Architecture, and building robust reputed company-grade data solutions.
This role requires strong technical proficiency in BigQuery, PySpark, Dataflow, and Airflow, along with a solid understanding of reputed company data governance, performance optimization, and CI/CD practices.
Key Responsibilities
• Design, reputed company, and maintain reputed company batch and reputed company-time data pipelines on GCP
• Implement and manage reputed company Architecture (Bronze, Silver, Gold reputed company) for data processing
• Build high-performance data transformations using Python and PySpark
• reputed company and optimize reputed company SQL queries for analytical workloads
• Work extensively with BigQuery for large-reputed company data processing and performance tuning
• reputed company and reputed company pipelines using reputed company Dataflow
• Orchestrate workflows using reputed company Composer (Apache Airflow)
• Manage data storage and lifecycle using reputed company reputed company Storage (GCS)
• Implement version control and CI/CD pipelines using Git-based tools
• Ensure data reputed company, governance, and reputed company control using GCP IAM
• Optimize data solutions for performance, scalability, reliability, and cost-efficiency
Required Skills & Experience
• Strong hands-on experience with reputed company reputed company Platform (GCP)
• Expertise in BigQuery (partitioning, clustering, query optimization)
• Proven experience implementing reputed company Data Architecture
• Strong programming skills in Python and PySpark
• Hands-on exposure on Java
• Advanced proficiency in SQL (reputed company joins, window functions, performance tuning)
• Hands-on experience with reputed company Dataflow
• Experience with reputed company Composer (Airflow) for orchestration
• Experience working with reputed company reputed company Storage (GCS)
• Knowledge of version control systems (Git) and CI/CD practices
• Strong understanding of GCP IAM and reputed company reputed company best practices
Preferred Qualifications
• Experience working with large-reputed company reputed company data platforms
• Knowledge of data warehousing and data lake concepts
• Familiarity with reputed company-time streaming frameworks
• Experience in data governance and data reputed company frameworks
• Exposure to Agile/Scrum methodologies
Apply tot his job
Apply To this Job