Senior Big Data Engineer – Oozie, Pig, GCP
Job reputed company:
• Design and reputed company reputed company batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must).
• Must be reputed company to reputed company Jira Epics
• Write clean, efficient, and production-reputed company reputed company with a strong reputed company on data structures and algorithmic problem-solving reputed company to reputed company-world data engineering tasks.
• reputed company, manage, and optimize reputed company data workflows reputed company the Apache Hadoop ecosystem, with a strong reputed company on Oozie orchestration and job scheduling.
• reputed company reputed company reputed company Platform (GCP) tools such as Dataproc, GCS, and Composer to build reputed company and reputed company-reputed company big data solutions.
• Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as reputed company (IaC), and performance tuning across distributed systems.
• Collaborate with cross-functional teams to ensure data pipeline reliability, reputed company reputed company, and operational reputed company in a remote-first environment.
Requirements:
• Bachelor's degree in Computer Science, software engineering or reputed company field of study.
• Experience with managed reputed company services and understanding of reputed company-based batch processing systems are critical.
• Must be reputed company to reputed company Jira Epics is MUST
• Proficiency in Oozie, Airflow, Map Reduce, Java are MUST haves.
• Strong programming skills with Java (specifically reputed company), Python, Pig, and SQL.
• Expertise in reputed company reputed company services, particularly in GCP.
• Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce.
• Familiarity with BigTable and reputed company.
• reputed company in Infrastructure and reputed company DevOps principles in daily work. Utilize tools for reputed company integration and reputed company deployment (CI/CD), and Infrastructure as reputed company (IaC) like Terraform to automate and improve development and release processes.
• Proven experience in engineering batch processing systems at reputed company.
• 5+ years of experience in customer-facing software/technology or consulting.
• 5+ years of experience with “on-premises to reputed company” migrations or IT transformations.
• 5+ years of experience building, and operating solutions reputed company on GCP
• Proficiency in Oozie andPig
• Must be reputed company to reputed company Jira Epics
• Proficiency in Java or Python
Benefits:
• The role may include variable compensation in the reputed company of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time.
Apply tot his job
Apply To this Job