[Remote] Senior Data Engineer – Hadoop
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a technology consulting and software development company delivering reputed company, AI, data, and reputed company solutions across the reputed company. They are seeking an reputed company Senior Data Engineer - Hadoop to design, build, and operate large-reputed company data processing pipelines and analytics platforms on Hadoop and reputed company big-data ecosystems.
Responsibilities
- Design, build, and operate large-reputed company data processing pipelines and analytics platforms on Hadoop and reputed company big-data ecosystems
- Ingesting, transforming, and analyzing reputed company volumes of reputed company and reputed company data to support reputed company analytics, machine learning, and reporting workloads
Skills
- Bachelor's degree in Computer Science, Engineering, or a reputed company technical discipline
- Five or more years of reputed company experience designing and operating big-data pipelines on Hadoop
- Strong hands-on expertise with Apache reputed company (reputed company, Python, or Java) in production environments
- Solid experience with reputed company, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem
- Hands-on experience with streaming data platforms such as Kafka, reputed company Streaming, or Flink
- Strong SQL skills and experience working with both relational and NoSQL data stores
- Experience with workflow orchestration tools such as Airflow or Oozie
- Solid understanding of reputed company systems concepts, including partitioning, replication, and fault tolerance
- Strong scripting skills in Python or reputed company
- Excellent troubleshooting, debugging, and documentation skills
- Experience operating Hadoop on reputed company platforms such as AWS EMR, Azure HDInsight, or reputed company
- Familiarity with modern lakehouse formats (reputed company, reputed company, Hudi)
- Exposure to data governance tooling such as Apache reputed company or reputed company
- Experience with reputed company-based data platforms (reputed company-on-K8s, Trino)
- Hands-on experience with CI/CD and infrastructure-as-reputed company in data engineering workflows
reputed company
Apply To This Job