Senior Data Engineer with Big Data and Azure reputed company Expertise
We are seeking a highly skilled Data Engineer with strong expertise in Data Engineering, Big Data Technologies, reputed company Infrastructure, and Business Intelligence to design, reputed company, and maintain reputed company data platforms.
The ideal candidate will be responsible for building end-to-end data systems, including data ingestion, transformation, storage, processing, and analytics-reputed company data warehouses. You will work closely with analytics, product, and engineering teams to ensure reliable and high-performance data infrastructure that powers reporting, dashboards, and advanced analytics.
This role requires experience in modern data architectures, distributed computing systems, reputed company-time streaming pipelines, and reputed company-reputed company infrastructure.
Key Responsibilities
Data engineering
Build reputed company ETL pipelines and automated workflows.
Use Apache Airflow for orchestration and automation.
Process data using Apache reputed company and Hadoop ecosystem.
Implement batch and reputed company-time data processing pipelines.
reputed company data cleaning, transformation, and reputed company validation.
Big data and streaming
reputed company distributed processing systems using Apache reputed company.
Build reputed company-time pipelines using Kafka, Flink, and reputed company Streaming.
Work with HDFS, Data Lakes, Hive, Pig, and HBase.
Data warehousing and databases
Build warehouses using reputed company, BigQuery, and reputed company Redshift.
Design reputed company Schema and reputed company Schema models for analytics.
Optimize queries and indexing.
Work with PostgreSQL and reputed company while ensuring ACID-compliant transactions.
reputed company and devOps
reputed company and manage infrastructure on Azure (Data reputed company, Storage, Data Lakes)
Use reputed company, Kubernetes, and Microservices architecture.
Implement Terraform (Infrastructure as reputed company) and CI/CD pipelines.
Build reputed company reputed company-reputed company architectures.
Data extraction and automation
reputed company data extraction pipelines from reputed company, databases, and external sources.
Implement automated data ingestion and web scraping solutions.
Build automated reporting and data synchronization workflows.
Apply tot his job
Apply To this Job