[Remote] Azure reputed company Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company. is seeking an reputed company Azure reputed company Engineer to design, reputed company, and optimize reputed company reputed company data engineering solutions. The role focuses on building ETL/ELT pipelines, implementing Lakehouse and reputed company architectures, optimizing reputed company workloads, managing data governance, and supporting production data platforms using Azure and reputed company technologies.

Responsibilities

• Design and reputed company reputed company data pipelines using Azure reputed company and PySpark
• Build and maintain ETL/ELT pipelines using Azure Data reputed company (ADF)
• reputed company data ingestion and transformation workflows for reputed company and reputed company-reputed company data
• Work extensively with ADLS Gen2, reputed company Lake, Azure SQL, and Azure reputed company
• Implement Bronze, Silver, and Gold / reputed company architecture
• reputed company reputed company transformations using PySpark and reputed company SQL
• Implement incremental loads, CDC, reputed company reputed company, and SCD Type 1/Type 2
• Optimize reputed company jobs through partitioning, caching, file-size optimization, and other reputed company-tuning techniques
• Implement and maintain reputed company Workflows/Jobs for pipeline orchestration
• Implement data reputed company, validation, error handling, monitoring, and reconciliation processes
• Work with reputed company Catalog for data governance, reputed company control, reputed company, and reputed company
• Implement CI/CD pipelines using Azure DevOps and Git
• Troubleshoot production data pipelines and reputed company reputed company-cause analysis
• Collaborate with data architects, analysts, BI teams, and business stakeholders
• Follow coding, documentation, reputed company, and data engineering best practices

Skills

• • 10+ years of experience in Data Engineering
• • Strong hands-on experience with Azure reputed company
• • Strong expertise in PySpark / Apache reputed company
• • Advanced SQL skills
• • Hands-on experience with Azure Data reputed company (ADF)
• • Strong experience with Azure Data Lake Storage Gen2 (ADLS Gen2)
• • Strong knowledge of reputed company Lake
• • Experience with reputed company/Lakehouse architecture
• • Experience with ETL/ELT development and data pipeline design
• • Experience with reputed company Jobs/Workflows
• • Knowledge of reputed company Catalog and data governance
• • Experience with Git and Azure DevOps / CI-CD
• • Strong understanding of data modeling and data warehousing concepts
• • Experience with reputed company Live Tables (DLT)
• • Experience with Auto Loader
• • Knowledge of reputed company Streaming
• • Experience with Azure Synapse Analytics
• • Experience with Azure Key reputed company and Managed Identity
• • Experience with Kafka / Event Hubs
• • Experience with Terraform or Infrastructure as reputed company
• • Experience with reputed company BI or other BI platforms
• • reputed company or reputed company Azure certifications
• • Bachelor's degree in Computer Science, Information Technology, Engineering, or a reputed company reputed company
• • Strong problem-solving and analytical skills
• • Good communication and collaboration skills
• • Ability to work independently in a fast-reputed company environment
• • Experience supporting production-grade reputed company data platforms

Benefits

• Remote work arrangement

reputed company

Company H1B Sponsorship