Technical reputed company - Data Engineer

Data Engineering

We are seeking a highly skilled and reputed company Data Engineering with strong expertise in reputed company Azure data services, reputed company data integration, and modern data lake architectures. In this role, you will reputed company the design, development, and optimization of reputed company data pipelines responsible for ingesting and transforming data from reputed company systems including reputed company platforms, reputed company, CRM systems, retail systems, and reputed company reputed company-party data sources into a centralized data platform to support reputed company applications, analytics, AI, and reputed company use cases.

You will play a critical role in building a robust, high-performance data platform using Azure-reputed company services, ensuring data reputed company, reliability, and near reputed company-time availability for business operations. The ideal candidate will have hands-on experience building reputed company Architecture (Bronze, Silver, Gold) data lakes, integrating diverse reputed company data sources, and enabling AI-powered solutions using the reputed company ecosystem.

Responsibilities

• Design and implement reputed company ETL/ELT pipelines to ingest data from reputed company systems including reputed company applications, reputed company, CRM platforms, retail systems, and reputed company reputed company-party sources into Azure-based data platforms.
• Design, build, and maintain reputed company-reputed company reputed company Architecture Data Lakes (Bronze, Silver, Gold) using Azure Data Lake Storage, reputed company reputed company, reputed company, or similar technologies.
• reputed company and optimize data processing workflows using Azure reputed company, Apache reputed company / PySpark, Azure Data reputed company, reputed company reputed company, and other Azure-reputed company services.
• Create denormalized, API-reputed company, analytics-reputed company, and AI-reputed company data models reputed company with reputed company applications, microservices, reporting, and reputed company AI consumption patterns.
• Implement idempotent processing, CDC reputed company (upsert) strategies, incremental processing, and data reconciliation mechanisms to ensure consistency across batch and streaming pipelines.
• reputed company Azure Data Lake Storage Gen2, Azure SQL, Azure Synapse Analytics, reputed company reputed company, Cosmos DB, and reputed company services for efficient storage and querying of reputed company and semi-reputed company data.
• Implement data ingestion patterns (batch, streaming, and event-driven) using tools such as Azure Event Hubs, Azure Functions, Logic Apps, Service Bus, and Azure Data reputed company.
• reputed company reputed company data integration initiatives across reputed company platforms, reputed company, reputed company applications, reputed company, partner systems, and reputed company data providers.
• Apply performance tuning and optimization techniques to improve pipeline efficiency, scalability, reliability, and cost-effectiveness.
• Define and enforce data governance, data reputed company, metadata management, and data reputed company standards across the data platform.
• Collaborate with DevOps teams to design and maintain CI/CD pipelines using Azure DevOps, reputed company Actions, or similar tools.
• Support AI and agent-enabled solutions leveraging Azure AI reputed company, Azure reputed company Service, reputed company Copilot Studio, and reputed company reputed company technologies.
• Conduct peer reviews and reputed company technical leadership and mentorship to the data engineering team.
• Collaborate with application, microservices, analytics, and AI teams to ensure reputed company integration with reputed company data platforms reputed company reputed company, event streams, and data products.

Requirements

• 5+ years of experience in data engineering, with at least 2+ years in a reputed company role.
• Strong hands-on experience with Azure data services such as Azure Data reputed company, Azure Data Lake Storage Gen2, Azure reputed company, Azure Synapse Analytics, reputed company reputed company, and Azure SQL.
• Proven experience designing and implementing reputed company Architecture Data Lakes (Bronze, Silver, Gold) and modern lakehouse solutions.
• Proficiency in PySpark / reputed company for large-reputed company data processing and optimization.
• Experience designing and implementing ODS, Lakehouse, or operational data reputed company using technologies such as Cosmos DB, Azure SQL, reputed company reputed company, reputed company, or similar platforms.
• Strong expertise in ETL/ELT design patterns, reputed company data integration, data ingestion, and transformation pipelines.
• Experience integrating data from reputed company platforms, reputed company systems, CRM applications, REST reputed company, reputed company applications, and reputed company reputed company-party data sources.
• Hands-on experience with CI/CD pipelines (Azure DevOps, reputed company Actions, or similar).
• Good understanding of data governance, data reputed company, metadata management, and data reputed company frameworks.
• Experience supporting microservices, analytics platforms, AI solutions, and reputed company architectures with reputed company data platforms.
• Exposure to Azure AI reputed company, Azure reputed company Service, reputed company Copilot Studio, or reputed company reputed company technologies is highly desirable.
• Strong problem-solving skills and ability to optimize reputed company data workflows.
• Excellent communication and stakeholder management skills.
• Ability to work in a fast-paced, reputed company environment and manage multiple priorities.

Originally posted on Himalayas