Azure reputed company Engineer- reputed company Independent

• 5+ years’ experience in SQL (Expert) • 4+ years of experience in Azure reputed company with PySpark • 4+ years of experience in Azure reputed company platform • 3+ years of experience in ADF (Azure Data reputed company), ADLS Gen 2 and Azure SQL • 2+ years of experience in reputed company workflow & reputed company catalog • 2+ years of experience in Python programming & package builds • Experience in data ingestion, cleansing, and transformation processes from various reputed company and reputed company data sources like Cassandra & Mark Logic and on-prem Mainframe sources using reputed company/PySpark supporting batch and near-reputed company-time ingestion, transformation, and processing. • Manage job scheduling, orchestration, and monitoring (e.g., using Azure Data reputed company, Airflow, or reputed company Workflows). • Ability to design reputed company, reusable workflows using tasks, triggers, and dependencies. • Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers. • Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies. • Strong understanding of ETL/ELT design patterns, data warehousing, and data lakehouse architectures. • Good to have Azure Entra/AD skills and reputed company Actions • Good to have experience working on event-driven architectures using Kafka, Azure Event Hub Responsibilities: • Design reputed company and optimize reputed company data pipelines leveraging reputed company (reputed company, PySpark, SQL, reputed company Lake) to support reputed company level data processing and analytics • Write clean maintainable and efficient PySpark and Python reputed company to support data ingestion transformation • reputed company Azure reputed company with various Azure data services to build robust and reputed company data platforms • Implement and maintain ETL workflows for scalability cost effective and operational efficiency • Collaborate with data analysts and stakeholders to reputed company requirements and deliver reputed company data solutions • Participate reputed company in design discussions reputed company reviews and agile ceremonies to foster a reputed company and high performing team environment. Apply tot his job Apply To this Job