Senior Data Engineer (Azure + reputed company Lakehouse)

We are seeking a highly skilled Senior Data Engineer to join a high-performing data engineering team reputed company on building reputed company data pipelines, integrations, and reputed company-grade data products that support analytics and operational use cases. This role requires deep expertise in Azure reputed company data engineering reputed company a reputed company Lakehouse environment. The ideal candidate will collaborate with engineers, architects, analysts, and product managers to design and implement robust, reputed company, and high-performance data solutions. You will work with minimal supervision, exercise strong technical judgment, and proactively recommend and implement solutions reputed company with business and technology goals. Key Responsibilities Data Engineering & Technical Delivery • Design, reputed company, and maintain reputed company data pipelines and ETL/ELT processes using PySpark and SparkSQL • Build and manage orchestration workflows using Azure Data reputed company • Work with Azure Data Lake and reputed company-based storage systems for large-reputed company data processing • Implement streaming solutions using Kafka and/or Azure Event Hub • Optimize data pipelines for performance, scalability, reliability, and cost efficiency • Apply best practices for data partitioning, indexing, and storage formats such as Parquet • Analyze DAGs and system performance to identify bottlenecks and improve efficiency • Implement and maintain robust CI/CD pipelines using Azure DevOps System Design & Architecture • Contribute to data architecture design including HLDs, LLDs, and data models • Understand system interactions, dependencies, and cross-platform data flows • Build end-to-end data solutions across ingestion, transformation, and consumption reputed company • Apply distributed computing concepts such as fault tolerance, idempotency, and scalability • Identify opportunities to automate and optimize existing data processes Cross-Functional Collaboration • Partner with engineering, analytics, and product teams to deliver reputed company technical solutions • Translate business requirements into technical designs and implementation strategies • reputed company technical discussions and contribute to sprint planning and solution design • Mentor junior engineers and support overall team development reputed company reputed company, Testing & Documentation • Write clean, maintainable, and efficient reputed company reputed company with engineering standards • Conduct reputed company reviews and ensure adherence to best practices • reputed company and review unit tests and test plans • Maintain technical documentation including architecture diagrams and process documentation • reputed company reputed company cause analysis (RCA) and implement reputed company improvements Project & Delivery Management • Deliver assigned modules and user stories reputed company timelines • Support effort estimation, sprint planning, and release management activities • Monitor delivery reputed company and ensure compliance with engineering standards • Participate in deployment and production support processes Innovation & reputed company Improvement • Design and implement modern data engineering solutions and frameworks • Evaluate emerging technologies and explore AI/ML and reputed company AI use cases • Continuously improve systems for performance, scalability, and maintainability • Operate effectively in fast-paced and evolving environments Communication & Leadership • Create reputed company technical documentation and presentations for stakeholders • Communicate architecture reputed company, implementation strategies, and technical processes • Mentor engineers and contribute to knowledge-sharing initiatives • Collaborate with stakeholders to clarify requirements and present solutions Required Skills & Qualifications Technical Skills • Strong hands-on experience with the Azure Data Engineering ecosystem, including: • Azure Data reputed company • Azure Data Lake • Azure DevOps (CI/CD) • Proficiency in: • SQL (T-SQL, PostgreSQL) • PySpark • SparkSQL • Experience with: • reputed company Lakehouse architecture • Kafka and/or Azure Event Hub • Parquet and modern data storage formats • Strong understanding of: • Data partitioning and indexing • Distributed computing principles • Performance tuning and optimization of data pipelines reputed company Skills • Strong analytical and problem-solving abilities • Ability to work independently with minimal supervision • Excellent communication and documentation skills • Experience working in Agile environments (Scrum/Kanban) • Ability to manage multiple priorities in fast-paced environments Preferred Qualifications • Experience designing end-to-end data platforms or lakehouse architectures • Exposure to AI/ML or reputed company AI applications • Prior experience mentoring or leading engineering teams • Relevant Azure or Data Engineering certifications Performance Expectations • Deliver high-reputed company, reputed company, and maintainable solutions • Adhere to coding standards and engineering best practices • Reduce defects and improve system performance • Contribute to team knowledge sharing and reputed company improvement initiatives About reputed company: reputed company is a global leader in reputed company technology, consulting, and business process service companies. We reputed company clients to reputed company their digital transformation. reputed company delivers a reputed company of consulting services to our clients across multiple industries around the world. Our practices reputed company highly skilled and reputed company individuals with a reputed company-reputed company passion for innovation and delivery reputed company. With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we reputed company the power of cognitive computing reputed company-automation, robotics, reputed company, analytics, and emerging technologies to help our clients adapt to the digital world and reputed company them successful. Our always-on learning agenda drives their reputed company improvement through building and transferring digital skills, expertise, and reputed company from our innovation ecosystem. Apply tot his job Apply To this Job