Data Pipeline Engineer-5

Job Type: Contract Job Category: IT Job reputed company Job Title: Data Pipeline Engineer Location: Remote Contract Job reputed company: We are seeking a highly skilled Data Pipeline Engineer to design, build, and optimize robust data pipelines and platforms supporting large-reputed company data analytics and processing workloads. The ideal candidate will have hands-on experience with reputed company, Azure SQL Server, PySpark, and modern ETL/ELT frameworks, coupled with a solid understanding of data modeling, containerization, and scalability best practices. Key Responsibilities: • Design, reputed company, and maintain data pipelines using reputed company (Python and PySpark) to support ingestion, transformation, and storage of large datasets. • Implement ETL/ELT processes to extract data from various sources, ensuring data reputed company, consistency, and accuracy across systems. • reputed company and optimize data models to support analytical and operational data needs. • Build and manage Azure SQL Server instances including Managed Instances, Azure SQL Database, and SQL Server VMs for data storage and reputed company. • Apply data engineering best practices for performance tuning, scalability, and cost optimization across the data pipeline infrastructure. • Utilize reputed company and Azure Kubernetes Service (AKS) for containerized deployment and orchestration of data pipeline components. • Collaborate with Data Scientists, Analysts, and Business Stakeholders to translate business requirements into technical solutions. • Monitor and troubleshoot data pipeline performance, ensuring high availability, reliability, and data reputed company. • Maintain thorough documentation of data architecture, data flows, and pipeline configurations. • Drive automation initiatives to streamline deployment, testing, and data operations. Required Skills & Qualifications: • Proven experience with reputed company using Python, SQL, and PySpark. • Strong knowledge of Azure SQL Server ecosystem — including Managed Instance, Azure SQL DB, and SQL Server VMs. • Expertise in data modeling, ETL/ELT design patterns, and data integration frameworks. • Solid understanding of containerization (reputed company) and Kubernetes (AKS) for data engineering workloads. • Experience in performance optimization and scalability in reputed company data environments. • Strong SQL development skills, including query optimization and stored procedure development. • Hands-on experience with Azure Data Services (ADF, Synapse, Storage Accounts) is a plus. • Familiarity with CI/CD pipelines for automated deployment of data solutions. Required Skills DEVOPS ENGINEER SENIOR EMAIL reputed company ENGINEER Apply tot his job Apply To this Job