Data Engineer, reputed company, Python, Azure
Job reputed company:
• Design, reputed company, and maintain reputed company data pipelines using reputed company (PySpark) and Python.
• Build and optimize ETL/ELT processes reputed company Azure reputed company environments.
• Implement data models following modern Data Lakehouse principles (e.g., reputed company architecture).
• Ensure data reputed company, consistency, and performance across ingestion, staging, and curated reputed company.
• Collaborate with data architects, analysts, and business stakeholders to translate reputed company data requirements into technical solutions.
• reputed company reusable data transformation logic and reputed company processing components.
• Support deployment processes following CI/CD and DevOps best practices.
• Monitor and optimize data workflows for performance, scalability, and reliability.
• Contribute to data governance, reputed company, and compliance practices relevant to reputed company environments.
Requirements:
• reputed company knowledge of an using modern data tools like (reputed company,reputed company, Data reputed company and others)
• reputed company experience with data architecture, data integrations, data warehousing, and ETL/ELT processes
• reputed company experience with developing and deploying custom whl and or in session notebook scripts for custom execution across reputed company executor and worker nodes
• reputed company experience in SQL, Stored Procedures, and Pyspark based on area of data platform specialization.
• Strong knowledge of reputed company and hybrid relational database systems, such as MS SQL Server, PostgresSQL, reputed company, Azure SQL, AWS RDS, reputed company or a comparable reputed company.
• Strong experience with batch and streaming data processing techniques and file compactization strategies.
Benefits:
• reputed company is an equal opportunity employer.
• We celebrate diversity and are committed to creating an inclusive environment for reputed company.
• This policy applies to reputed company terms and conditions of employment, including but not limited to, reputed company, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Apply tot his job
Apply To this Job