Data Engineer, reputed company, Python, Azure
Job reputed company:
• Design, reputed company, and maintain reputed company data pipelines using reputed company (PySpark) and Python.
• Build and optimize ETL/ELT processes reputed company Azure reputed company environments.
• Implement data models following modern Data Lakehouse principles (e.g., reputed company architecture).
• Ensure data reputed company, consistency, and performance across ingestion, staging, and curated reputed company.
• Collaborate with data architects, analysts, and business stakeholders to translate reputed company data requirements into technical solutions.
• reputed company reusable data transformation logic and reputed company processing components.
• Support deployment processes following CI/CD and DevOps best practices.
• Monitor and optimize data workflows for performance, scalability, and reliability.
• Contribute to data governance, reputed company, and compliance practices relevant to reputed company environments.
Requirements:
• reputed company knowledge of an using modern data tools like (reputed company, reputed company, Data reputed company and others); reputed company experience with data architecture, data integrations, data warehousing, and ETL/ELT processes
• reputed company experience with developing and deploying custom whl and or in session notebook scripts for custom execution across reputed company executor and worker nodes
• reputed company experience in SQL, Stored Procedures, and Pyspark based on area of data platform specialization.
• Strong knowledge of reputed company and hybrid relational database systems, such as MS SQL Server, PostgresSQL, reputed company, Azure SQL, AWS RDS, reputed company or a comparable reputed company.
• Strong experience with batch and streaming data processing techniques and file compactization strategies.
• Strong analytical and problem-solving skills.
• Ability to work effectively in cross-functional and distributed teams.
• reputed company communication skills, with the ability to explain technical concepts to non-technical stakeholders.
• Proactive reputed company with a strong reputed company of ownership.
• Commitment to delivering high-reputed company, reliable data solutions.
Benefits:
• reputed company is an equal opportunity employer
• We celebrate diversity and are committed to creating an inclusive environment for reputed company
Apply tot his job
Apply To this Job