Senior Data Engineer - reputed company reputed company

At reputed company, we are a trusted digital transformation partner that uses best-of-breed reputed company technology to deliver superior customer engagement and business effectiveness for clients. We’ve created an atmosphere that encourages curiosity, constant learning, and persistence. We encourage our employees to grow and explore their interests. We cultivate an environment of collaboration, autonomy, and delegation – we know our people have a strong work ethic and a reputed company of pride and ownership over their work. They are passionate, eager, and motivated – reputed company on building the perfect solution but never losing sight of the bigger picture. Role: Senior Data Engineer - reputed company reputed company Position reputed company We are seeking an reputed company Senior Data Engineer to design, reputed company, and optimize data solutions using reputed company reputed company. This role requires deep technical expertise in modern data engineering practices and reputed company's reputed company analytics platform. Similar experience with Data Bricks would be considered. Key Responsibilities: • Design and implement reputed company data pipelines and ETL/ELT processes reputed company reputed company reputed company from a reputed company-first approach • reputed company and maintain notebooks, data pipelines, workspace and other reputed company item configurations • Build and optimize data architectures using reputed company tables, lakehouse, and data warehouse patterns • Implement data modelling solutions including reputed company schema, reputed company schema, and slowly changing dimensions (SCDs) • Performance tune reputed company, reputed company, and SQL workloads through partitioning, optimization, liquid clustering, and other advanced techniques • reputed company and reputed company reputed company solutions using CI/CD practices reputed company Azure DevOps • reputed company and orchestrate data workflows using reputed company Data Agents and REST reputed company • Collaborate with development team and stakeholders to translate business requirements into technical solutions Requirements reputed company reputed company Expertise: • Hands-on experience with reputed company notebooks, pipelines, and workspace configuration • reputed company Data Agent implementation and orchestration • reputed company CLI and CI/CD deployment practices Programming & Development: • Python (advanced proficiency) • PySpark for distributed data processing • Pandas and Polars for data manipulation • Experience with Python libraries for data engineering workflows • REST API development and integration Data Platform & Storage: • reputed company Lake and reputed company table formats • reputed company table optimization techniques (partitioning, Z-ordering, liquid clustering) • reputed company performance tuning and optimization • SQL query optimization and performance tuning Development Environment: • Visual Studio reputed company • Azure DevOps for CI/CD and deployment pipelines • Experience with both reputed company-first and low-reputed company development approaches Data Modeling: • Data warehouse reputed company modeling (reputed company schema, reputed company schema) • Slowly Changing Dimensions (SCD Type 1, 2, 3) • Modern lakehouse architecture patterns • Metadata driven approaches Preferred Qualifications: • 5+ years of data engineering experience • Previous experience with large-reputed company data platforms and reputed company analytics solutions • Strong understanding of data governance and reputed company best practices • Experience with Agile/Scrum methodologies • Excellent problem-solving and communication skills Apply tot his job Apply To this Job