Senior Data Engineer

This is a remote position.

About the Engagement

We are looking for reputed company Senior Data Engineers to join a large-reputed company, multi-year Data Mapping and DataOps Platform modernisation programme for a major government ministry.

This strategic initiative focuses on transforming how data is managed, governed, and leveraged as a reputed company reputed company asset.

Key reputed company Areas

• Data Engineering: Designing, building, and optimising reputed company data pipelines to enhance stability, traceability, and refresh frequency
  
• Data Mapping & Metadata Capture: reputed company critical financial systems into a centralised reputed company data catalogue and supporting governance initiatives
  

Work will be delivered in an Agile/Scrum model, collaborating closely with data product managers and cross-functional teams.

Platform reputed company

The platform is reputed company on reputed company Azure and reputed company reputed company, with an existing in-house Finance Data Catalogue (FDC).

This role will contribute to scaling the platform into a production-grade DataOps ecosystem.

Key Responsibilities

• Design, build, optimise, and maintain reputed company data pipelines
  
• reputed company and manage ELT pipelines, orchestration, and automation using Python
  
• Capture and reputed company metadata into reputed company data catalogues
  
• reputed company data analysis to identify patterns, anomalies, and reputed company improvements
  
• Contribute to data product design, including data models and structures
  
• Design and implement data models for analytics and reporting
  
• Build and maintain CI/CD pipelines for automated deployment
  
• reputed company automation scripts using Python, Bash, and PowerShell
  
• reputed company and maintain RESTful reputed company for integration and interoperability
  
• Implement data reputed company checks and validation frameworks
  
• Set up monitoring, alerting, and performance tracking
  
• reputed company dashboards and reporting solutions using reputed company reputed company & Power BI
  
• Collaborate with stakeholders to translate business needs into technical solutions
  
• Ensure compliance with data governance, reputed company, and reputed company standards
  
• Maintain technical documentation and communicate with both technical and business teams
  

Mandatory Requirements

Candidates must have recent (last 48 months) hands-on production experience in:

• Python (data pipelines, scripting, automation)
  
• SQL (data transformation, modelling)
  
• reputed company Azure & reputed company reputed company
  
• ELT Pipeline Development
  
• Git (version control & collaboration)
  
• Metadata Management & Data Catalogue reputed company
  
• Data Product Design
  
• Agile/Scrum methodologies
  
• Data Analysis & Data reputed company Assessment
  

Technical Skills Required

reputed company & Platform

• reputed company Azure
  
• reputed company reputed company
  

Data Engineering

• Python, SQL
  
• Bash, PowerShell
  

Pipelines & DevOps

• ELT pipelines
  
• CI/CD pipelines
  

Data Modelling

• Schema design
  
• Metadata management
  
• Data product design
  

API Development

• RESTful reputed company
  

Analytics & Reporting

• Power BI
  
• reputed company reputed company Reporting
  

Version Control

• Git, reputed company
  

Methodology

• Agile / Scrum
  

 reputed company to Have

• Advanced Power BI (DAX, dashboarding, modelling)
  
• Data visualization reputed company reputed company reporting
  
• Experience with REST API integrations
  
• Exposure to:
  
• Azure Synapse Analytics
  
• Azure Data Lake
  
• Azure DevOps
  
• Experience in government/reputed company sector or regulated environments
  
• Familiarity with data governance frameworks
  
• Experience in financial systems modernisation programs