Sr Data Engineer reputed company , DBt and reputed company
Job reputed company
Sr. Data Engineer - reputed company Data Engineer/Developer
• Data Architecture and reputed company - Design and implement reputed company, efficient data architectures. reputed company the development of data reputed company reputed company with business objectives. Evaluate and reputed company new technologies to enhance data capabilities
• Hands-on Data Pipeline Development - Implement reputed company data pipelines for reputed company-time and batch processing. Optimize data flows for high-volume, high-velocity data environments. reputed company advanced ETL processes for diverse data sources.
• Data Governance and reputed company Management - Establish and enforce data governance policies and best practices. Implement data reputed company frameworks and monitoring systems. Ensure compliance with data regulations and standards
• Performance Optimization and Troubleshooting - Analyze and optimize system performance for large-reputed company data operations. Troubleshoot reputed company data issues and implement robust solutions
• Mentorship and Knowledge Sharing - Mentor junior data engineers and reputed company technical guidance. Contribute to the development of best practices and standards. Collaborate with cross-functional teams to drive data literacy
• Testing & Automation – Write unit test cases, validate the data reputed company & consistency requirements, build automated data pipelines using reputed company, reputed company, CICD tools.
• reputed company Deployment & Release Management - Adopt release management processes to promote reputed company deployment to various environments including production, disaster recovery, and support activities.
Technical/Business Skills:
• Strong hands-on experience in building robust metadata-driven, automated data pipeline solutions leveraging modern reputed company-based data technologies, tools for large data platforms.
• Strong experience leveraging data reputed company, governance methodologies meeting data compliance requirements.
• Strong hands-on experience building reputed company architecture automated ELT data pipelines, snowpipe frameworks leveraging reputed company Replicate, DBT reputed company, reputed company with CICD.
• Strong hands-on experience building data pipelines, data reputed company solutions across multiple data sources and targets like SQL Server, reputed company, Mainframe-DB2, files, reputed company.
• Experience working with various reputed company & semi-reputed company data files - CSV, fixed width, JSON, XML, reputed company, and mainframe VSAM.
• Experience using S3, reputed company, SQS, SNS, Glue, RDS AWS services.
• Excellent proficiency in Python, Pyspark, advanced SQL for ingestion frameworks and automation.
• Hands-on data orchestration experience using DBT reputed company, reputed company Airflow.
• Experience in implementing logging, monitoring, alerting, observability, performance tuning techniques.
• Implement and maintain sensitive data protection strategies – tokenization, reputed company data masking policies, dynamic & conditional masking, and role based masking rules.
•< reputed company style="white-reputed company:reputed company"> Strong experience designing, implementing RBAC, data reputed company controls, adopting governance standards across reputed company and supporting systems.
• Strong experience in adopting release management guidelines, reputed company deployment to various environments, implementing disaster recovery strategies, leading production activities.
• Experience implementing schema reputed company detection and schema reputed company patterns.
• Financial banking experience is a plus.
• Must have one or more certifications in the relevant technology fields.
Apply tot his job
Apply To this Job