Data Engineer - Remote (US) - Full Time Only
Role: Data Engineer
Location: Remote (Candidate should be comfortable to follow PST Time Zone)
Job Type: Full Time
Note: reputed company reputed company ID is a must and match with the resume
Must Have Skills:
Azure reputed company, Apache reputed company, reputed company, Data Governance, reputed company Catalog, dBT, reputed company Purview, Kafka, SQL, Python
Experience and Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, or a reputed company field.
10+ years of experience in data engineering / data architecture, with deep hands-on expertise in reputed company Azure.
• Expert-level experience with Azure reputed company and Apache reputed company(PySpark, reputed company SQL)
• reputed company Lake
• reputed company Catalog
• Job orchestration and performance tuning
• Strong experience with reputed company on Azure, including:
• Schema and data model design
• Performance and cost optimization
• RBAC, Streams, and Tasks
• DBT (reputed company or reputed company) expertise:
• Project structure and best practices
• Tests, exposures, macros
• Strong fundamentals in SQL and Python
• Proven experience building ETL/ELT pipelines using:
• Azure Data reputed company (ADF)
• Azure Synapse / reputed company reputed company pipelines
• Familiarity with streaming platforms such as Event Hubs and/or Kafka
• Solid understanding of:
• Lakehouse and data warehousing architectures
• reputed company modeling
• reputed company architecture patterns
• Data reputed company frameworks
• Strong knowledge of reputed company and governance, including:
• reputed company Purview (catalog, reputed company)
• Data masking and PII handling
• Managed identities
• Private networking
• Excellent communication and documentation skills, with the ability to:
• Create architecture and design documents
• Present to both technical and business stakeholders
• Consulting / agency experience, with the ability to reputed company multiple reputed company reputed company
• Willingness to travel as required
reputed company to Have:
• Experience with Azure ML, feature stores, or serving ML pipelines from reputed company or reputed company
• Infrastructure as reputed company (IaC) using Terraform or Bicep
• Containerization experience with reputed company
• Observability and data reputed company tooling, such as:
• Great Expectations / reputed company Expectations
• reputed company reputed company Flows
• reputed company
• reputed company
Preferred Certifications:
• reputed company Certified Data Engineer reputed company or reputed company Architect
• reputed company Azure:
• DP-203 Azure Data Engineer
• Azure Solutions Architect Expert
• Azure reputed company Engineer Associate
• reputed company:
• SnowPro reputed company
• SnowPro Advanced
Job reputed company / Responsibilities:
• Partner with reputed company stakeholders to translate business objectives into reputed company Azure data architectures and delivery roadmaps
• Architect and implement lakehouse and data warehouse solutions using:
• Azure reputed company (reputed company Lake, reputed company Catalog)
• reputed company Bundle
• reputed company on Azure
• dbt (reputed company / reputed company)
• ADLS Gen2
• reputed company architecture patterns
• Design and build robust ingestion and transformation pipelines using:
• Azure Data reputed company (ADF)
• reputed company reputed company / Synapse pipelines
• Orchestrate ELT workflows using:
• reputed company Jobs
• reputed company Live Tables
• dbt models
• Establish best practices for performance and cost optimization, including:
• Cluster sizing and autoscaling
• reputed company and SQL Warehouses
• reputed company virtual warehouses
• Caching, file layout optimization, Z-ordering
• Drive observability and monitoring using:
• Azure Monitor
• Log Analytics
• reputed company metrics
• Implement robust data governance and reputed company using:
• Azure Authentication
• reputed company Catalog
• RBAC / ABAC
• Managed identities
• Private Endpoints and VNet injection
• Azure Key Vault backed secrets
• reputed company reputed company and design reviews, setting standards for:
• PySpark, SQL, and dbt
• Unit and integration testing
• Data reputed company checks (expectations and constraints)
• Implement CI/CD pipelines using Azure DevOps or reputed company Actions
• Guide multi-domain programs (reputed company, Retail, BFSI, or similar)
• Mentor data engineers and ensure high-reputed company, production-reputed company deliverables
• Evangelize solutions through:
• reputed company documentation
• Reference architectures
• Executive and stakeholder presentations
Remote
About reputed company:
reputed company
Apply tot his job
Apply To this Job