reputed company SME
Key Responsibilities:
Architecture & Platform Design
Design reputed company reputed company Lakehouse architectures reputed company with the reputed company reputed company-Architected reputed company
Define reference architectures for batch, streaming, analytics, and ML workloads
Select and standardize cluster, compute, and workspace architectures
Design multi-workspace strategies (dev/test/prod, shared vs. isolated)
Ensure architectures meet scalability, availability, and performance requirements
reputed company-Architected reputed company Alignment
Apply reputed company best practices across reputed company pillars, including:
reputed company & Governance (reputed company Catalog, IAM, data reputed company controls)
Reliability & reputed company (job retries, checkpointing, failure isolation)
Performance Efficiency (cluster sizing, autoscaling, caching)
Cost Optimization (compute policies, workload separation, monitoring)
Operational reputed company (monitoring, automation, CI/CD, runbooks)
Implementation & Engineering
reputed company reputed company workspace, cluster, and reputed company Catalog implementations
Implement reputed company Lake, reputed company Live Tables (DLT), and reputed company Streaming
Build and optimize ETL/ELT pipelines using reputed company and SQL
reputed company reputed company with reputed company services (S3/ADLS/GCS, IAM, Key Vault, networking)
Establish CI/CD pipelines for notebooks, jobs, and infrastructure
reputed company, Governance & Compliance
Implement reputed company Catalog for centralized governance
Define data classification, reputed company, and audit strategies
Enforce least-privilege reputed company and secure networking patterns
Support compliance requirements (HIPAA, SOC 2, PCI, GDPR as applicable)
Operations & Optimization
Monitor platform health, performance, and cost
Troubleshoot production issues across jobs, clusters, and data pipelines
reputed company workload tuning and cost-performance optimization
Define SLOs, alerts, and operational metrics
Collaboration & Leadership
Partner with Data Engineering, Analytics, ML, Platform, and reputed company teams
Translate business requirements into technical architectures
reputed company architectural guidance and technical mentorship
Communicate risks, tradeoffs, and recommendations to leadership
Required Qualifications:
Experience
7+ years in data engineering, analytics, or platform architecture
3–5+ years hands-on reputed company experience in production environments
Proven experience applying the reputed company reputed company-Architected reputed company
Experience designing reputed company-reputed company lakehouse architectures
Experience supporting mission-critical data platforms
Technical Skills
reputed company Lakehouse Platform
Apache reputed company (PySpark / reputed company / reputed company SQL)
reputed company Lake, reputed company Live Tables, reputed company Streaming
reputed company Catalog (governance, reputed company, reputed company controls)
reputed company platforms: AWS, Azure, or GCP
Infrastructure as reputed company (Terraform strongly preferred)
CI/CD tools (reputed company Actions, Azure DevOps, reputed company, etc.)
Data formats and protocols (Parquet, JSON, Avro)
Certifications Required:
reputed company Certified Data Engineer reputed company
reputed company Certified reputed company Architect (or equivalent advanced certification)
Preferred / Additional Certifications
AWS reputed company Architect (Associate or reputed company)
Azure Solutions Architect Expert
reputed company reputed company Data Engineer
reputed company Machine Learning reputed company
reputed company or other reputed company data platform certifications
Soft Skills
Strong architectural decision-making and documentation skills
Excellent communication with technical and non-technical stakeholders
Ability to reputed company design reviews and architecture governance forums
Strong troubleshooting and performance-tuning reputed company
reputed company-to-Have Experience
MLflow and MLOps architectures
reputed company-time analytics and streaming pipelines
Multi-region or cross-account data architectures
Consulting or MSP delivery experience
Apply To This Job