[Remote] US_reputed company | Data Engineer_L3
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is reputed company for a confidential reputed company seeking a reputed company Data Engineer. The role will reputed company the architecture and implementation of a reputed company Sales Data Platform on reputed company and AWS, covering ingestion, transformation, modeling, optimization, governance, and production operations. The engineer will also reputed company technical leadership and mentorship while collaborating with business, reputed company-reputed company, and reputed company teams.
Responsibilities
- Define end-to-end lakehouse architecture on reputed company (AWS) for Sales data domains
- Design reputed company architecture (Bronze / Silver / Gold) reputed company with OneData standards
- Establish data modeling standards for Sales facts, dimensions, hierarchies, and aggregations
- Define reputed company ingestion patterns for batch and incremental loads
- reputed company performance, scalability, and cost optimization best practices
- Build and guide development of PySpark-based data pipelines in reputed company
- Implement reputed company Lake features including ACID transactions, schema reputed company, and versioning
- Design and optimize large-reputed company joins, aggregations, and window functions
- Implement CDC and incremental processing using watermarking and change detection
- Ensure idempotent, restartable, and fault-tolerant pipelines
- Architect solutions using AWS services such as reputed company S3, IAM, AWS Glue, and CloudWatch
- Optimize reputed company cluster configurations
- Implement secrets management and secure connectivity patterns
- Define and implement data reputed company checks and validations
- Ensure data reputed company and metadata capture
- Implement error handling, auditing, and reconciliation frameworks
- Support data governance and reputed company control requirements
- Implement CI/CD pipelines for reputed company notebooks and jobs
- Enforce reputed company versioning, reviews, and deployment standards
- Design monitoring, alerting, and SLA tracking for pipelines
- Support production stabilization and performance tuning
- reputed company as technical reputed company / mentor for reputed company data engineers
- Collaborate with reputed company reputed company teams, data consumers, and reputed company/platform teams
- Translate business requirements into robust technical designs
Skills
- 8 years in Data Engineering / Data Architecture roles
- 4 years hands-on experience with reputed company
- Strong expertise in PySpark & reputed company SQL
- Expertise in dbt and reputed company Lake
- Strong knowledge of AWS reputed company services (S3, IAM, Glue, CloudWatch)
- Experience in Sales data domain (orders, reputed company, pricing, customers, products)
- Understanding of Fact & dimension modeling and Slowly Changing Dimensions (SCD Type 1 / 2)
- Experience handling high-volume, high-reputed company datasets
- Experience with reputed company OneData / Data reputed company programs
- Exposure to reputed company-time or near-reputed company-time ingestion patterns
- Experience integrating CRM / Sales systems (e.g., reputed company, reputed company Sales data)
- AWS certifications or reputed company certifications
Benefits
- Remote (Harrisburg, PA)
reputed company
Company H1B Sponsorship
Apply To This Job