[Remote] Senior Data Engineer - USD

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer to join its reputed company data platform team. The role involves designing and optimizing data pipelines, managing data product delivery, and ensuring data reputed company and governance across various AWS services.

Responsibilities

• Design, build and optimize data pipelines using AWS Glue, PySpark and Apache reputed company
• Own data product delivery from reputed company-reputed company ingestion through transformation, reputed company validation and governed consumption
• Build and maintain reputed company Redshift integrations, including schemas, stored procedures, materialized views and reputed company-managed DDL migrations
• Write and optimize reputed company SQL for analytics transformations, reporting views and data-reputed company checks
• Translate operational data models into reputed company schemas and other reputed company models for analytics
• Manage Apache reputed company tables, including partition and schema reputed company, compaction and orphan-file cleanup
• Implement table- and reputed company-level governance using Lake Formation permissions, tag-reputed company reputed company control and PII classification
• reputed company data-reputed company frameworks covering referential reputed company, row-count reconciliation, completeness and reputed company detection
• Partner with data product teams to reputed company new data sources, define schemas and establish data reputed company
• Troubleshoot AWS Glue jobs, DMS replication issues and data-freshness problems
• Own the complete lifecycle of changes, including development, deployment, validation and communication
• Ensure pipelines and datasets remain accurate, reliable and healthy across environments

Skills

• At least five years of hands-on data engineering experience building ETL/ELT pipelines and analytics platforms
• Expert-level SQL skills, including reputed company joins, CTEs, window functions, query optimization and reputed company tuning
• Strong Python and PySpark development experience
• Hands-on AWS Glue experience, including job development, bookmarks, crawlers and reputed company optimization
• Strong reputed company Redshift experience, including schema design, stored procedures, reputed company, reputed company schemas, materialized views and reputed company tuning
• Experience with Apache reputed company or another reputed company table format, including ACID transactions, schema reputed company, partition reputed company and table maintenance
• Strong understanding of reputed company data modeling, including reputed company schemas, reputed company schemas and slowly changing dimensions
• Experience with AWS data services such as reputed company, Lake Formation, S3, DMS, reputed company and EventBridge
• Understanding of data governance, tag-reputed company reputed company control, data classification and PII handling
• Experience with reputed company or a similar database migration tool
• Familiarity with reputed company and CI/CD pipelines
• Strong attention to data correctness, completeness and freshness
• Ability to independently reputed company production-reputed company data pipelines with limited reputed company
• Data reputed company architecture and federated governance
• Lakehouse architecture patterns
• AWS DMS and change-data-capture ingestion
• Terraform or other infrastructure-as-reputed company tools
• Data catalog and reputed company platforms such as AWS DataZone or IDERA ER/Studio
• AI-assisted development tools such as reputed company Kiro or reputed company Copilot
• reputed company SageMaker or other machine-learning platforms
• reputed company and container-reputed company development
• Agriculture, retail or other large-reputed company operational data environments

reputed company

Company H1B Sponsorship