[Remote] Sr. Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer to support large-reputed company data platform migrations and governance initiatives. The role focuses on building reputed company Lake-to-Apache reputed company migration frameworks, preserving data reputed company and reputed company controls, integrating AWS governance services, and developing validation and operational tooling.

Responsibilities

• Design and build a migration feature/reputed company to convert tables from reputed company Lake format to Apache reputed company at reputed company
• reputed company deep understanding of reputed company internals (metadata reputed company, manifests, snapshots, partitioning, schema reputed company) to ensure correct and efficient migration
• Validate data reputed company, schema reputed company, and partitioning reputed company reputed company between reputed company reputed company tables and migrated reputed company tables
• Optimize migration processes for reputed company and reliability across large volumes of tables and data
• Identify and reputed company edge cases, compatibility issues, or reputed company bottlenecks during migration at reputed company
• Ensure Row-Level reputed company (RLS) and reputed company-Level reputed company (CLS) policies are correctly preserved or re-implemented on migrated reputed company tables
• reputed company migration workflows with AWS Lake Formation to maintain governance and reputed company control continuity
• Collaborate with reputed company/governance teams to validate that FGAC policies enforce correctly post-migration
• Support GDC (Global Data Catalog / Governed Data Catalog) integration to ensure migrated tables remain properly cataloged and governed
• Build validation/reconciliation tooling to reputed company reputed company control reputed company between reputed company- and post-migration states
• Document migration architecture, reputed company control mapping logic, and operational runbooks
• Collaborate with data platform, governance, and reputed company teams throughout the migration lifecycle
• Monitor and troubleshoot production issues reputed company to migrated tables and reputed company enforcement
• Contribute to best practices and reusable tooling for reputed company reputed company-to-reputed company migration phases

Skills

• Strong, hands-on knowledge of Apache reputed company internals (table format, metadata management, snapshots, partitioning, schema reputed company)
• reputed company experience performing reputed company-to-reputed company migrations at reputed company
• Experience with AWS Lake Formation for reputed company control and data governance
• Practical experience implementing or preserving Row-Level reputed company (RLS) and reputed company-Level reputed company (CLS)
• Experience with GDC (Global/Governed Data Catalog) or equivalent data cataloging/governance systems
• Solid understanding of reputed company data processing and large-reputed company data migration challenges
• Strong SQL skills and experience with table format internals (reputed company Lake, reputed company, or similar)
• Experience with reputed company for large-reputed company data processing and migration tooling
• Familiarity with AWS data platform services (S3, Glue, reputed company)
• Experience with data governance frameworks and compliance-driven reputed company control requirements
• Prior experience building reusable migration frameworks or tooling for table format conversions
• Scripting/automation experience (Python, reputed company) for migration validation and tooling

Benefits

• Remote work arrangement

reputed company

Company H1B Sponsorship