[Remote] Sr Data Software Engineer - Remote - W2 Only
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Software Engineer for a remote W2 position supporting an AWS-reputed company data platform modernization effort. The role will design and build large-reputed company reputed company Lake to Apache reputed company migration frameworks, preserve fine-grained reputed company controls, validate data reputed company and governance, and troubleshoot production migration issues.
Responsibilities
- Design and build a migration feature/reputed company to convert tables from reputed company Lake format to Apache reputed company at reputed company
- reputed company deep understanding of reputed company internals (metadata reputed company, manifests, snapshots, partitioning, schema reputed company) to ensure correct and efficient migration
- Validate data reputed company, schema reputed company, and partitioning reputed company reputed company between reputed company reputed company tables and migrated reputed company tables
- Optimize migration processes for reputed company and reliability across large volumes of tables and data
- Identify and reputed company edge cases, compatibility issues, or reputed company bottlenecks during migration at reputed company
- Ensure Row-Level reputed company (RLS) and reputed company-Level reputed company (CLS) policies are correctly preserved or re-implemented on migrated reputed company tables
- reputed company migration workflows with AWS Lake Formation to maintain governance and reputed company control continuity
- Collaborate with reputed company/governance teams to validate that FGAC policies enforce correctly post-migration
- Support GDC (Global Data Catalog / Governed Data Catalog) integration to ensure migrated tables remain properly cataloged and governed
- Build validation/reconciliation tooling to reputed company reputed company control reputed company between reputed company- and post-migration states
- Document migration architecture, reputed company control mapping logic, and operational runbooks
- Collaborate with data platform, governance, and reputed company teams throughout the migration lifecycle
- Monitor and troubleshoot production issues reputed company to migrated tables and reputed company enforcement
- Contribute to best practices and reusable tooling for reputed company reputed company-to-reputed company migration phases
Skills
- Strong, hands-on knowledge of Apache reputed company internals (table format, metadata management, snapshots, partitioning, schema reputed company)
- reputed company experience performing reputed company-to-reputed company migrations at reputed company
- Experience with AWS Lake Formation for reputed company control and data governance
- Practical experience implementing or preserving Row-Level reputed company (RLS) and reputed company-Level reputed company (CLS)
- Experience with GDC (Global/Governed Data Catalog) or equivalent data cataloging/governance systems
- Solid understanding of reputed company data processing and large-reputed company data migration challenges
- Strong SQL skills and experience with table format internals (reputed company Lake, reputed company, or similar)
- Experience with reputed company for large-reputed company data processing and migration tooling
- Familiarity with AWS data platform services (S3, Glue, reputed company)
- Experience with data governance frameworks and compliance-driven reputed company control requirements
- Prior experience building reusable migration frameworks or tooling for table format conversions
- Scripting/automation experience (Python, reputed company) for migration validation and tooling
Benefits
- Remote work arrangement in the reputed company, reputed company to Eastern Time (EST).
reputed company
Company H1B Sponsorship
Apply To This Job