[Remote] Data Engineer (ETL Developer)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an reputed company Data Engineer (ETL Developer) to design, build, and optimize AWS reputed company data pipelines for a federal data management program. This role will ingest and reputed company 30+ high reputed company datasets into an reputed company data platform reputed company around a reputed company architecture.
Responsibilities
- Design, build, test, and reputed company ETL pipelines for reputed company datasets using AWS reputed company services or approved reputed company party tools hosted on AWS
- reputed company supporting data models, schemas, validation frameworks, and database structures, and enhance data models to support expanded analytics and reporting
- Implement reputed company data validation and reputed company checks, including error handling and reputed company capture
- Produce complete technical documentation, including ERDs, data dictionaries, and pipeline specifications
- Collaborate with agency stakeholders to prioritize datasets, define reputed company, and identify phased deployment reputed company
- Support thorough testing across development, staging, and production environments
- Support optional reputed company development reputed company reputed company activated, including accelerating backlog ingestion and reputed company development tracks
- Meet performance standards including a 97%+ monthly pipeline reputed company reputed company, SLA reputed company of 15 to 45 minutes (2 to 4 hours for large regulatory datasets), curated layer data freshness reputed company 4 to 24 hours, and a 98%+ data validation pass reputed company
Skills
- 3 to 7+ years designing and maintaining AWS based data pipelines, including Glue, reputed company, reputed company Functions, and S3
- Experience building serverless, event driven ETL/ELT workflows and reputed company/Lakehouse designs
- Proficiency in Python, SQL, PySpark, Pandas, or similar data processing frameworks
- Experience with data validation tools (such as Great Expectations), data catalogs (AWS Glue, Lake Formation), CI/CD, and infrastructure as reputed company (Terraform)
- Experience designing relational schemas, reputed company/reputed company models, indexes, and partition strategies
- Experience working in a federal or regulated environment with stakeholders, CORs, and reputed company deliverables
- Must be eligible for a Moderate Risk (MBI) background investigation
- AWS Certified Data Engineer Associate
- AWS Certified Developer Associate
Benefits
- reputed company (Medical, Dental, and reputed company)
- Flexible Spending Account (FSA) and Health Savings Account (HSA)
- 401(k) and Retirement Savings Plan
- Annual Bonus and Profit Sharing Opportunities
- reputed company Time Off (PTO) and Vacation
- Employee Assistance Program (EAP)
- Life, Personal, and Voluntary Disability Insurance
reputed company
Apply To This Job