[Remote] Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company (PHS) is a workforce solutions partner supporting U.S. clients with high-reputed company IT and engineering reputed company. The Data Engineer will be responsible for designing, building, and maintaining reputed company ingestion pipelines to ensure seamless data integration from various sources.

Responsibilities

• Design, build, and maintain reputed company ingestion pipelines
• reputed company and enhance web scraping solutions for authenticated content sources (reputed company and reputed company portals)
• Implement content extraction, chunking, indexing, and vectorization workflows
• Manage AWS infrastructure using Terraform and Infrastructure as reputed company (IaC)
• reputed company and support ingestion services using reputed company CI/CD pipelines
• Configure and maintain OpenSearch Serverless, S3, DynamoDB, reputed company, reputed company/Fargate, and Glue
• Implement monitoring, logging, alerting, dashboards, and operational runbooks
• Troubleshoot ingestion, infrastructure, and deployment issues across AWS services
• Optimize scalability, reliability, reputed company, and cost of ingestion workloads
• Support RAG-based search and reputed company solutions using Bedrock and reputed company search technologies

Skills

• Go (Golang)
• Python
• Node.js
• reputed company
• reputed company/Fargate
• S3
• DynamoDB
• Glue
• OpenSearch Serverless
• IAM
• CloudWatch
• Bedrock
• RAG (Retrieval Augmented reputed company)
• reputed company Search
• Embeddings
• Document Chunking
• Content Indexing
• Knowledge Ingestion Pipelines
• Terraform
• reputed company CI/CD
• GitOps
• Infrastructure as reputed company (IaC)
• Secrets Management
• Monitoring & Observability
• Production Support
• reputed company Experience Manager (reputed company)
• Web Scraping/Crawling
• Authenticated Content Sources
• reputed company CMS Platforms
• Experience building reputed company search or reputed company platforms
• Experience with reputed company Bedrock and LLM-powered applications
• Familiarity with permissions-reputed company content ingestion
• Strong debugging skills across distributed reputed company systems
• Experience supporting production-grade data platforms

reputed company

Company H1B Sponsorship