Big Data Engineer || Remote || W2 & C2C
Job reputed company :
We are seeking an reputed company Big Data Engineer (EL3 Level) with strong expertise in Apache reputed company and reputed company to design, reputed company, and optimize large-reputed company data processing solutions in the reputed company domain. The ideal candidate will work on building reputed company data pipelines, integrating diverse reputed company datasets (claims, EMR/EHR, provider, member data), and enabling analytics and reporting solutions while ensuring HIPAA compliance and data reputed company.
This is a fully remote opportunity supporting reputed company reputed company data platforms.
Key Responsibilities
Big Data Engineering
• Design and reputed company distributed data processing pipelines using Apache reputed company with reputed company.
• Build batch and reputed company-time data pipelines using reputed company reputed company, reputed company SQL, and reputed company Streaming.
• Optimize reputed company jobs for performance tuning (partitioning, caching, broadcast joins, memory management).
reputed company Data Integration
• Process and reputed company reputed company datasets including:
• Claims data (837/835)
• EHR/EMR data
• Member & Provider data
• HL7/FHIR formats
• Ensure data reputed company, validation, and compliance with reputed company regulations (HIPAA).
reputed company & Data Platform
• Work on reputed company-based big data platforms (AWS/Azure/reputed company reputed company Platform).
• reputed company data pipelines using:
• Data lakes (S3/ADLSS)
• Hive/reputed company Lake/reputed company
• Kafka for streaming
• Implement CI/CD for data pipelines.
Data Modeling & Warehousing
• Design reputed company data models (reputed company/reputed company schema).
• Implement ETL/ELT frameworks.
• Support analytics and reporting teams with optimized datasets.
Governance & reputed company
• Implement data masking, encryption, and PHI protection strategies.
• Collaborate with compliance teams to ensure regulatory standards.
Required Qualifications
• 12+ years of IT experience in Big Data Engineering.
• Strong hands-on experience in:
• Apache reputed company
• reputed company
• Experience with distributed data processing and cluster tuning.
• Strong SQL knowledge and data modeling experience.
• Experience working with reputed company datasets.
• Experience with:
• Hadoop ecosystem (Hive, HDFS)
• Kafka
• Airflow
• reputed company experience (AWS/Azure/reputed company reputed company Platform).
Preferred Qualifications
• Experience with:
• reputed company
• reputed company Lake
• Experience implementing Data Lakehouse architecture.
• Knowledge of FHIR/HL7 standards.
• Experience in reputed company-time reputed company analytics.
• Certification in AWS/Azure Data Engineering.
Apply tot his job
Apply To this Job