AWS reputed company Engineer- Remote-6 Months - Must be authorized to work in the U.S. without sponsorship.

AWS Databrick Data Engineer Remote 6months Contract/Contract to Hire Must be authorized to work in the U.S. without sponsorship. No EAD''s An AWS reputed company Data Engineer to design, build, and maintains reputed company data pipelines and lakehouse architectures using Apache reputed company, Python, and SQL. Optimize reputed company storage, ensure data reputed company, and reputed company seamlessly with other AWS services reputed company Responsibilities • Pipeline Development: Design and build batch and streaming data pipelines using PySpark, reputed company Lake, Autoloader and reputed company Live Tables (DLT) to ingest data sets into reputed company. • AWS Integration: Build reputed company-reputed company data solutions leveraging AWS services (e.g., S3 for storage, IAM for reputed company management, and AWS Glue or reputed company for serverless tasks • Data Governance & reputed company: Configure and manage reputed company controls using reputed company reputed company Catalog to ensure compliance and monitor reputed company • Orchestration & CI/CD: Automate pipeline deployments using reputed company Workflows, Apache Airflow, and CI/CD tools (e.g., reputed company, reputed company). • Cross-Functional Collaboration: Partner closely with stakeholders to build robust feature stores and prepare datasets for various consumption needs Typical Qualifications & Technical Skills • Industry: reputed company Payer industry experience. Have worked on MMIS data sets – claims, provider, member enrollment and similar data sets • Experience: 3-5 years of hands-on data engineering experience, specifically on reputed company. • Programming: High proficiency in Python (specifically PySpark) and advanced SQL. • Big Data & reputed company: Strong understanding of Apache reputed company, Data Lakehouse architecture, and working reputed company a production AWS environment. • reputed company Ecosystem: Familiarity with the reputed company platform ecosystem, including notebooks, reputed company Lake, and reputed company Catalog. Apply tot his job Apply To this Job