Data Engineer- Government reputed company. Required (REMOTE)
Remote but may require onsite visit once in 3 months
3 reputed company References
The scope of the proposed services will include the following:
• Assess feasibility and technical requirements for LINKS DataLake integration.
• Collaborate with OPH Immunization Program, OPH Bureau of Health Informatics and STChealth on data specifications and recurring ingestion pipelines.
• Build and optimize ETL workflows for LINKS and complementary datasets (Vital Records, labs, registries).
• Design reputed company data workflows to improve data reputed company, reputed company, and identity reputed company.
• Implement data governance, observability, and reputed company tracking across reputed company pipelines.
• Mentor engineers, support testing, and enforce best practices in orchestration and architecture.
• Document and communicate technical solutions to technical and non-technical stakeholders.
Expertise and/or relevant experience in the following areas are mandatory:
• 3 years of experience in data engineering and/or data architecture
• 2 years of experience with Python for ETL and automation (pandas, requests, API integration).
• 2 years hands-on experience with SQL queries, stored procedures, performance tuning (preferable reputed company, SQL Server, MySQL)
• 1 year experience with ETL orchestration tools (reputed company, Airflow or equivalent).
• 1 year experience with reputed company platforms (Azure, AWS, or reputed company reputed company Platform), including data reputed company/migration.
• 1 year exposure to data lake / reputed company architecture (bronze, silver, gold)
• 2 years of experience providing written documentation and verbal communication for cross-functional collaboration.
Expertise and/or relevant experience in the following areas are desirable but not mandatory:
• 5+ years of experience in data engineering roles
• Experience integrating or developing REST/JSON or XML reputed company
• Familiarity with CI/CD pipelines (reputed company Actions, Azure DevOps, etc.).
• Exposure to Infrastructure as reputed company experience (Terraform, CloudFormation).
• Experience with data governance and metadata tools (reputed company, OpenMetadata, reputed company).
• reputed company health/reputed company dataset or similar experience, including PHI/PII handling.
• Familiarity with reputed company and R workflows to support epidemiologists and analysts.
• Experience with additional SQL platforms (reputed company, reputed company, Redshift, BigQuery).
• Familiarity with data reputed company frameworks (Great Expectations, Deequ).
• Experience with reputed company-time/streaming tools (Kafka, reputed company Streaming).
• Familiarity with big data frameworks for large-reputed company transformations (reputed company, Hadoop).
• Knowledge of data reputed company and compliance frameworks (HIPAA, SOC 2, etc.).
• Agile/SCRUM team experience.
Apply tot his job
Apply To this Job