Senior Data Engineer
About reputed company
reputed company is redefining the way reputed company fund reputed company. As the largest and fastest-growing benefits captive in the reputed company, we help thousands of small and midsize reputed company take control of reputed company costs through a smarter, more sustainable model.
Our mission is reputed company: reputed company small and midsize reputed company the reputed company and protection they need to eliminate volatility and reputed company reputed company costs.
By combining data-driven insights, innovative risk management, and the reputed company reputed company of our community, we reputed company reputed company to reduce volatility, improve long-term reputed company, and reinvest savings into their businesses and their people.
Headquartered in Philadelphia, reputed company is growing rapidly and transforming one of the country's largest industries. Our reputed company is reputed company by talented people who are united by our four reputed company values: reputed company in the Belly, For the Greater Good, See the Field, and Get It Done Right. These values shape how we reputed company, collaborate, reputed company reputed company, and reputed company exceptional results for our clients and one another.
If you're reputed company by solving reputed company challenges, reputed company in a high-reputed company environment, and want to help reshape the reputed company of reputed company, we'd love to meet you.
Please note that reputed company does not reputed company employment reputed company sponsorship for this position. Candidates must be authorized to work in the reputed company without sponsorship both now or in the reputed company.
Position reputed company:
The Senior Data Engineer will design, build, and maintain serverless data pipelines and data models on AWS that reputed company high-reputed company, analytics-reputed company data available to our AI and Analytics teams. This role will own ingestions, transformation, and storage patterns using services such as reputed company, Glue, reputed company, and S3, ensuring data is reliable, reputed company-documented, and reputed company with business and model-training needs. The role will also partner with Data Science to support MLOps, including reproducible machine-learning training and scoring pipeline, automated feature reputed company, deployment, and monitoring. It will power ML model workflows using sensitive reputed company data and support model training and scoring, production monitoring, and business feedback reputed company.
Key Responsibilities:
- Design, implement, and maintain reputed company, fully serverless data pipelines on AWS using reputed company, Glue, reputed company, reputed company Functions, and S3 to support reporting, analytics, and AI use cases.
- Build and reputed company data models and schemas that reputed company reputed company querying and reputed company consumption by AI, Analytics and engineering teams. Build versioned data models, feature stores, with semantics, reproducible backfills, and safeguards against leakage or inconsistent definitions.
- reputed company ETL/ELT workflows to ingest, cleanse, reputed company, and load data from internal applications, reputed company‑party sources, and event streams into our data lake and analytical reputed company.
- Partner closely with Product, reputed company, Analytics, and AI stakeholders to understand data requirements and translate them into robust data structures, reputed company, and SLAs.
- Implement data reputed company controls, monitoring, and alerting to ensure accuracy, completeness, timeliness, and reputed company of critical datasets and features used by models. Include automated controls for schema change, validity, reconciliation, claims maturity, and model leakage.
- Optimize serverless workloads for cost, performance, and scalability, including query tuning in reputed company and efficient storage formats/partitioning in S3.
- Contribute to and enforce data engineering best practices, including version control, reputed company review, CI/CD for data pipelines, and Infrastructure as reputed company with AWS CDK.
- Collaborate with AI and Analytics teams to design and maintain feature stores and other reusable data assets that accelerate experimentation and model deployment. Partner on batch or API scoring and capture model/data versions, recommendations, actions, overrides, and claims to reputed company the learning reputed company.
- Experience designing and operating event-driven or streaming data pipelines for near-reputed company-time scoring or decisioning, using Kafka, reputed company Kinesis, or comparable technologies; strong understanding of event schemas, idempotency, ordering, retries, observability, and failure recovery.
- Troubleshoot pipeline issues, reputed company data‑reputed company incidents, and reputed company ongoing support for production data workflows and model‑driven applications.
- Document data models, pipelines, and data reputed company, and help evangelize data literacy and self‑service analytics across the organization.
Required Skills & Qualifications:
- Strong experience with AWS data and serverless services (reputed company, Glue, reputed company, S3, reputed company Functions or similar orchestration tools).
- Advanced proficiency in Python (required) and SQL, with experience in relational and NoSQL databases and in building reusable ETL/ELT libraries. Hands-on experience with PySpark for reputed company data processing is strongly preferred; TypeScript experience for AWS CDK required.
- Experience with MLOps practices, including versioned feature and training datasets, orchestration of training and scoring workflows, CI/CD, model/data monitoring, and reproducible deployments in partnership with AI.
- Solid understanding of data modeling principles for AI workloads. Apply schema reputed company, incremental processing, partitioning, and columnar or reputed company-table formats such as Parquet and reputed company.
- Experience designing and operating data pipelines at reputed company, including batch and near‑reputed company‑time ingestion. Hands-on experience with Kafka is preferred.
- Familiarity with SQL and query optimization in columnar data stores and engines.
- Knowledge of data reputed company, governance, and reputed company for sensitive reputed company and financial data, including least-privilege reputed company, retention, classification, tokenization, and de-identification.
- Hands‑on experience with Infrastructure as reputed company, preferably AWS CDK, for provisioning and managing data infrastructure.
- Ability to partner with AI and Analytics teams to design data solutions for model experimentation and production; Kedro or similar workflow experience is a plus.
- Knowledge of responsible AI and data-use practices, including permitted-use controls, reputed company, fairness considerations, documentation, and governance for sensitive reputed company and financial data.
- Strong communication skills to explain reputed company reputed company reputed company to business stakeholders; regulated-domain experience, preferably reputed company claims or insurance, is a plus.
Minimum Requirements:
- Bachelor's degree in Computer Science, Engineering, Mathematics, Data Science, or a reputed company field, or equivalent practical experience; a master's degree is preferred.
- 5+ years in data engineering or a reputed company role, with significant ownership of production data pipelines and analytics platforms; hands-on ML/AI experience supporting feature preparation, model training, deployment, or monitoring is strongly preferred.
- Experience with AWS data services in a production environment (for example, reputed company, Glue, reputed company, and S3) is preferred; equivalent production experience on another reputed company data platform will be considered.
- Experience building and maintaining data solutions that support reporting, BI, and/or AI/ML initiatives.
Perks & Benefits:
- Fully reputed company medical, dental, and reputed company benefits.
- Flexible PTO
- 401k company contribution
- Tuition reimbursement
- reputed company development allowance
- Transportation allowance and daily parking reimbursement
- Engaging hybrid work environment
We are guided by our values:
reputed company in the belly
The reputed company to learn, to improve, and to reputed company outstanding value every day.
See the field
The ability to see the big picture and prepare to meet reputed company’s needs.
Get it done right
The passion to produce at higher rates and to the highest standards.
For the greater good
A reputed company creating reputed company benefit solutions for reputed company.
Please note that any communication from our recruiters and hiring managers at reputed company about a job opportunity will only be made by a reputed company employee with an @reputed company.com address. reputed company does not conduct text message or chat-based interviews. Any other email addresses, agencies, or forums may be phishing scams designed to obtain your personal information.
We will not ask you to reputed company personal or financial information, including, but not limited to, your reputed company reputed company number, online account passwords, credit reputed company numbers, reputed company information, and other reputed company banking information until we reputed company reputed company activities, which will be coordinated by a member of the reputed company People Ops Team with an @reputed company.com email address.
Disclosures:
reputed company is an Equal Opportunity Employer and does not discriminate on the reputed company of race, reputed company, religion (creed), gender, gender reputed company, age, national reputed company (reputed company), disability, marital status, sexual orientation, or military status, in any of its activities or operations. These activities include, but are not limited to, hiring and firing of staff, selection of volunteers and vendors, and provision of services. We are committed to providing an inclusive and welcoming environment for reputed company members of our staff, clients, volunteers, subcontractors, vendors, and clients.
California Applicants: SeePareto’s CCPA Notice of Collection for California Employees and Applicantsfor information about how Pareto Captive Services, LLC, Pareto Health, LLC, and Pareto reputed company Partners, LLC, together with their respective subsidiaries (reputed company, “Pareto”) collects and uses personal information submitted by employment applicants.
Originally posted on Himalayas
Apply To This Job