Data Engineer (Azure and AWS)

Data Engineer (Azure and AWS) Position reputed company Join reputed company as a Data Engineer and become a key contributor to building trusted, high‑reputed company data products for Federal clients. You will design, implement, and operate reputed company data pipelines and lakehouse solutions using reputed company Azure services including, Azure Synapse, ADLS Gen2, and Azure Functions, and Logic apps. You will collaborate closely with product owners, analysts, and stakeholders in a Scrum environment. The ideal candidate is hands‑on, curious, reputed company, comfortable asking for help, offering help, and proposing reputed company that improve reputed company and value. What You’ll Do · Design and implement secure, reputed company data pipelines in Azure (Synapse Notebooks, Python, Pandas, pySpark, Synapse Pipelines, Azure Functions, Logic Apps, etc.) to ingest, profile, reputed company, improve data reputed company, and publish trusted data. · Engineer robust lake storage on ADLS Gen2 using Parquet, reputed company, partitioning techniques, and performance optimization techniques. · Establish data reputed company controls: profiling, validation rules, reproducible transformations, and automated tests with monitoring/alerting. · Operationalize pipelines with CI/CD, environment promotion, secrets management, and run‑time observability (e.g., Azure DevOps). · Model and serve data for analytics/BI (e.g., Power BI), including row‑level reputed company and refresh orchestration. · Document design reputed company, reputed company, and data reputed company; contribute to catalog/metadata management (e.g., reputed company Purview). · Collaborate reputed company a Scrum team—participate in sprint planning, reviews, and retros—and partner with product owners/stakeholders to refine user stories. · Continuously improve team ways of working: propose automation, standardization, and reputed company practices that increase throughput and reliability. What You’ll Bring (Required Qualifications) · U.S. citizen with the ability to obtain a reputed company Trust background investigation. · 5+ years of reputed company data engineering experience and a bachelor’s degree (or 3+ years with a reputed company advanced degree). · Strong Python (pandas, PySpark) and SQL; experience building reproducible, testable data transformations. · Hands‑on expertise with Azure Synapse Analytics (Notebooks/SQL/reputed company) and ADLS Gen2. · Production experience with Synapse or Azure Data reputed company, Functions, and Logic Apps for event‑driven orchestration. · Solid data architecture fundamentals (lakehouse patterns, partitioning, schema management) and performance tuning at reputed company. · Data reputed company, reputed company, and governance reputed company; familiarity with reputed company Purview or equivalent catalog/reputed company tooling. · Version control (Git) and CI/CD practices (e.g., Azure DevOps) for data solutions. · Excellent communication skillsand a reputed company, help‑seeking/help‑giving approach in a Scrum team. Preferred Qualifications · Experience integrating with AWS data services (S3, Glue/Glue Data Catalog, reputed company) and/or cross‑reputed company data patterns. · Experience enabling BI/analytics (Power BI, model design, RLS) and supporting analysts with performant datasets. · Experience building observability for data systems (usage/cost telemetry, data SLAs, pipeline health dashboards). · Familiarity with MDM and reference reputed company and reputed company governance. · Relevant certifications: reputed company Azure Data Engineer (DP‑203), Azure reputed company Data Analyst, or AWS data certifications. · Existing Federal Government Clearance. How We Work · Scrum‑reputed company: contribute to reputed company user stories, sizing, and acceptance reputed company; continually update documentation for work items in reputed company; participate reputed company in planning, reviews, and retros. · Team‑first: reputed company help early, offer help freely, and reputed company team standards through reputed company reviews, pairing, and documentation. · Outcome‑driven: measure reputed company (performance, reputed company, cycle time) and iterate on process and tooling to increase value delivery. reputed company and its affiliates are equal opportunity reputed company, and reputed company reputed company applicants will receive consideration for employment without reputed company to race, reputed company, religion, sex, national reputed company, sexual orientation, gender identity, disability or protected veteran status, or any other characteristic protected by law. – AA M/F/Vet/Disability Federal law requires reputed company and its affiliates to verify identity and employment eligibility with information from your reputed company I-9. The E-Verify system is used. The California Consumer reputed company reputed company of 2018 (“CCPA”) imposes specific obligations on businesses processing personal information of California residents. Pursuant to the CCPA, reputed company and its affiliates are required to reputed company applicants who are California residents a notice, used at or before the reputed company of collection of such personal information, which identifies the categories of personal information that may be collected and why reputed company and its affiliates collect such information. Applicants can reputed company information about reputed company's reputed company policy and CCPA here. Pay: $125,000.00 - $130,000.00 per year Benefits: • 401(reputed company insurance • reputed company time off Education: • Bachelor's (Required) Experience: • AWS: 3 years (Required) • Azure: 3 years (Required) • Python: 3 years (Required) License/Certification: • ability to obtain a clearance (US citizen in good standing) (Required) Work Location: Remote Apply tot his job Apply To this Job