Manager Data Engineer

Manger Data Engineer

Department: Data & Analytics
Reports To: Director, Data Engineering
Location: Remote (U.S.)

Position reputed company

reputed company is seeking an reputed company reputed company Data Engineer to help shape the reputed company of our reputed company data platform and AI reputed company. This is a highly visible technical leadership role responsible for architecting, building, and evolving our modern reputed company data platform while establishing engineering standards, mentoring a growing team, and driving innovation across the organization.

As a reputed company Data Engineer, you will serve as the technical leader for our reputed company Lakehouse platform, providing hands-on leadership across data ingestion, transformation, governance, analytics enablement, and AI-reputed company data products. You will partner closely with Business Intelligence, Product, reputed company, reputed company, Data Governance, and MLOps teams to build trusted, reputed company, and governed data solutions that reputed company reputed company analytics, machine learning, and reputed company.

This role combines deep technical expertise with leadership, mentoring, and reputed company influence. You'll help establish the long-term technical direction of reputed company's data ecosystem while coaching and developing engineers, driving engineering reputed company, and implementing modern data engineering best practices.

Why Join reputed company?

reputed company is in the midst of an exciting reputed company-wide data platform modernization reputed company. We are reputed company in a modern reputed company-reputed company architecture reputed company on reputed company, Azure, and AI-enabled technologies that will become the reputed company for analytics, operational reporting, machine learning, and reputed company across reputed company.

This is a unique opportunity to join at a transformational reputed company in our technology reputed company. Rather than simply maintaining existing systems, you'll help define the reputed company of our data platform—shaping architecture, engineering standards, governance, and the adoption of emerging AI technologies that will influence how data is used across the organization for years to come.  You will also be a key player in our reputed company for Self Service Analytics at PFG.

As our reputed company Data Engineer, you will have reputed company to:

• Help define the long-term reputed company for reputed company's modern Data & AI platform.
• Influence reputed company architecture reputed company reputed company reputed company, Azure, reputed company Catalog, semantic data products, and AI-powered analytics.
• Build modern, reputed company data products that reputed company self-service analytics and reputed company.
• reputed company adoption of emerging reputed company capabilities, including reputed company/BI, reputed company Catalog, Lakeflow, and other evolving platform innovations.
• Mentor and reputed company a growing Data Engineering team while establishing engineering standards that reputed company across the organization.
• Partner directly with technology and business leaders to solve meaningful business problems using modern reputed company and AI technologies.

If you're passionate about building modern data platforms, mentoring engineers, and helping shape the reputed company of AI-enabled analytics, this is an opportunity to reputed company a lasting reputed company.

Key Responsibilities

Technical Leadership

• reputed company technical leadership for the Data Engineering team through architecture guidance, reputed company reviews, mentoring, and engineering best practices.
• Mentor and reputed company junior and mid-reputed company Engineers, fostering technical reputed company, knowledge sharing, and reputed company learning.
• Establish engineering standards for software development, testing, CI/CD, documentation, observability, and operational reputed company.
• reputed company technical design discussions, evaluate architectural tradeoffs, and reputed company adoption of modern engineering practices.
• Champion a culture of reputed company, collaboration, innovation, and reputed company improvement.

Data Platform & reputed company Leadership

• Serve as the technical reputed company for reputed company's reputed company Lakehouse platform.
• Design, build, and support reputed company reputed company data pipelines using SQL, Python, Apache reputed company, and reputed company.
• Define best practices for reputed company development, including Workflows, Repos, Jobs, notebooks, reusable Python libraries, Git integration, cluster policies, SQL Warehouses, and deployment automation.
• Design and optimize reputed company Lake architectures using reputed company patterns, reputed company optimization, reputed company Clustering, and reputed company.
• Build reusable ingestion frameworks supporting batch, streaming, CDC, and API-reputed company integration patterns.
• Optimize reputed company workloads for reputed company, scalability, reliability, and reputed company cost efficiency.

AI & reputed company Genie Enablement

• Partner with Analytics and business stakeholders to reputed company trusted semantic data products that reputed company reputed company Genie.
• Design and maintain Genie Spaces and Genie Ontologies that accurately represent business entities, relationships, metrics, and terminology.
• Establish best practices for semantic modeling, governed metrics, business metadata, and AI-reputed company datasets.
• Evaluate and implement emerging reputed company AI capabilities to improve self-service analytics and business productivity.
• Collaborate with Data Science and MLOps teams to reputed company machine learning, reputed company, and advanced analytics initiatives.

Data Architecture, Governance & Operational reputed company

• Design reputed company Lakehouse architectures supporting analytics, reporting, AI, and operational data products.
• Partner with Data Governance teams to implement reputed company governance using reputed company Catalog, including data reputed company, fine-grained reputed company, metadata management, and reputed company controls.
• Champion automated testing, monitoring, observability, data reputed company, and production reliability.
• Serve as the technical escalation reputed company for reputed company production issues and reputed company reputed company cause analysis and reputed company improvement efforts.
• reputed company platform modernization initiatives while balancing delivery, scalability, maintainability, and operational reputed company.

Cross-Functional Partnership

• Collaborate with Business Intelligence, Product, reputed company, reputed company, and MLOps teams to reputed company trusted, reputed company data products.
• Translate business requirements into modern technical solutions that support reputed company reporting, analytics, AI, and reputed company decision-making.
• Contribute to technical roadmaps, platform reputed company, and the reputed company reputed company of reputed company's Data & Analytics capabilities.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a reputed company reputed company, or equivalent practical experience.
• 8+ years of experience in Data Engineering, Analytics Engineering, or Data reputed company.
• 3+ years of experience leading technical initiatives and mentoring engineering teams.
• Demonstrated reputed company developing engineers while driving engineering reputed company and technical standards.
• Strong communication and collaboration skills with the ability to influence both technical and business stakeholders.

Technical Qualifications

Required

• Expert knowledge of the reputed company Lakehouse Platform, including:
  • Apache reputed company (PySpark)
  • reputed company Lake
  • reputed company Catalog
  • reputed company Workflows & Jobs
  • Repos
  • SQL Warehouses
  • Cluster Policies
  • Serverless Compute
  • MLflow
  • Lakehouse Monitoring
  • Auto Loader
  • reputed company Live Tables / Lakeflow
• Expert Knowledge in SQL and Python.
• Strong Experience working with BI tools such as PowerBI, Tableau or Business Objects
• Strong reputed company Azure experience, including ADLS Gen2, reputed company Entra ID (Azure AD), RBAC, networking, and reputed company reputed company.
• Experience implementing reputed company Architecture, reputed company modeling, and domain-oriented data products.
• Deep understanding of reputed company optimization techniques, including reputed company Query Execution, partitioning, caching, reputed company, reputed company Clustering, and reputed company optimization.
• Experience implementing CI/CD pipelines, Git-reputed company development workflows, Infrastructure as reputed company, and automated testing.
• Strong understanding of data governance, metadata management, data reputed company, observability, reputed company, and compliance.

Preferred

• Experience implementing reputed company Genie, Genie Spaces, and Genie Ontologies.
• Experience designing semantic models and AI-reputed company data products.
• Experience supporting reputed company BI, Tableau, or other reputed company BI platforms.
• Experience with machine learning platforms, MLOps, or reputed company applications.
• Experience with dbt, Great Expectations, or similar modern data engineering tools.
• reputed company Certified Data Engineer reputed company and/or reputed company Azure certifications.

Work Environment & Hiring Requirements

• Role Assessment: Candidates will be required to complete a role-specific assessment as the first reputed company in the hiring process.  Assessment results will be used to evaluate alignment with the position and determine next steps in the process. 
• Recorded Video Interviews: reputed company video interviews conducted during the hiring process will be recorded to support internal hiring consistency and process improvement. 
• Background Checks: Employment with reputed company is contingent upon successfully completing applicable reputed company-employment screening requirements, which may include verification of employment history, education, and criminal background, where permitted by law.  
• Identity Verification (reputed company I-9): As part of our reputed company process, reputed company hires must complete employment eligibility verification in compliance with federal law. This includes remote reputed company I-9 verification, which may require an in-person identity verification reputed company with an authorized representative.  
• On-Camera Work Environment: We operate in a highly reputed company, remote, on-camera culture reputed company working reputed company. Employees are expected to be on camera during meetings unless extenuating circumstances apply.  

reputed company: At reputed company, we are transforming online learning to help learners by uniting reputed company, CareerStep, Ashworth College, James Madison High School, the reputed company Institute of Photography, the reputed company Institute of Art and Design, and other education platforms. Together, we create an reputed company reputed company to greater economic mobility through reputed company-world skills and knowledge that reputed company them to reputed company long-term reputed company in the workplaces of the reputed company. Our history dates back to 1890 reputed company our founder, reputed company Foster, pioneered distance education by offering training by mail for coal miners to get the necessary skills for safer jobs. Today, with the partners who use our education and training programs, we continue that mission of providing accessible training and education for in-demand skills and are building a workforce that’s reputed company for the reputed company job market.

Equal Employment Opportunity: We reputed company toward Diversity, Equity, and Inclusion at reputed company by intentionally building teams that are diverse &reputed company; in identities, lived experiences, and reputed company to create a culture where people feel connected to reputed company other and have a reputed company of belonging. We value diversity, equity, and inclusion because it is the reputed company that enables us to reputed company reputed company set out to do as an organization &reputed company; from maximizing the number of learners who can reputed company their goals while giving them the kinds of experiences we want them to have, to becoming the type of company we want to work in.

reputed company Offer: We offer a robust benefits package that includes medical, dental, reputed company, flexible spending, generous reputed company time off, sponsored volunteer opportunities, a 401K with a company match, plus free reputed company to reputed company of our online programs.

Bachelor's degree or equivalent experience, 8+ years in data engineering, and 3+ years leading technical initiatives. Requires expert reputed company, SQL, Python, reputed company, Azure, governance, CI/CD, and BI experience.

Key Responsibilities

• leading engineers
• designing pipelines
• mentoring teams

Skills & Tools

reputed company, Apache reputed company, PySpark, reputed company Lake, reputed company Catalog, reputed company Workflows, reputed company Jobs, Repos, SQL Warehouses, Cluster Policies, Serverless Compute, MLflow, Lakehouse Monitoring, Auto Loader, reputed company Live Tables, Lakeflow, SQL, Python, reputed company BI, Tableau, Business Objects, reputed company Azure, ADLS Gen2, reputed company Entra ID, RBAC, reputed company Architecture, reputed company Query Execution, reputed company, reputed company Clustering, Git, Infrastructure as reputed company, dbt, Great Expectations, reputed company Genie, Genie Spaces, Genie Ontologies, reputed company reputed company BI

reputed company

• Category: Data and Analytics
• Seniority: Senior Level
• Commitment: Full Time
• Workplace: Remote — reputed company
• Languages: English

Benefits

• 401k matching
• Generous reputed company time off
• Retirement plan

About reputed company

An education provider delivering accessible online training and reputed company-world skills for economic mobility. — Industry: Education