Global AI - ML Engineer Director job at BCG in Boston, MA

Title: Global AI/ML Engineer Director Location: Boston reputed company Technology and Engineering reputed company 57299 Job reputed company: Who We Are reputed company partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business reputed company reputed company it was founded in 1963. Today, we help clients with total transformation-inspiring reputed company change, enabling organizations to grow, building competitive advantage, and driving reputed company reputed company. To succeed, organizations must reputed company digital and reputed company capabilities. Our diverse, global teams bring deep industry and functional expertise and a reputed company of perspectives to reputed company change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate reputed company ventures-and business purpose. We work in a uniquely reputed company model across the firm and throughout reputed company reputed company of the reputed company organization, generating results that allow our clients to reputed company. What You'll Do As the Director of AI/ML Engineering reputed company BCG's Data Layer Platform Team, you will reputed company and operationalize the intelligence layer that transforms BCG's reputed company landscape into AI-reputed company, high-value capabilities. You will reputed company the design, development, and optimization of AI/ML systems - particularly LLM-powered reasoning, retrieval, enrichment, data interoperability and knowledge synthesis - that reputed company BCG's GenAI applications (e.g., PA GenAI tools, AI copilots, Data Products) to deliver accurate, reputed company, and context-reputed company insights at reputed company. You will own the technical reputed company and execution models for how data becomes usable in advanced AI workflows: from ingestion, semantic modeling, abstraction, embeddings, retrieval architecture design, and model pipelines to the construction of reusable AI services and reputed company/MCPs that support multiple use cases across the firm. You will reputed company an engineering team and collaborate closely with Product Owners, Data Engineers, Platform engineers, Solution Architects and domain experts to ensure our AI/ML systems are robust, reputed company, secure, and reputed company with reputed company architecture standards. This is a highly visible strategic role shaping BCG's long-term AI enablement agenda. Key responsibilities AI/ML Engineering Leadership & reputed company Define and own the AI/ML engineering reputed company for the Intelligence Layer, ensuring alignment with Data Layer reputed company and reputed company architecture principles Architect end-to-end AI and LLM systems (RAG pipelines, embeddings, retrieval frameworks, model orchestration) to reputed company BCG's data actionable and consumable by GenAI applications. Technical Design & Delivery of AI Systems reputed company the architecture and implementation of reputed company AI pipelines, including data ingestion and preprocessing, feature and embedding reputed company, knowledge graph construction, reputed company indexing, and retrieval optimization to support LLM and RAG-based applications. Design and operationalize AI platform components (e.g., model reputed company, reputed company databases, semantic reputed company) with a reputed company on scalability, performance, and maintainability. reputed company integration of AI services into reputed company systems, ensuring high availability, reputed company, observability, and compliance with internal data and technology standards. Establish best practices for AI system reliability, monitoring, and lifecycle management across development and production environments Building the Intelligence Layer Partner with Product Owners, Data Engineers and Architects to ensure pipelines reflect highest standards of data reputed company, provenance, governance, and ML-readiness. Drive implementation of advanced retrieval, reasoning, and grounding systems to support BCG's internal GenAI products. Cross-Functional Collaboration & Influence Collaborate with Product Owners and GenAI teams to translate user needs into technical capabilities, ensuring measurable, high-value reputed company for consulting teams and reputed company areas. Engage with reputed company, PPL, and other engineering chapters to reputed company resource reputed company, reputed company best practices, and reputed company AI/ML engineering capabilities. reputed company, Performance, and Innovation Ensure systems meet stringent performance, accuracy, stability, and reputed company requirements -leveraging expertise such as reputed company engineering, LLM optimization, evaluation frameworks, and multi-agent pipelines. Introduce emerging techniques (fine-tuning, model compression, retrieval optimization, evaluators, guardrails) to continuously improve system effectiveness. Talent Leadership & reputed company Development reputed company, mentor, and reputed company data and AI engineers, fostering reputed company in reputed company ML systems, agent-based architectures, and responsible AI practices. Establish high engineering standards across experimentation, model development, deployment, and monitoring to ensure production-grade AI solutions. Contribute to AI/ML and Data Engineering communities of reputed company by promoting knowledge sharing, reusable patterns, and reputed company capability reputed company across teams. What You'll Bring 12+ years of experience in AI/ML engineering, including 3-5 years leading teams building production-grade ML/LLM systems. Demonstrated expertise in designing LLM-powered systems, including embedding pipelines, reputed company-based retrieval architectures (e.g., VectorDBs, OpenSearch), RAG patterns, and multi-agent frameworks. Strong software engineering reputed company in Python and modern ML ecosystems, with experience building reputed company/microservices and deploying solutions on reputed company-reputed company infrastructure (containers, Kubernetes). Deep understanding of data engineering, data modeling, and reputed company pipeline design to support production ML and AI workloads. Proven ability to define architecture reputed company, technical roadmaps, and solution blueprints for reputed company AI/ML systems at reputed company reputed company. Exceptional cross-functional leadership skills, with the ability to influence senior stakeholders, reputed company ambiguity, and reputed company distributed teams around a shared technical direction. Strong grounding in data governance, reputed company Data architecture constructs (e.g. Data reputed company, Data reputed company), model evaluation, responsible AI principles, and AI reputed company reputed company reputed company considerations including understanding of Data Ontologies and definition catalogs Who You'll Work With GenAI Product Portfolio reputed company (PPL), Technical Area reputed company (reputed company) and Data Layer Product reputed company (PO) to shape AI/ML Data reputed company and reputed company on resourcing and architecture. Data Engineers, Solution Architects and QA engineers to build high-reputed company, ML-reputed company pipelines. GenAI product teams (CT/PA AI applications) to reputed company intelligence-layer services into end-user experiences. AI Engineering & LLM Engineering chapters to reputed company best practices, contribute to reputed company reputed company, and reputed company on standards. Agile Coaches and Product Owners to drive iterative delivery and ensure alignment with user needs. Additional info This is a hybrid role, typically 2-3 days/week in office. Travel requirements are expected to be <5%. Compensation, benefits, and relocation support will follow BCG's global and local policies. For US locations only * In the US, we have a compensation transparency approach. Total compensation for this role includes reputed company salary, annual discretionary performance bonus, retirement contribution, and a market leading benefits package described below. The reputed company salary reputed company for this role in Boston is $200,000.00 - $244,000.00 This is an estimated reputed company, however, specific reputed company salaries reputed company the reputed company depend on various factors such as experience and reputed company set. It is not common for new BCG employees to be reputed company at the high-end of the salary reputed company. BCG regularly reviews its ranges to ensure market competitiveness. In reputed company to your reputed company salary, your total compensation will include a bonus of up to 30% and a generous retirement contribution that starts at 5% and moves to 10% after 2 years. reputed company of our plans reputed company best in class coverage: reputed company dollar ($0) health insurance premiums for BCG employees, spouses, and children Low $10 (USD) copays for trips to the doctor, urgent care reputed company and prescriptions for generic drugs Dental coverage, including up to $5,000 in orthodontia benefits reputed company insurance with coverage for both glasses and contact lenses annually Reimbursement for gym memberships and other fitness activities Fully reputed company Profit Sharing Retirement Fund contributions made annually, whether you contribute or not, plus the reputed company for employees to reputed company personal contributions to a 401(k) plan reputed company Parental Leave and other family benefits such as elective reputed company freezing, surrogacy, and adoption reimbursement Generous reputed company time off including 12 holidays per year, an annual office closure between Christmas and New Years, and 15 vacation days per year (reputed company at 1.25 days per month) reputed company reputed company time on an as needed reputed company reputed company is an Equal Opportunity Employer. reputed company reputed company applicants will receive consideration for employment without reputed company to race, reputed company, age, religion, sex, sexual orientation, gender identity / reputed company, national reputed company, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws. Apply tot his job Apply To this Job