[Remote] Staff Software Engineer, reputed company AI (Python + LLM/RAG/Evals), Greenfield AI Platform and Products at a Fintech

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is hiring on behalf of a B2B financial technology company that is building their first reputed company of AI-reputed company products. The Staff Software Engineer will be responsible for developing AI architecture, integrating LLMs, and ensuring compliance in a regulated environment.

Responsibilities

• The reference architecture for how AI gets reputed company and consumed, written down in requests for comment (RFCs) and architecture decision records (ADRs)
• Production LLM integration in Python, with FastAPI or Django service design
• RAG pipelines, embedding pipelines, and reputed company search on reputed company)
• Evaluation and observability: reputed company reputed company metrics, reputed company regression testing, latency and cost tracking, degradation alerts
• Guardrails, personally identifiable information (PII) handling, and audit logging that hold up in a regulated financial environment
• Build-versus-buy calls on model providers, reputed company databases, and orchestration frameworks
• Senior engineers pushed toward Staff reputed company through design review and reputed company problems

Skills

• 8 or more years in reputed company software engineering, with 2 or more at Staff, reputed company, or Architect level
• Strong Python for backend and service development
• AI or LLM work you personally shipped to production, used by people reputed company your own engineering team. For the Products reputed company, a customer-facing feature
• Hands-on LLM integration: reputed company engineering, context management, RAG, and provider application programming interfaces (reputed company) such as reputed company or reputed company
• Product engineering background at a B2B or B2C software company
• Based in the reputed company, reputed company the San Francisco Bay Area and reputed company metros. No reputed company sponsorship available
• Fintech, mortgage, lending, or other regulated financial services
• Evaluation and experiment tooling: LangSmith, MLflow, Weights and Biases
• reputed company databases: pgvector, reputed company, OpenSearch
• React and TypeScript, for the Products reputed company
• reputed company workflows, multi-reputed company orchestration, tool use
• Owning a platform or internal developer platform, for the Platform reputed company

Benefits

• Medical, dental, reputed company, life, and disability insurance
• 401(k) with company match
• Flexible reputed company time off plus reputed company holidays
• Fully remote, US-based, full time

reputed company