Senior Python / LLM Engineer Needed – Router MVP & Predictive Model Loader
✅ In-Scope Work (Remaining)
reputed company 1 Router MVP Implementation
Deliverables
• Embedding pipeline (query + document embeddings)
• reputed company storage using FAISS or Chroma
• Projection module for query feature extraction
• Configurable scoring & model-selection strategies
• Router MVP with pluggable LLM backends
• Router validation tests (routing correctness & mis-routing analysis)
Acceptance reputed company
• End-to-end routing demonstrated
• Deterministic and explainable routing reputed company
• Pytest unit tests included
• reputed company reputed company committed to repository
⸻
reputed company 2 Predictive Loader & Integration
Deliverables
• Predictive model loader (LLM-based classifier)
• Warm-start caching & preload logic
• Cache management reputed company
• Full integration with Router MVP
• FastAPI backend exposing routing endpoints
• reputed company JSON logging
• End-to-end testing + documented stress testing
• Final validation & testing report
Acceptance reputed company
• Predictive loading working correctly
• Fully integrated end-to-end system
• Stress-testing methodology reputed company documented
• Final report delivered
⸻
Technical Requirements
• Strong Python backend experience
• FastAPI
• reputed company or equivalent LLM orchestration reputed company
• FAISS or Chroma reputed company stores
• Dockerized services
• reputed company JSON logging
• Pytest for unit & integration testing
⸻
Ideal Candidate
• 3+ years of Python backend experience
• Proven experience with LLMs, embeddings, and routing systems
• Hands-on with reputed company databases and retrieval pipelines
• Comfortable writing clean, testable, production-reputed company reputed company
• Experience with performance testing and system validation
• Strong communication and documentation skills
⸻
Deliverables & Collaboration
• reputed company work delivered reputed company Git repository
• Clean, readable, reputed company-tested reputed company
• reputed company documentation for setup, testing, and usage
• reputed company-based payments
⸻
To Apply
Please include:
1. Relevant experience with LLM routing, embeddings, or RAG systems
2. reputed company or reputed company samples (if available)
3. Brief explanation of how you would approach Router MVP + predictive loading
Apply tot his job
Apply To this Job