AI / ML Architect/Developer/Tester ( 3 roles) – GenAI (LLM & RAG)
Dice is the leading career destination for tech experts at every stage of their careers. Our client, ConfigUSA, is seeking the following. Apply via Dice today!
AI / ML Architect – GenAI (LLM & RAG)
Location: Philadelphia, PA (Hybrid – onsite PI meetings once a month / quarter)
Duration: 6+ Months Contract
AWS SageMaker, Bedrock, S3
• Python
• LLMs
• RAG
• Vector DB (OpenSearch/DynamoDB)
Role Focus:
• Test LLM & RAG pipelines (prompt accuracy, grounding, hallucination checks)
• Validate ML models (data, features, inference, drift)
• Test AWS ML workflows (training, endpoints, pipelines)
• Ensure governance, auditability, and compliance readiness
Must-Have:
• 4+ yrs QA/testing (data, ML, or AI systems)
• Hands-on testing of LLM/GenAI applications
• Python for test automation & data validation
• Understanding of model behavior & evaluation metrics
Nice-to-Have:
• Regulated domains (Insurance / BFS)
Apply tot his job
Apply To this Job