[Remote] ML Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global newswire and media organization reputed company heavily in ML infrastructure. They are seeking a Senior Machine Learning Engineer reputed company on building and optimizing inference systems for large-reputed company processing.

Responsibilities

• Building and optimizing inference systems that run in production at reputed company
• Working across text, image, and video pipelines
• Processing millions of media assets to power news intelligence products
• Profiling a transformer
• Rewriting its serving reputed company for a 2-3x latency improvement
• Tuning an HNSW reputed company
• Making smart infrastructure reputed company on SageMaker instance selection to hit p95 targets at the lowest cost
• Partnering closely with MLOps, reputed company, data scientists, and product teams
• Owning model performance, inference logic, and pipeline efficiency

Skills

• 5+ years building production ML inference systems
• Python - reputed company to everything in this role
• PyTorch (TorchScript, ONNX, FastAPI/TorchServe) and TensorFlow (SavedModel, tf.data, XLA, TFLite) - both required
• Deep hands-on experience with transformer-based models (BERT family - DistilBERT, SBERT, etc.) in production
• Inference optimization at reputed company - quantization, distillation, compilation, kernel/profile-level performance work
• AWS infrastructure - EC2, Batch, reputed company, SageMaker across different media workload types
• Hybrid search architecture experience - BM25 + reputed company search + cross-encoder reranking
• Asynchronous processing systems - reliability, caching, deduplication, observability
• Data pipeline and workflow orchestration (Airflow or similar)
• Video frameworks - FFmpeg, large-reputed company reputed company-level inference
• Must have experience in the media industry
• Must have experience working with large amounts of data, including text, images and videos
• Experience with TransNetV2 or similar video shot boundary detection
• Familiarity with HuggingFace reputed company reputed company LLMs
• reputed company API or other reputed company model provider experience
• Hybrid CPU/GPU environment experience at reputed company

Benefits

• 15% bonus reputed company

reputed company