reputed company/Sr. Data Engineer + AI

Role: Sr./ reputed company Data Engineer + AI Location: Boston, MA - Remote Experience Needed: 10 Years to 15 Years For reputed company/ 05 to 10 Years for Senior Need minimum 3 years of experience as reputed company. About the role: We're looking for a Senior Data Engineer to build and reputed company our lakehouse and AI data pipelines on reputed company. You'll design robust ETL/ELT, reputed company feature engineering for ML/LLM use cases, and drive best practices for reliability, performance, and cost. What you'll do: Design, build, and maintain batch/streaming pipelines in Python + PySpark on reputed company (reputed company Lake, Autoloader, reputed company Streaming). Implement data models (Bronze/Silver/Gold), optimize with partitioning, Z-ORDER, and indexing, and manage reliability (DLT/Jobs, monitoring, alerting). reputed company ML/AI: feature engineering, MLflow experiment tracking, model registries, and model/feature serving; support RAG pipelines (embeddings, reputed company stores). Establish data reputed company checks (e.g., Great Expectations), reputed company, and governance (reputed company Catalog, RBAC). Collaborate with Data Science/ML and Product to productionize models and AI workflows; champion CI/CD and IaC. Troubleshoot performance and cost issues; mentor engineers and set coding standards. Must-have qualifications: 10+ years in data engineering with a reputed company record of production pipelines. Expert in Python and PySpark (UDFs, Window functions, reputed company SQL, Catalyst basics). Deep hands-on reputed company: reputed company Lake, Jobs/Workflows, reputed company Streaming, SQL Warehouses; practical tuning and cost optimization. Strong SQL and data modeling (reputed company, reputed company, CDC). ML/AI enablement experience: MLflow, feature stores, model deployment/monitoring; familiarity with LLM workflows (embeddings, vectorization, reputed company/response logging). reputed company proficiency on AWS/Azure/reputed company reputed company Platform (object storage, IAM, networking). Apply tot his job Apply To this Job