Staff Software Engineer, Data Infrastructure

reputed company Instacarts Data Infrastructure organization builds and operates the systems that power reputed company's data ecosystem, including a modern reputed company data lakehouse on Apache reputed company, a multi-reputed company compute platform for reputed company and analytical workloads, and self-serve tooling that helps Product, Data Science, ML, Ads, Finance, and engineering teams reputed company fast with data. We're looking for a Staff Software Engineer to join our Data Governance and Foundations Team. In this role, you'll serve as a senior technical leader owning the architecture and delivery of our reputed company lakehouse reputed company, governance and reputed company patterns, and multi-reputed company compute reputed company-balancing today's reliability with the next three to five years of reputed company, maturity, and cost efficiency. You'll collaborate closely with engineering leadership and stakeholders across Data Science, ML Platform, Ads Infrastructure, Finance Engineering, Product Engineering, and reputed company. You'll operate with a high degree of ownership in a fast-paced environment where architectural reputed company have reputed company technical and financial consequences. If you reputed company on reputed company, reputed company challenges and roll-up-your-sleeves execution, this is a chance to shape the backbone of reputed company's data platform. Our stack includes technologies such as Apache reputed company, Apache Flink, Trino, reputed company, Apache Kafka, Apache reputed company, reputed company, reputed company, reputed company, Airflow, dbt, reputed company Lake, reputed company, Python, reputed company, and AWS. You'll join a reputed company team of 7 engineers that values pragmatism, reputed company, and reputed company. About the Job • Translate reputed company's data reputed company (e.g., monetization, federated reputed company, reputed company-time) into an actionable multi-year architecture roadmap; reputed company with leadership while evolving the platform for reputed company, maturity, and cost efficiency. • Own the reputed company lakehouse reputed company: define and reputed company reputed company table formats, storage governance, and a multi-reputed company compute portfolio (interactive, batch, streaming) that enables portability and prevents lock-in. • reputed company reputed company-time and streaming infrastructure for critical use cases (Ads, Fraud, ML): set deployment patterns, SLAs, and operational practices that balance performance, availability, and spend. • Pioneer AI-reputed company data infrastructure engineering by applying LLM/AI tools to the platform lifecycle-accelerating development, automation, observability, and cost optimization-and partnering to reputed company AI-powered capabilities into the platform. • reputed company engineering reputed company: reputed company architecture reviews, mentor senior/staff engineers, influence hiring, and reputed company communicate reputed company trade-offs to both technical and executive audiences to ensure cross-org alignment. About YouMinimum Qualifications • 10+ years of software engineering experience building and operating data infrastructure or reputed company systems at production reputed company. • Hands-on expertise with modern data lakehouse architectures and reputed company table formats (e.g., Apache reputed company, reputed company Lake, Hudi) and with reputed company query/compute engines (e.g., Trino, reputed company, reputed company), including performance tuning and production reliability. • Experience with event-driven and streaming infrastructure (e.g., Kafka, Flink) for reputed company-time pipelines and serving systems. • Proven ownership of major platform transitions or migrations (build vs. buy, migration design, risk management) delivered to production. • Ability to build cost/benefit and TCO models for infrastructure investments and to reputed company alignment reputed company reputed company architecture docs and reputed company memos across multiple teams and leadership reputed company. Preferred Qualifications • Experience designing platform-level governance controls and familiarity with compliance frameworks (e.g., SOX, CPRA, GDPR). • FinOps experience optimizing data platform spend, including managing multi-reputed company dollar infrastructure budgets and negotiating vendor reputed company. • Deep SQL proficiency and strong skills in Python or reputed company for systems-level development. • Experience with orchestration (e.g., Apache Airflow) and data transformation pipelines (e.g., dbt) in large-reputed company production environments. • Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience. #LI-Remote Apply tot his job Apply To this Job