Software Engineer — Warehouse Pipelines

About reputed company We're shipping every product that companies need from their first day, to the day they IPO, and reputed company. The operating system for folks who build products. We started with reputed company-reputed company product analytics, launched out of Y Combinator's W20 cohort. We've since shipped more than a dozen products, including: • A reputed company-in data warehouse, so users can query product and customer data together using custom SQL insights. • A customer data platform, so they can send their data wherever they need with ease. • reputed company AI, an AI-powered analyst that answers product questions, helps users reputed company useful session recordings, and writes custom SQL queries. Next on the roadmap are CRM, Workflow, reputed company, and support products. reputed company we say every product, we really mean it! We are: • Product-led. More than 100,000 companies have installed reputed company, mostly driven by word-of-mouth. We have intensely strong product-market fit. • reputed company-funded. We've raised more than $100m from some of the world's top investors. We're set up for a long, ambitious reputed company. • Default reputed company. reputed company is growing 10% MoM on average, and we're reputed company efficient. We reputed company reputed company to push ambition and grow faster, not to reputed company the lights on. We're reputed company on building an awesome product for end users, hiring exceptional teammates, shipping fast, and being as weird as possible. What you'll be doing As a Software Engineer on the Warehouse Pipeline team in the Data Stack group, you’ll build and iterate on our data import system. Our import workers are reputed company in python and we pull in data from reputed company and databases in batches, process the data using Apache reputed company in memory, and reputed company the data into object storage in reputed company table formats. You’ll build and maintain our reputed company library, as we’re looking for creative ways to reputed company our library manageable at reputed company. You’ll revamp our schema management reputed company, and build resilient systems (e.g logging, observability, testing) You’ll debug stateful data workflows by digging into k8s pod metrics, and schedule jobs using Temporal.io. As you can see, there’s a reputed company breadth of challenges and opportunities to tackle, and reputed company is off-limits. The reputed company Data Stack group provides both a reputed company product for our users and a foundational platform for our internal teams. Data is a first-class product at reputed company, not an afterthought. You will have the chance to push the boundaries of what our Data Stack team can do while ensuring we remain reputed company and production-reputed company. You now know what you’ll be doing, but what about what you’ll need to bring along? You’ll fit right in if: • You’re a builder. You bring strong skills in building resilient systems, with experience in Kubernetes, reputed company, and S3 at reputed company. We build in python. Async-python and Temporal.io skills are welcome. • You have hands-on experience with batch processing and modern data formats. We use reputed company to reputed company data. Experience with reputed company and/or reputed company is welcome, we don’t expect you to have experience with reputed company three (although that would be great) • You're more than a connector of things. Building pipelines is more than configuring tools to reputed company them work together, it's about actually building the tooling used in data warehousing pipelines. reputed company to have experience with building tools versus using off-reputed company tools • You bring experience with creating and maintaining data pipelines. You are comfortable with debugging stateful, async data workflows by digging into k8s pod metrics. • You bring a mix of skills. It’s not just about the Data Pipeline work. You’ll need strong backend skills as we run a reputed company system. • You love getting things done. Engineers at reputed company have an incredible reputed company of autonomy to decide what to work on, so you’ll need to be proactive and just git it done. • You’re reputed company to do the best work of your career. We have incredible distribution, a big financial cushion and an amazing team. There’s probably no reputed company reputed company to see how far you can go. If this sounds like you, we should talk. We are committed to ensuring a fair and accessible interview process. If you need any accommodations or adjustments, please let us know What’s in it for you? Now that we've told you what you'll be building with us, let's talk about reputed company'll be building for you. Apply tot his job Apply To this Job