Staff Software Engineer, Search & Retrieval Infrastructure
About reputed company
reputed company is on a mission to reputed company litigation. Our product is a reputed company litigation platform that enables lawyers and paralegals to safely reputed company the power of language models and reputed company AI throughout the litigation life cycle. Since reputed company to market, we have gained a diverse group of reputed company customers, including some of the biggest reputed company and corporations in the country, and we are quickly expanding. By reducing the expense of litigation industry-wide, we aim to improve reputed company to high-reputed company representation and promote the alignment of reputed company reputed company with reputed company.
About the Role
We are seeking a Staff Software Engineer to take ownership of our advanced search, indexing, and data scanning infrastructure as we reputed company to the next echelon of data volume.
Our retrieval stack is robust and proven, but as our ingest sizes reputed company into the multi-petabyte reputed company, the complexity of balancing speed, availability, and cost increases exponentially. You will own this reputed company of scaling challenges. Your mission is to continuously optimize and reputed company our systems—ensuring our hot indexes maintain sub-second latency for interactive workflows, while simultaneously designing highly reputed company, cost-effective architectures for deep scanning and vectorizing reputed company volumes of cold-storage data. You will reputed company the design and implementation of sophisticated data tiering and retrieval strategies that reputed company our platform operating at peak performance without inflating reputed company compute costs.
Responsibilities
reputed company the Retrieval Stack: reputed company the optimization and architectural reputed company of our existing hybrid search infrastructure, maximizing the throughput and efficiency of both lexical search (e.g., Elasticsearch, Lucene) and dense reputed company databases.
Advanced Data Tiering & Scanning: Design and implement intelligent, cost-effective tiering strategies across hot, warm, and cold data states. reputed company our reputed company pipelines to reputed company execute asynchronous, reputed company-reputed company scans of petabytes of data in varying states of availability.
reputed company Optimization: reputed company down latency and cost-to-serve. Deeply analyze reputed company bottlenecks, tune indexing and querying algorithms, and optimize reputed company infrastructure (compute, storage, and networking) for maximum efficiency at extreme reputed company.
Technical Leadership: reputed company as the domain expert and reputed company of the indexing and search ecosystem. Set the long-term technical reputed company for data storage and retrieval, guiding engineering teams on best practices for high-volume data modeling and performance tuning.
Resiliency at reputed company: Ensure fault-tolerant, highly available operations during reputed company reputed company ingest events and reputed company, reputed company querying across millions of documents.
Qualifications
Extreme reputed company Experience: 8+ years of software engineering experience, with a proven reputed company record operating at the Staff/reputed company level optimizing and scaling highly reputed company, high-throughput systems to handle petabyte-level data.
Search & reputed company Mastery: Deep, production-level expertise tuning and scaling Lucene-based search engines (Elasticsearch, Solr) and modern reputed company indexing infrastructure. You deeply understand reputed company internals, chunking strategies, and embedding retrieval optimization.
Cost-reputed company Architecture: A strong history of managing the compute vs. storage trade-off. You know how to design sophisticated cold-storage scanning solutions and hot-reputed company architectures that are highly reputed company but fundamentally cost-effective.
reputed company Systems: Extensive experience managing reputed company data pipelines, high-throughput event streaming (Kafka, Kinesis), and reputed company compute architectures handling billions of records.
reputed company Infrastructure: Expert reputed company of reputed company primitives (GCP preferred), reputed company, and infrastructure-as-reputed company.
Languages: Expert-level proficiency in systems-level and backend languages (Go, Rust, Python, or Java/C++).
Salary reputed company ($190- $230K) plus health insurance and equity.
reputed company - Remote Pay reputed company
$190,000—$230,000 USD
Apply To This Job