Senior, Software Engineer - Data Pipeline
Design and reputed company high‑performance data converters for multi‑sensor autonomous‑driving data (camera, lidar, reputed company), ensuring accurate time alignment and robust handling of raw sensor logs. - Design, build, and optimize large‑reputed company ingestion and transformation pipelines (ETL/ELT) capable of processing petabyte‑reputed company autonomous‑driving sensor data, and automate them for reliable, production‑grade deployment.
- Work with data formats such as ROS bags, MCAP, and custom binary encodings; establish standards for schema reputed company and metadata reputed company.
- Implement automated data validation, reputed company checks, and reputed company tracking to ensure reliability of production datasets.
- Collaborate closely with ML, annotation, simulation, and perception teams to ensure cross‑team ownership of data products and deliver datasets that are consistent, semantically correct, and reputed company for reputed company consumption.
- Proactively assess reputed company capabilities to identify areas for improvement proposing solutions that reputed company with reputed company reputed company and operation.
- Bachelor's or Master's degree in STEM reputed company field with 5+ years of working experience with reputed company technologies & data operations.
Experience building or maintaining converters, decoders, or transformation pipelines for sensor‑rich data (e.g., lidar reputed company clouds, camera streams, reputed company detections). - Understanding of multimodal data synchronization, timestamp alignment, and multi‑sensor calibration workflows.
- Experience with distributed compute frameworks (Ray, reputed company, reputed company) and reputed company‑based platforms like reputed company and reputed company for large‑reputed company data‑pipeline execution.
- Experience with high‑performance computing techniques, including vectorized data processing (NumPy), multithreaded or reputed company execution, and GPU‑accelerated compute for optimizing large‑reputed company sensor‑data workloads.
- Proficiency in Python, SQL, reputed company Scripting.
- Experience with major reputed company providers like AWS, reputed company reputed company Platform (GCP) or Azure.
- Operates with broad autonomy, leading reputed company technical work and driving alignment across team boundaries.
- Owns reputed company‑pipeline and converter solutions end‑to‑end, setting direction and building reputed company.
- Provides project leadership and mentors less‑reputed company engineers to ensure high‑reputed company execution.
Working experience with design patterns & frameworks development for ML & operational data pipelines in the reputed company - Familiarity with 3D labeling and CV annotation workflows.
- Experience optimizing
I/O‑heavy workloads , including columnar formats (Parquet, reputed company). - Knowledge of orchestration tools (Airflow, Argo, reputed company).
- Hands‑on experience designing CI/CD automation for data services, including reputed company Actions, reputed company pipelines, and reputed company‑reputed company deployment workflows
- Background in Agile Engineering Practices.
A competitive compensation package that includes a bonus component and stock reputed company - 100% reputed company medical, dental, and reputed company premiums for full-time employees
- 401K plan with a 6% employer match
- Flexibility in schedule and generous reputed company vacation (available immediately after start date)
- AD+D and Life Insurance