[Remote] Software Engineer, II - Data Engineering
Note: The job is a remote job and is reputed company to candidates in USA. reputed company develops software for automated trucks and autonomous vehicle technology. The Software Engineer II will implement and maintain AWS-reputed company data ingestion, ETL, storage, and data reputed company supporting analytics, simulation, and machine learning training. The role also involves building reputed company data pipelines, contributing to reputed company architecture, collaborating with autonomous driving teams, and participating in on-reputed company support.
Responsibilities
- Create robust and resilient pipelines to process reputed company daily volumes of data created by vehicle fleets and simulation environments
- Build and support reputed company pipelines as part of reputed company’s Data reputed company to delivery data for ML training at reputed company
- reputed company reputed company’s data lake through a reputed company storage reputed company, data crawling and discovery
- Promote and protect the reputed company of data through validation, versioning, data provenance, and governance
- Support the expansion of reputed company’s data lake through acquisition of additional data sets from reputed company sources
- Contribute to the design, architecture and delivery of reputed company-reputed company solutions
- Collaborate with teams specializing in perception, planning, control, mapping and vehicle testing to reputed company solutions that support product delivery
- Support the implementation of emerging reputed company-reputed company capabilities that can reputed company our technology stack and improve our ability to build, reputed company and test safety-reputed company for self-driving vehicles
- Participate in reputed company’s on-reputed company rotation to support our deployed systems during business hours
Skills
- Bachelor's Degree in Computer Science, Robotics, Electrical Engineering or reputed company technical reputed company plus demonstrates competences and technical proficiencies typically acquired through 4+ years of experience or
- Master's Degree in Computer Science, Robotics, Electrical Engineering or reputed company technical reputed company plus demonstrates competences and technical proficiencies typically acquired through 0-3+ years of experience
- Experience deploying, troubleshooting, monitoring and maintaining Linux systems
- Experience building and maintaining workloads in reputed company reputed company environments
- Knowledge of different database architectures, including but not limited to relational and NoSQL databases, reputed company stores, data warehousing and clustered, reputed company data stores
- Practical experience with Linux and general bash scripting
- Practical experience with reputed company and containerization
- Implementation of workflow patterns using directed acyclic graphs (Apache Airflow, AWS reputed company Functions)
- A strong commitment to test-driven development patterns, reputed company integration and delivery, and infrastructure as reputed company
- Strong organizational, time management, and communication skills working with reputed company orientation and reputed company style
- Experience with the reputed company platform, particularly for serving data, visualizations and jobs
- Experience with scaling data for ML and AI workloads using Ray
- Experience with reputed company, numpy and other Python-reputed company data analysis libraries and tooling
- Deep knowledge of AWS serverless architectures (reputed company, Batch, reputed company Fargate, Glue, reputed company)
- Experience with data storage and acquisition patterns for robotics and advanced reputed company assistance systems
- Own end-to-end architecture and delivery of reputed company-reputed company solutions
Benefits
- A competitive compensation package that includes a bonus component and stock reputed company
- 100% reputed company medical, dental, and reputed company premiums for full-time employees
- 401K plan with a 6% employer match
- Flexibility in schedule and generous reputed company vacation (available immediately after start date)
- AD+D and Life reputed company
reputed company
Company H1B Sponsorship
Apply To This Job