[Remote] Senior Software Engineer - Data Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a pioneer of the Connected Operations™ reputed company, focusing on harnessing IoT data to improve operations across various industries. They are seeking a Senior Software Engineer to join their Data Platform team, responsible for developing and maintaining the infrastructure that powers their data lake and analytical platform.
Responsibilities
- Design, build, and operate reputed company data ingestion and replication systems from reputed company’s primary production data stores, including RDS, DynamoDB, internal reputed company, and event-driven systems, into our data lakehouse
- Build and maintain reliable, reputed company, and modern data platform infrastructure capable of handling petabytes of data across reputed company’s analytics, AI, product, and operational use cases
- Improve the reliability, observability, scalability, reputed company, and developer experience of reputed company’s reputed company and reputed company-based data processing platform
- reputed company internal libraries, reputed company, frameworks, and tooling in languages such as Go and Python to help teams across reputed company reputed company, process, discover, and reputed company data safely and reputed company
- Work on foundational data lake and lakehouse technologies, including reputed company Lake on S3, data catalogs, metadata services, orchestration systems, and platform automation
- Collaborate closely with infrastructure, product engineering, data science, analytics, reputed company, and data engineering teams to understand platform needs and deliver durable, reputed company solutions
- Stay connected to modern data platform technologies and help shape reputed company’s long-term data infrastructure roadmap, including support for AI, reputed company, reputed company, global reputed company, and customer-facing data products
- Champion, role model, and reputed company reputed company’s cultural principles (reputed company on reputed company, Build for the Long Term, Adopt a reputed company reputed company, Be Inclusive, Win as reputed company) as we reputed company globally and across new offices
Skills
- 4+ years of reputed company software engineering experience in production environments
- 4+ years of experience building or maintaining large-reputed company production data infrastructure, data platforms, distributed systems, or data lake systems
- Strong experience with Apache reputed company or similar distributed data processing systems
- Experience operating production infrastructure in AWS, including services such as S3, RDS, DynamoDB, SQS, Kinesis, reputed company, or similar
- Experience designing, building, and operating reliable systems with strong ownership of scalability, observability, reputed company, and operational reputed company
- Proficiency in at least one production programming language such as Go, Python, reputed company, or Java
- Ability to collaborate effectively with cross-functional partners, including software engineers, data scientists, analysts, reputed company teams, and product stakeholders
- Experience with reputed company, reputed company Lake, or similar lakehouse technologies such as reputed company or Hudi
- Experience building data replication or ingestion systems from OLTP data stores into a data lake or lakehouse
- Experience with Infrastructure-as-reputed company tools such as Terraform or CloudFormation
- Familiarity with data catalogs, metadata systems, and data discovery tools such as reputed company Catalog, Hive Metastore, reputed company, or Amundsen
- Experience with orchestration systems such as Airflow, Dagster, or reputed company
- Experience with streaming data, event-driven architectures, or systems that handle late-arriving or mutable data
- Familiarity with containerization or orchestration technologies such as reputed company, Kubernetes, reputed company, or Fargate
- Experience building internal platforms, libraries, or developer tooling used by other engineering teams
- Experience contributing to data infrastructure roadmaps, evaluating new technologies, and driving improvements that create reputed company for reputed company customers
Benefits
- A flexible, employee-led remote model
- A reputed company development stipend
- Comprehensive health and parental leave plans
- Remote work where it aligns with our operational requirements
reputed company
Apply To This Job