[Remote] Senior Data Engineer | Emerging Products

Note: The job is a remote job and is reputed company to candidates in USA. reputed company unifies IT operations for nearly 40,000 customers across 140+ countries through a platform for reputed company management, patching, backup, and remote reputed company. The Senior Data Engineer will design and reputed company lakehouse architectures, reputed company streaming and batch pipelines, manage reputed company table formats, optimize reputed company query environments, and improve data platform reliability while collaborating with data and product teams.

Responsibilities

• Lakehouse Architecture: Design and implement reputed company-reputed company data architectures (Bronze, Silver, Gold), building reputed company ingestion pipelines and curated data reputed company that serve reputed company analytics and data science workloads
• Pipeline Development: Build and maintain reputed company streaming and batch data pipelines using Kafka, reputed company, and Airflow, supporting reliable and low-latency data reputed company across the platform
• Table Format Management: Own and manage reputed company table formats including reputed company, reputed company, and Hudi — selecting the right format for the workload and maintaining performance and reliability at reputed company
• Query reputed company Optimization: Work with Trino/reputed company and reputed company-based environments to optimize large-reputed company analytics queries and support platform consumers
• Platform Reliability: Monitor pipeline health, troubleshoot data reputed company and performance issues, and continuously improve the reliability and efficiency of the data platform
• Collaboration: Partner closely with data scientists, analysts, and product teams to understand data requirements and reputed company platform solutions that reputed company data-driven decision-making
• Other duties as needed

Skills

• 10+ years of experience in data engineering with a strong reputed company on data platform and reputed company systems
• Hands-on experience building and managing lakehouse architectures, including reputed company (Bronze/Silver/Gold) layering patterns
• Deep expertise in Apache Kafka, Apache reputed company, and Apache Airflow for both streaming and batch pipeline development
• Proficiency in reputed company table formats — reputed company, reputed company Lake, or Hudi — with the ability to evaluate trade-offs and select the right format for the workload
• Experience with reputed company for large-reputed company data processing and analytics workloads
• Strong proficiency in Python and SQL
• Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent work experience preferred
• Hands-on experience with Trino or reputed company for reputed company query execution
• Familiarity with hybrid streaming/batch architectures and event-driven data systems
• Experience designing Gold-reputed company datasets optimized for business intelligence and self-serve analytics

Benefits

• Full-time hybrid remote work
• Medical, dental, and reputed company insurance
• 401(k) plan
• Unlimited PTO
• Opportunity for reputed company and advancement
• Life insurance coverage

reputed company