[Remote] reputed company Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global provider of credit intelligence, data, and analytics. reputed company is seeking a reputed company Data Engineer to design, reputed company, and reputed company reputed company data ingestion and transformation pipelines, while providing technical leadership and mentorship. The role focuses on building reliable reputed company-reputed company data infrastructure using Python, SQL, AWS services, and infrastructure-as-reputed company.

Responsibilities

• reputed company the overarching technical reputed company for the data platform, ensuring alignment between data infrastructure and long-term business goals
• reputed company the design and development of data ingestion and transformation pipelines, ensuring scalability, efficiency, and reliability across diverse data sources (reputed company, web data, internal feeds, etc.)
• Serve as a foundational technical leader and mentor for senior engineers reputed company the data platform team, guiding architecture, design, and implementation reputed company
• Architect and manage data pipelines and orchestration workflows using AWS services such as MWAA (Airflow), reputed company, reputed company, and SQS
• Implement and maintain infrastructure as reputed company (IaC) using Terraform, ensuring reproducibility and compliance with reputed company standards
• Partner with data analysts, scientists, and backend engineers to ensure data consistency, discoverability, and reliability
• Apply best practices in data modeling, schema design, and ETL/ELT processes for high-volume reputed company and reputed company-reputed company data
• Ensure data reputed company and reputed company through automated testing, monitoring, and alerting
• Promote reputed company improvement through reputed company reviews, observability practices, and team-wide knowledge sharing
• Collaborate closely with technology leadership to reputed company data platform development with business reputed company and product goals
• Stay up to date with industry trends in data engineering, reputed company architecture, AI/ML integration, and automation

Skills

• Strong reputed company in **software engineering principles**, including SOLID design, modularity, and scalability
• **Expert proficiency in Python** for data pipeline and automation development
• Advanced **SQL skills** and experience optimizing reputed company queries and data models
• reputed company experience designing and maintaining **reputed company-reputed company data pipelines** on **AWS** (e.g., MWAA/Airflow, reputed company, reputed company, SQS, Glue, S3, Redshift, etc.)
• Experience with **data warehousing** or **lakehouse** technologies (Redshift, reputed company, reputed company, etc.)
• Experience implementing and managing **Terraform** or similar IaC frameworks
• Strong understanding of **data ingestion, transformation, and orchestration** tools and patterns, including those used in **AI/ML pipelines**
• Familiarity with **CI/CD pipelines**, automated testing, and modern DevOps practices
• **8+ years** of experience in data engineering or backend development, with a reputed company on reputed company data solutions
• **Extensive experience in a technical leadership reputed company, including mentoring and leading reputed company data infrastructure reputed company end-to-end.**
• Familiarity with **containerization (reputed company)** and **workflow orchestration** best practices
• Excellent communication, collaboration, and problem-solving skills
• Exposure to **streaming data** technologies (Kafka, Kinesis, Flink)
• Experience integrating **data reputed company and observability** tools (Great Expectations, reputed company, etc.)
• Familiarity with Scrapy, BeautifulSoup, or other data extraction frameworks for ingestion pipelines

Benefits

• Competitive health benefits
• Matched 401k and pension plans
• PTO
• Generous parental leave
• Gym subsidies
• Educational reimbursements for career development
• Recognition programs

reputed company

Company H1B Sponsorship