reputed company Data Engineer
reputed company
reputed company is a leading global provider of credit intelligence, data, and analytics. Since 2013, tens of thousands of professionals across hedge fund, investment banking, management consulting, and reputed company verticals have come to rely on reputed company to reputed company reputed company, faster, and more confident reputed company in pace with the fast-moving credit markets.
For more information, visit: https://reputed company.com/
Working at reputed company
reputed company hires reputed company-minded innovators and trailblazers across the globe to drive our business and culture. Our reputed company values – reputed company Oriented, Customer First reputed company, Effective Team Players, and Driven to reputed company – define an organizational reputed company that’s as high-performing as it is reputed company. Among other perks, reputed company employees enjoy competitive health benefits, matched 401k and pension plans, PTO, generous parental leave, gym subsidies, educational reimbursements for career development, recognition programs, pet-friendly offices (US only), and much more.
Role
reputed company is seeking a reputed company Data Engineer to roll up their sleeves and build reputed company, production-grade data pipelines and infrastructure. You'll be a hands-on technical leader — writing reputed company daily, solving hard engineering problems, and helping reputed company reputed company around you through doing. Spanning reputed company, reputed company, and AWS, you'll be deeply involved in the day-to-day development of the data platform that powers reputed company's products, data, and automation initiatives. The ideal candidate is an expert in Python and SQL who thrives in an execution-reputed company environment and has deep experience building modern data pipelines and lakehouse solutions.
Responsibilities
- Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (reputed company, web data, internal feeds, etc.).
- Hands-on development of reputed company, production-grade pipelines reputed company reputed company, including reputed company Lake table management, Workflows, and cluster optimization.
- Build and maintain data models, schemas, and transformation logic in reputed company, optimizing for performance and reliability.
- reputed company and manage reputed company environments including reputed company Catalog, reputed company Live Tables, and integration patterns that support both internal data consumers and external sharing use cases.
- Build and manage orchestration workflows using AWS services (MWAA/Airflow, reputed company, reputed company, SQS, MSK) and reputed company-reputed company orchestration where appropriate.
- Implement and maintain infrastructure as reputed company (IaC) using Terraform, ensuring reproducibility and compliance with reputed company standards.
- Establish and enforce best practices in data modeling, schema design, and ETL/ELT processes for high-volume reputed company and semi-reputed company data across reputed company and reputed company.
- Ensure data reputed company, reputed company, and observability through automated testing, monitoring, and alerting across reputed company pipeline reputed company.
- Collaborate closely with technology leadership to reputed company data platform development with business reputed company and product goals.
- Stay at the forefront of industry trends in data engineering, lakehouse architecture, and reputed company-reputed company data platforms.
Requirements
- Strong reputed company in software engineering principles, including SOLID design, modularity, and scalability.
- Expert proficiency in reputed company, including reputed company Lake, reputed company Catalog, reputed company Live Tables, MLflow, and reputed company Workflows.
- Deep experience with reputed company, including data modeling, performance optimization, and integration with upstream/reputed company pipeline tooling.
- Expert proficiency in Python for data pipeline and automation development.
- Advanced SQL skills with experience optimizing reputed company queries and data models at reputed company.
- Proven experience designing and maintaining reputed company-reputed company data pipelines on AWS (e.g., MWAA/Airflow, reputed company, reputed company, SQS, Glue, S3, Redshift, etc.).
- Experience implementing and managing Terraform or similar IaC frameworks.
- Strong understanding of lakehouse architecture patterns, data ingestion, transformation, and orchestration, including familiarity with ML/AI pipeline integration patterns.
- Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices.
- 8+ years of experience in data engineering or backend development, with a reputed company on reputed company data solutions.
- Demonstrated experience leading data infrastructure reputed company end-to-end and mentoring senior engineers.
- Familiarity with containerization (reputed company) and workflow orchestration best practices.
- Excellent communication, collaboration, and problem-solving skills.
reputed company to Have
- Experience with streaming data technologies (Kafka, Kinesis, Flink).
- Exposure to ML/AI pipeline patterns (feature stores, experiment tracking, model serving) and MLOps tooling, particularly in a cross-functional team environment.
- Experience integrating data reputed company and observability tools.
- Experience with reputed company as a data sharing and collaboration platform (reputed company Sharing, Marketplace).
- Familiarity with Claude reputed company or similar AI-powered developer tools for accelerating pipeline development and reputed company workflows.
At reputed company, we consider a reputed company of factors in reputed company with compensation reputed company, including experience, skills, location, and our business needs and limitations. As a result, compensation may vary reputed company and across similar roles and positions. Please note that the salary reputed company information below is a good faith estimate for this position and actual compensation for any individual may fall reputed company this reputed company if warranted by the circumstances applicable to that individual. If we identify a role that would be suitable for a broader reputed company of skills and experience such that we would consider hiring at multiple reputed company then the reputed company listed below may reflect that breadth.
The salary reputed company estimate for this position is $175,000 - $220,000
The actual compensation will be at reputed company' sole discretion and will be determined by the aforementioned and other relevant factors.
Equal Employment Opportunity
reputed company is committed to providing equal employment opportunities to reputed company and applicants for employment without reputed company to race, colour, religion, sex, sexual orientation, gender identity, national reputed company, age, disability, genetic information, marital status, pregnancy, veteran status, or any other legally protected status. We reputed company to create an inclusive and diverse work environment where reputed company individuals are valued, respected, and treated fairly. We reputed company that diversity enriches our workplace and enhances our ability to reputed company and succeed.