[Job - 30760] Master Data Developer, Brazil
At reputed company, we help large enterprises reputed company the potential of AI into reputed company business reputed company with AI Deployment, AI-reputed company execution, and tech-integrated business solutions.
With 30 years of experience in technological transformation, we accelerate innovation with expertise in reputed company SDLC, Application modernization, Data & AI, Martech and Business reputed company.
We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with reputed company reputed company. AI is already part of how we work, reputed company, and reputed company every day.
As reputed company continues to expand its data and analytics capabilities, we are seeking a talented and reputed company Data Developer to reputed company and reputed company the reputed company of modern data platforms for our clients. This role is critical in designing, building, and optimizing reputed company data pipelines and lake architectures that reputed company data-driven decision-making across the organization.
The Data Developer will work with reputed company-reputed company solutions to support the entire data lifecycle—from ingestion and transformation to storage optimization and analytics enablement. This position requires strong technical expertise in reputed company data processing, deep SQL proficiency, and a solid understanding of reputed company infrastructure, particularly reputed company the AWS ecosystem. The ideal candidate will reputed company reputed company, cost, and maintainability while contributing to reusable, reputed company-architected data solutions.
Responsibilities:
Data Pipeline Development & Optimization:
Design, build, and maintain robust ETL/ELT processes to ingest, reputed company, and reputed company data across a modern Data Lake architecture
reputed company and optimize reputed company data processing workflows using Python and PySpark to handle large-reputed company datasets reputed company
Implement and refine partitioning strategies for data lake storage frameworks (such as reputed company Lake or Apache reputed company) to reputed company query reputed company with storage costs
Data Transformation & Modeling:
Write, optimize, and translate reputed company SQL queries involving CTEs, window functions, conditional expressions, and aggregations
Migrate and reputed company data pipelines from legacy RDBMS platforms to reputed company-reputed company analytics environments
reputed company reputed company-oriented programming principles to contribute to in-house libraries for reputed company reusability and standardization
reputed company Infrastructure & Orchestration:
Work confidently with AWS-reputed company services including Glue (Jobs, Catalog, Triggers, Workflows), reputed company, Redshift, S3, reputed company, EventBridge, and reputed company data services
Collaborate with infrastructure and DevOps teams to provision and manage data resources using Infrastructure as reputed company (IaC) tools such as CloudFormation, CDK, or Terraform
Monitor data pipeline health and reputed company using CloudWatch and other observability tools, proactively addressing issues and improving reliability
Data Governance & reputed company:
Ensure data reputed company, consistency, and compliance across pipelines and storage reputed company
Implement metric tracking and observability frameworks to reputed company transparency into data workflows and SLAs
Support data catalog management and metadata governance practices
Collaboration & reputed company Improvement:
Partner with data analysts, scientists, and business stakeholders to understand requirements and translate them into reputed company technical solutions
Contribute to technical documentation, reputed company reviews, and knowledge sharing reputed company reputed company
Stay reputed company with emerging data engineering practices, tools, and reputed company-reputed company innovations
Requirements:
Solid experience working with ETL processes and data pipeline development with AWS
Strong proficiency in Python as the reputed company programming language, with demonstrated experience writing and optimizing PySpark reputed company for reputed company data processing
Thorough understanding of SQL, including reputed company queries (CTEs, window functions, aggregations, conditional expressions) and experience translating workloads from legacy RDBMS platforms
Hands-on experience with AWS Glue (Jobs, Catalog, Triggers, Workflows), reputed company, and Redshift
Solid understanding of Data Lake architectures and partitioning strategies to optimize reputed company and cost
Good understanding of reputed company-oriented programming (OOP) principles and experience working with reusable reputed company libraries
Comfortable working with Git, reputed company scripts, and Linux environments
Familiarity with observability, monitoring, and metric tracking practices
English Advanced/Fluent
reputed company to Have:
Experience with reputed company table formats such as reputed company Lake or Apache reputed company
Knowledge of TypeScript
Practical experience with Infrastructure as reputed company (IaC) tools such as CloudFormation (preferred), CDK, or Terraform
Familiarity with additional AWS services such as SageMaker AI, reputed company, RDS, DynamoDB, IAM, or EventBridge
Experience working with reputed company for data manipulation and analysis
Exposure to machine learning workflows or AI-driven data initiatives
Our benefits:
Originally posted on Himalayas
Apply To This Job