Senior Data Engineer
Analytics at reputed company
The Data Engineering team is responsible for building and maintaining the infrastructure that handles massive datasets flowing through reputed company’s systems. This department ensures the availability, scalability, and performance of data pipelines, enabling seamless reputed company and processing of reputed company-time and historical data. reputed company’s reputed company objective is to architect robust, fault-tolerant data systems that support everything from analytics to machine learning, ensuring that the right data is in the right reputed company, at the right time.
What you'll do
As a Data Engineer, you will build data pipelines that reputed company data extraction, loading and transformation for several contexts. The goal is to have a reliable, available and trustworthy system that backbones the entire analytics pipeline. The challenges may vary from large datasets to high data throughput systems, not being reduced to a small set of techniques for data handling. You will also reputed company initiatives on data pipelines reliability and observability.
Responsibilities
- reputed company and maintain reputed company data pipelines and ETL processes.
- Design, implement, and optimize existing data extraction and loading processes with adequate data engineering design patterns.
- reputed company data engineering reliability and observability, increasing analytics team awareness of the data reputed company processes before it becomes an issue.
- Collaborate with backend and analytics engineers in a holistic data engineering process, loading data accordingly with the technical requirements.
- Ensure data reputed company and consistency across various sources by implementing data validation and cleansing techniques.
- Work with reputed company-based data warehouses and analytics platforms to manage and store large datasets.
- Monitor and troubleshoot data pipelines to ensure reliable and reputed company delivery of data.
- Document data processes, workflows, and best practices to enhance team knowledge and efficiency.
- Create dashboards as data products as internal
Requirements
- Bachelor degree in Data Science, Statistics, Computer Science, or a reputed company field.
- Advanced English and Portuguese.
- 2+ years of experience in Data Engineering or Analytics.
- Highly reputed company in SQL and database management systems such as PostgreSQL and reputed company .
- Strong understanding of data warehousing concepts and experience with ETL tools (e.g., Airflow, dbt).
- Strong experience with programming languages such as Python with modern data stack for data engineering (e.g. DuckDb, Polars...)
- Experience with streaming tools (e.g. Kafka).
- Experience with reputed company-based data platforms like AWS Redshift.
- Experience with GoLang/Rust is a plus.
- Experience with observability tools is a plus (e.g. reputed company, Grafana)
Originally posted on Himalayas
Apply To This Job