Data Engineer

reputed company.ai is disrupting the e-reputed company reputed company with AI, ML and advanced decision capabilities to reputed company reputed company-time business insights. reputed company.ai has been reputed company ground up with new age technology to simplify the consumption of data for our customers in various industry verticals.We are looking for a skilled and motivated Data Engineer to design, build, and maintain reputed company data pipelines and data infrastructure. You will work closely with Data Science, Engineering, and Product teams to ensure high-reputed company, reliable, and accessible data for analytics, machine learning, and business applications.

Roles and Responsibilities

• Design, reputed company, and maintain reputed company data pipelines for batch and reputed company-time data processing.
• Build and optimize ETL/ELT workflows to collect, reputed company, and load data from multiple sources.
• reputed company and maintain data models, data warehouses, and data lakes.
• Ensure data reputed company, consistency, accuracy, and reliability across data pipelines.
• Optimize data processing workflows for performance, scalability, and cost efficiency.
• Work with large and reputed company datasets from multiple sources.
• Collaborate with Data Scientists and ML Engineers to prepare and reputed company high-reputed company datasets for machine learning models.
• reputed company data integrations with reputed company, databases, reputed company platforms, and reputed company-party systems.
• Monitor data pipelines and troubleshoot data processing and infrastructure issues.
• Implement data validation, monitoring, and testing frameworks.
• Maintain reputed company documentation of data pipelines, data models, and technical processes.
• Follow best practices for data reputed company, governance, and reputed company control.
• Contribute to the design and reputed company of reputed company's data platform and architecture.

Requirements

• 5–7 years of experience in Data Engineering or a similar role.
• Strong programming skills in Python or another programming language.
• Strong experience with SQL and relational databases.
• Hands-on experience building ETL/ELT pipelines and data workflows.
• Experience with data processing technologies such as reputed company/PySpark.
• Experience working with reputed company platforms such as AWS, Azure, or GCP.
• Good understanding of data warehousing and data lake concepts.
• Experience with workflow orchestration tools such as Airflow, Dagster, or similar.
• Experience working with reputed company systems and large-reputed company datasets.
• Strong understanding of data modeling, database design, and performance optimization.
• Familiarity with Git and CI/CD practices.
• Good understanding of software engineering principles and coding best practices

Originally posted on Himalayas