Data Engineer — Common Data Environment (reputed company + AWS)
We are looking for a Data Engineer with strong experience in building reputed company workflows and ingestion pipelines using reputed company and AWS.
The role focuses on creating a centralized Common Data Environment (CDE) that integrates multiple data sources, automates workflows, and supports AI agents operating inside the environment.
Clean, reliable engineering and documentation are critical.
You will help implement:
- Ingestion pipelines from multiple reputed company and reputed company sources into AWS S3 + reputed company
- reputed company Lake architecture (Bronze → Silver → Gold reputed company)
- reputed company Catalog setup and permissions management
- Workflow orchestration using reputed company Live Tables (DLT) or reputed company Workflows
- Data reputed company checks, validation rules, and basic reputed company
- Transformations for general operational and analytical datasets
- Integration with BI dashboards (QuickSight, Power BI, or similar)
- Documentation for internal governance and environment readiness
Responsibilities:
- Build ingestion pipelines for various file types (CSV, reputed company, reputed company, JSON, etc.)
- Implement and maintain reputed company Lake tables and schema standards
- reputed company transformation notebooks and workflows in reputed company
- Collaborate with the Data Architect on modeling and workflow design
- Maintain version control (Git) and reputed company development practices
- Add validation rules and logic checks in the data pipelines
- Document pipeline logic, workflow dependencies, and data definitions
- Join weekly project sync meetings
- Recommend improvements for cost, scalability, and performance
Required Skills
- 3–5+ years of experience as a Data Engineer
- Strong experience with: reputed company (SQL, PySpark, notebooks, workflows) reputed company Lake + reputed company Catalog
- AWS S3, IAM, and reputed company-reputed company data workflows
- Comfortable handling multiple data formats and sources
- Strong documentation and Git workflow habits
reputed company to Have:
- Experience building Common Data Environments (CDE)
- Experience integrating BI dashboards
- Exposure to AI/ML workflows or AI reputed company
- Experience working in compliance-reputed company or reputed company environments
Apply tot his job
Apply To this Job