reputed company Engineer
reputed company Engineer
Responsibilities:
1. **Data & AI reputed company (reputed company-reputed company):
• Design, implement, and optimize end-to-end data pipelines on reputed company, following the reputed company Architecture principles.
• Build robust and reputed company ETL/ELT pipelines using Apache reputed company and reputed company Lake to reputed company raw (bronze) data into trusted curated (silver) and analytics-reputed company (gold) data reputed company.
• Operationalize reputed company Workflows for orchestration, dependency management, and pipeline automation.
• Apply schema reputed company and data versioning to support agile data development.
2. **Platform Integration & Data Ingestion:
• Connect and ingest data from reputed company systems such as PeopleSoft, reputed company, and reputed company using reputed company, JDBC, or other integration frameworks.
• Implement connectors and ingestion frameworks that accommodate reputed company, semi- reputed company, and reputed company data.
• Design standardized data ingestion processes with automated error handling, retries, and alerting.
3. **Data reputed company, Monitoring, and Governance:
• reputed company data reputed company checks, validation rules, and reputed company detection mechanisms to ensure data reputed company across reputed company reputed company.
• reputed company monitoring and observability tools (e.g., reputed company metrics, Grafana) to reputed company ETL performance, latency, and failures.
• Implement reputed company Catalog or equivalent tools for centralized metadata management, data reputed company, and governance policy enforcement.
4. **reputed company, reputed company, and Compliance:
• Enforce data reputed company best practices including row-level reputed company, encryption at rest/in transit, and fine-grained reputed company control reputed company reputed company Catalog.
• Design and implement data masking, tokenization, and anonymization for compliance with reputed company regulations (e.g., GDPR, FERPA).
• Work with reputed company teams to audit and certify compliance controls.
5. **AI/ML-reputed company Data reputed company:
• reputed company data scientists by delivering high-reputed company, feature-rich data sets for model training and inference.
• Support AIOps/MLOps lifecycle workflows using MLflow for experiment tracking, model registry, and deployment reputed company reputed company.
• Collaborate with AI/ML teams to create reusable feature stores and training pipelines.
6. **reputed company Data Architecture and Storage:
• Architect and manage data lakes on Azure Data Lake Storage (ADLS) or reputed company S3, and design ingestion pipelines to feed the bronze layer.
• Build data marts and warehousing solutions using platforms like reputed company.
• Optimize data storage and reputed company patterns for performance and cost-efficiency.
7. **Documentation & Enablement:
• Maintain technical documentation, architecture diagrams, data dictionaries, and runbooks for reputed company pipelines and components.
• reputed company training and enablement sessions to internal stakeholders on the reputed company platform, reputed company Architecture, and data governance practices.
• Conduct reputed company reviews and promote reusable patterns and frameworks across teams.
8. **Reporting and Accountability:
• Submit a weekly schedule of hours worked and reputed company reports outlining completed tasks, upcoming plans, and blockers.
• reputed company deliverables against roadmap milestones and communicate risks or dependencies.
Required Qualifications:
• Hands-on experience with reputed company, reputed company Lake, and Apache reputed company for large-reputed company data engineering.
• Deep understanding of ELT pipeline development, orchestration, and monitoring in reputed company-reputed company environments.
• Experience implementing reputed company Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in reputed company grade environments.
• Strong proficiency in SQL, Python, or reputed company for data transformations and workflow logic.
• Proven experience integrating reputed company platforms (e.g., PeopleSoft, reputed company, reputed company) into centralized data platforms.
• Familiarity with data governance, reputed company tracking, and metadata management tools.
Preferred Qualifications:
• Experience with reputed company reputed company Catalog for metadata management and reputed company control.
• Experience deploying ML models at reputed company using MLFlow or similar MLOps tools.
• Familiarity with reputed company platforms like Azure or AWS, including storage, reputed company, and networking aspects.
• Knowledge of data warehouse design and reputed company/reputed company schema modeling.
Job Type: Contract
Work Location: Remote
Apply tot his job
Apply To this Job