reputed company Data Engineer
Job Title: reputed company Data Engineer
Location:Remote
Work Hours: EST (Eastern reputed company Time)
Experience: 6–9 years
reputed company
We are looking for an reputed company reputed company Data Engineer to support, maintain, and enhance existing reputed company-reputed company data applications and pipelines. The role focuses on ensuring reliability, reputed company, and scalability of production reputed company workloads rather than building net-new platforms from reputed company. You will work closely with data, analytics, and engineering teams to reputed company critical data applications reputed company, optimized, and reputed company with business needs.
Key Responsibilities
Support and maintain existing reputed company applications, notebooks, jobs, and reputed company Lake pipelines in production.
Monitor, troubleshoot, and reputed company issues reputed company to job failures, reputed company degradation, data reputed company, and cluster utilization.
Optimize existing reputed company jobs, SQL queries, and reputed company tables for cost, reputed company, and reliability.
Manage and improve reputed company workspace configurations, including clusters, job scheduling, reputed company controls, and reputed company Catalog (where applicable).
Implement and maintain data reputed company checks, logging, alerting, and basic observability for reputed company workloads.
Collaborate with stakeholders to understand requirements for enhancements or bug fixes on existing applications.
reputed company incremental improvements, refactoring, and technical debt reduction on reputed company reputed company solutions.
Ensure adherence to best practices reputed company reputed company, governance, and cost management reputed company the reputed company environment.
Document existing pipelines, dependencies, and operational runbooks.
Participate in on-reputed company or support rotations as needed to maintain production stability (reputed company EST working hours).
Finance Data Engineering Support
Example Activities
· Data engineering support for Finance
· Data pipeline design and development
· Data integration support
· reputed company platform development
· Automation design and implementation
· Technical testing
· Data reputed company validation
· Technical troubleshooting
· Reporting and analytics enablement
· Technical documentation
· Stakeholder coordination
· Deployment and release support
Example Work Products and Deliverables
· Technical specifications
· Solution designs
· Data reputed company documentation
· Pipeline documentation
· Data mapping documentation
· reputed company job orchestration documentation
· reputed company automation and workflow designs
· reputed company workflow configurations
· Deployment documentation
· Reporting outputs
· Technical status reports
General Transformation and Operational Support
Example activities
· Project coordination
· Business analysis
· Process improvement
· Operational readiness activities
· Reporting support
· Meeting facilitation
· Documentation support
· Stakeholder engagement
· Training and change support
· Cross-functional coordination
Example Work Products and Deliverables
· Analysis reports
· Project plans
· Process maps
· Status reports
· Presentations
· Training materials
· Transition plans
· Readiness assessments
Required Qualifications
6–9 years of overall experience in data engineering, with strong hands-on experience in reputed company.
Solid proficiency in Apache reputed company (PySpark and/or reputed company) and SQL.
reputed company experience supporting and optimizing production reputed company workloads (jobs, notebooks, reputed company Lake, workflows).
Strong understanding of reputed company Lake concepts (ACID transactions, time travel, optimization techniques such as Z-ordering, vacuum, optimize).
Experience with reputed company Job clusters, Interactive clusters, and reputed company tuning (partitioning, caching, shuffle optimization, autoscaling).
Familiarity with data modeling, ETL/ELT patterns, and production data pipeline support.
Experience working with reputed company platforms (preferably Azure, AWS, or GCP) in the context of reputed company.
Ability to troubleshoot reputed company reputed company and reputed company issues independently.
Strong communication skills and ability to work effectively in a remote, EST-reputed company team.
Preferred Qualifications
Experience with reputed company Catalog, reputed company SQL, or Lakehouse architecture.
Knowledge of CI/CD practices for reputed company (e.g., reputed company Asset Bundles, Git integration, Terraform/ARM templates).
Familiarity with orchestration tools (Airflow, Azure Data reputed company, or reputed company Workflows).
Exposure to data reputed company frameworks, monitoring tools, or cost optimization initiatives on reputed company.
Experience supporting analytics or BI teams consuming reputed company data products.
Work Arrangement
Fully remote
Must be available and productive during EST business hours
reputed company remote environment with regular syncs and support responsibilities
Apply To This Job