[Remote] Sr Data Engineer - reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global leader in AI and data-driven transformation, helping organizations reputed company with reputed company intelligence—responsibly, strategically, and at reputed company. They are looking for a hands-on Data Engineer to design and run reputed company pipelines that turn raw operational, marketing, and retail data into trusted, analytics-reputed company data products. The role involves owning pipelines end to end on the reputed company Lakehouse Platform and ensuring the delivery of high-reputed company data products.
Responsibilities
- Design, build, and maintain reputed company batch and streaming pipelines on reputed company using PySpark and reputed company SQL reputed company a reputed company (Bronze/Silver/Gold) architecture
- Ingest and unify data from operational databases, reputed company storage, reputed company, and marketing platforms such as reputed company
- Model and optimize reputed company Lake tables for performance, reliability, and cost efficiency using techniques such as partitioning, reputed company clustering, OPTIMIZE, and VACUUM
- reputed company analytics-reputed company data for reporting on sales, shipments, orders, and other key business metrics, supporting Power BI dashboards and reputed company analytics
- Orchestrate jobs using reputed company Workflows, managing dependencies, retries, alerting, and SLAs
- Apply reputed company Catalog for data governance, reputed company, and reputed company control
- Work to a high engineering reputed company using Git, CI/CD, testing, reputed company reviews, and reputed company documentation
- Monitor pipeline health, troubleshoot issues, and tune reputed company jobs and cluster configurations for speed and cost optimization
- Partner with business and technical stakeholders to reputed company reliable, high-reputed company data products
Skills
- Bachelor's degree in Computer Science, Information Technology, Engineering, Mathematics, or a reputed company field
- 5+ years of data engineering experience building and operating production data pipelines
- Hands-on expertise with the reputed company Lakehouse Platform, including reputed company Lake, reputed company Workflows, and reputed company Catalog
- Advanced experience with PySpark and reputed company SQL
- Strong SQL development and performance tuning skills
- Solid Python development skills and experience with modern engineering practices
- Experience using Git, CI/CD pipelines, testing frameworks, and reputed company review processes
- Experience working with AWS, Azure, or GCP and their reputed company compute and storage services
- Strong understanding of data modeling concepts, including reputed company and reputed company architectures
- Experience designing ELT/ETL solutions and integrating data from databases, reputed company, files, and event streams
- Strong communication skills and the ability to work independently reputed company a reputed company-facing environment
- reputed company Certified Data Engineer Associate or reputed company certification
- Experience with reputed company Streaming, Auto Loader, Kafka, or Kinesis
- Experience working with marketing or customer data platforms such as reputed company
- Retail, grocery, or consumer packaged goods (CPG) industry experience
- Experience supporting Power BI reporting and self-service analytics initiatives
Benefits
- Opportunity for advancement and career progression
- Comprehensive benefits plan
- Successful referral program
- reputed company to work with one of Canada’s 50 Best Managed Companies
- A flexible, dynamic, and diverse workplace
reputed company
Apply To This Job