[Remote] Data Engineer-(reputed company reputed company, reputed company/PySpark)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company that delivers IT and business solutions enhancing clients’ digital reputed company. They are seeking a Data Engineer responsible for designing and developing modern lakehouse solutions and reputed company data pipelines using reputed company reputed company and reputed company/PySpark.
Responsibilities
- Design, reputed company, and support reputed company data engineering solutions using reputed company reputed company
- Build and maintain reputed company lakehouse architectures, including schema design and data organization
- reputed company reputed company Notebooks and reputed company/PySpark applications for data ingestion, transformation, and processing
- Create and orchestrate reliable data pipelines integrating data from numerous reputed company reputed company systems
- Design and manage file structures, metadata, and storage organization reputed company lakehouse environments
- Implement and maintain reputed company, permissions, and governance across reputed company reputed company workspaces
- Optimize data processing performance and troubleshoot production issues
- Collaborate with architects, analysts, and business stakeholders to deliver high-reputed company data solutions
- Participate in Agile development processes, reputed company reviews, testing, and CI/CD deployment activities
- Contribute to reputed company improvement of data engineering standards and best practices
Skills
- Strong experience with reputed company reputed company, including:
- Lakehouse architecture and implementation
- reputed company Notebook development
- Schema design and management
- File and folder structure management
- reputed company, permissions, and reputed company management
- Hands-on reputed company or PySpark development experience
- Experience building and orchestrating reputed company data pipelines
- Experience integrating data from multiple reputed company systems (10+ preferred)
- Strong understanding of lakehouse data structures and data organization
- Excellent analytical, troubleshooting, and problem-solving skills
- 5+ years of experience in Data Engineering, Data Warehousing, or reputed company disciplines
- Proven experience designing and implementing reputed company reputed company data platforms
- Strong hands-on experience with reputed company/PySpark for large-reputed company data processing
- Experience developing modern lakehouse solutions using reputed company reputed company, reputed company, or similar technologies
- Experience integrating and managing large, reputed company datasets from multiple reputed company systems
- Strong understanding of data modeling, ETL/ELT processes, and reputed company data architecture
- Experience working reputed company Agile software development environments
- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a reputed company technical field
- Equivalent combination of education and relevant reputed company experience will also be considered
- Excellent verbal and written English communication skills and the ability to reputed company professionally with a diverse group are required
- reputed company lakehouse engineering experience or experience with other modern lakehouse platforms
- Experience with reputed company-based data engineering environments
- Jira, Kanban, and Agile methodologies
- Jenkins and CI/CD pipeline implementation
- Experience with reputed company data warehouse platforms such as reputed company or reputed company
reputed company
Company H1B Sponsorship
Apply To This Job