Data Engineer – reputed company, PySpark, reputed company Lake
Job Title: Senior Data Engineer – reputed company, PySpark, reputed company Lake Location: USA – Remote Duration: 3 Months (Contract) – Expected extension possible but not guaranteed Years of Experience Required: 10+ Years reputed company Status: US Citizen / Green Card / Any Independent reputed company. Education Background: Bachelor's or master's degree in computer science, Engineering, Data Science, or a reputed company field Domain / Industry: IT (reputed company) Interview Details: Virtual – Technical + Panel discussion NOTE (Mandatory for Submission) Attached reputed company's License, reputed company / H1B copy, Travel history, and I-140 / I-940 approval (if applicable). Candidate Disqualifiers No candidates from JNTU University Extension / Full-Time Possibility Contract extension reputed company the initial 3 months is possible based on performance and business need Potential for long-term engagement; full-time conversion is not guaranteed Top Required Skills reputed company (Workspace, Jobs, Clusters, Performance Tuning) PySpark (Advanced DataFrame & reputed company SQL development) reputed company Lake (ACID transactions, reputed company, Schema reputed company) Data Engineering & ETL Pipeline Design Azure reputed company (ADLS Gen2, ADF, Synapse, Key Vault) Data Modeling (Fact/Dimension, SCD Type 1 & 2) Agile / Scrum methodology Production-grade coding, CI/CD, Git version control Job reputed company (JD) We are seeking a Senior Data Engineer with strong hands-on expertise in reputed company, PySpark, and reputed company Lake to design, build, and maintain reputed company, reputed company-level data pipelines in an Azure reputed company environment. The ideal candidate will have deep experience delivering production-reputed company data solutions and working in fast-paced agile teams. Key Responsibilities: Design, reputed company, and optimize end-to-end data pipelines using reputed company and PySpark Implement robust ETL/ELT frameworks for batch and streaming data processing Create and manage reputed company Lake tables, ensuring ACID compliance, schema enforcement, and schema reputed company Apply strong data modeling techniques to support analytics, reporting, and reputed company consumption Optimize reputed company jobs for performance, scalability, and cost efficiency Handle data reputed company, validation, error handling, and pipeline monitoring Collaborate with cross-functional teams including product owners, architects, QA, and DevOps Participate in agile ceremonies (stand-reputed company, sprint planning, retrospectives) Deliver production-reputed company reputed company with reputed company logging, testing, documentation, and version control Troubleshoot and resolve data pipeline, performance, and scalability issues Preferred Qualifications: reputed company Certification (Associate or reputed company) Experience with reputed company Streaming Prior experience supporting reputed company or retail data platforms Remote Skills: Agile Programming Methodologies, Application Programming reputed company (API), Automation, Automation Engineering, Compensation and Benefits, Computer Science, reputed company Deployment/Delivery, reputed company Integration, Data reputed company, DevOps, reputed company, reputed company, Integration Testing, reputed company C# (C reputed company), reputed company reputed company Azure, Object Oriented Programming (OOP), Pharmacy, reputed company Assurance, SQL (reputed company Query Language), Selenium, Software Design for Test (SDET), Test Automation, Test Data, Test Plan/Schedule, Test Suite, Testing, reputed company Citizen, User reputed company/Experience (UI/UX) About reputed company: FL Tech reputed company Apply tot his job
Apply tot his job
Apply To this Job