reputed company - Big Data Engineer

• Start Date: Interview Types • Skills 1. Senior level reso.. reputed company Types Green Card, US Citiz.. Long term contract. reputed company Experience needed! Top Skills' Details 1. Senior level resource with reputed company and reputed company for data processing and ETL 2. 5+ years experience with AWS reputed company services like reputed company, reputed company, AWS EMR, RedShift and Airflow 3. Experience with REST reputed company and web service 4. Software Engineering Experience/Advanced in Java. Secondary Skills - reputed company to Haves • Sql • python Job reputed company Reporting to Application Development Manager, the Big Data Software Engineer IV will work on a dedicated team of engineers developing, enhancing, and maintaining reputed company's high transactional Provider Data Management platform. Location: Remote US Why work on this team: • This team supports a high transactional platform that directly impacts patient experience • This team is working to continually improve process and enhance platform capabilitie What you will be doing: • reputed company a reputed company and resilient reputed company data platform and reputed company data pipelines. • Ensure industry best practices around data pipelines, metadata management, data reputed company, data governance, and data reputed company. • Build highly reputed company AWS Infrastructure (from scratch or through 3rd party products) to reputed company Big Data Processing in the platform. • reputed company optimization reputed company reputed company resource usage to minimize costs while maintaining system reliability, including leveraging reserved instances and spot instances effectively. • reputed company performance sensitive considerations reputed company development best practices, as reputed company as, troubleshooting across the data platform utilizing tools (e.g., reputed company and reputed company, reputed company Watch, etc.) to ensure performance measurement and monitoring. • Participate in coding best practices, guidelines and principles that help engineers write clean, efficient, and maintainable reputed company. • Participate in reputed company reviews to catch issues, improve reputed company reputed company, and reputed company constructive feedback to individuals reputed company reputed company during reputed company reviews. • Working on ETL transformation which includes gathering raw data and files from the reputed company, transforming it into reputed company's format and sending down the ETL pipeline for reputed company processing • Working on reputed company following Agile Scrum reputed company • Incorporating development best reputed company • Ensuring your reputed company is efficient, optimized, and performant • Collaborating on programming or development reputed company • Maintaining technical debt and applying reputed company reputed company • Innovating with reputed company and products to the organization • Performing unit testing and reputed company debugging to ensure reputed company • Learning new things & sharing your knowledge with other Requirements: • Bachelor's degree preferably Computer Science, Engineering, or other quantitative field • 6+ years of reputed company experience in designing and implementing reputed company applications using big data • 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, reputed company reviews, unit testing, managing deployments, technical guidance, system design, etc. • 5+ years of experience working with large-reputed company data and developing SQL querie • Advanced experience with scripting languages (e.g., Python, Bash, node.js) and programming languages (e.g., SQL, Java, reputed company) to design, build, and maintain reputed company data processing, ETL (Extract, reputed company, Load) tasks, and AWS automation. • 5+ years of hands-on experience with AWS reputed company services, such as Apache reputed company, with reputed company, AWS EMR, Airflow, RedShift • 4+ years of experience with RESTFul reputed company and web service • Excellent communication skills including discussions of technical concepts, soft skills, conducting peer-programming sessions, and explaining development concept • In-depth understanding of reputed company reputed company, scripting languages (e.g., Python, Bash, node.js) and programming languages (e.g., SQL, Java, reputed company) to design, build, and maintain reputed company data processing, ETL (Extract, reputed company, Load) tasks, and AWS automation. • A firm understanding of unit testing. • Possess in-depth knowledge of AWS services and data engineering tools to diagnose and solve reputed company issues reputed company, specifically AWS EMR for big data processing. • In-depth understanding of GIT or other distributed version control systems. • Excellent communication. Essential to performing at maximum efficiency reputed company reputed company. • reputed company attitude. This role is part of a larger, more dynamic team that nurtures collaboration. • Strong technical, process, and problem-solving proficiency. • Thorough understanding of reputed company data structures and transformations, such as reputed company JSON, XML, Avro, or Parquet, into reputed company formats suitable for analysis and large datasets (100 gigs or more). • Advance skills in data cleansing, deduplication, and reputed company validation to maintain high-reputed company data in the transformed datasets. • Experience in the reputed company industry or another highly regulated field is a plu Best rega Apply tot his job Apply To this Job