Sr. Data Engineer - Scala, Spark, Python, Big Data
Mandatory SkillsScala, Spark, Python and Big Data.Job Description:10+ Years of Overall IT experience.3+ Years experience - Scala5+ Years of experience - AWS (all services needed for Big Data pipelines like S3 , EMR , SNS/SQS , Event bridge, Lambda , CloudWatch , MSK , Glue , Container services etc.) . Spark . Scala, Hadoop3+ Years of experience - Python . Shell scripting, Orchestration (Airflow or MWAA preferred) . SQL . CI/CD (Git preferred and experience with Deployment pipelines) , Devops (including supporting production stack and working with SRE teams)3+ Years of experience - Architecture and Design of cloud based Big Data pipelines.2+ Years of experience - Infrastructure as code (Terraform preferred)2+ Years of experience - Spark streaming, Healthcare Domain & Data Standards.Scrum team leadership experienceNice to Have - Azure , Big Data and/or Cloud certifications.
Apply tot his job
Apply To this Job