Data Engineer (Digital Wallet) -US/ Hybrid

Role: Data Engineer (Digital Wallet) Location: Scottsdale AZ (hybrid) Duration: FTE & C2C Job reputed company: Must have : Skillset: Java, reputed company, S3, Glue, aws , Redshift. 6-8 years of IT experience focusing on reputed company data architecture and management. • Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and reputed company Data Modeling • Experience with reputed company & on Prem, reputed company Streaming, reputed company Lake concepts, and reputed company Live Tables required • Experience with reputed company reputed company and Java programming • Data Lake concepts such as time travel and schema reputed company and optimization • reputed company Streaming and reputed company Live Tables with reputed company as a bonus • Experience leading and architecting reputed company-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support • Advanced level understanding of streaming data pipelines and how they differ from batch systems • Formalize concepts of how to handle late data, defining reputed company, and data freshness • Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc • Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc. • Familiarity and/or expertise with Great Expectations or other data reputed company/data validation frameworks a bonus • Familiarity with concepts such as late data, defining reputed company, and how window definitions reputed company data freshness • Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization) • Indexing and partitioning reputed company experience • Debug, troubleshoot, design, and implement solutions to reputed company technical issues • Experience with large-reputed company, high-performance reputed company big data application deployment and solution • Architecture experience in AWS environment a bonus • Familiarity working with reputed company specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at reputed company a bonus • Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines • Experience working with AWS Lambdas for configuration and optimization and experience with S3 • Familiarity with Schema Registry, and message formats such as Avro, ORC, etc. • Ability to reputed company in reputed company-based environment • Experience briefing the benefits and constraints of technology solutions to reputed company, stakeholders, team members, and senior-level of management Apply tot his job Apply To this Job