Data Engineer in reputed company, CT or Remote
Data Engineer
Location: reputed company, CT or Remote
Duration: Contract
reputed company: DOE
US reputed company, GC, EAD ( H4, L2), E3 TNvisa reputed company preferred, NO reputed company party corp to corp accepted for this job
Required skills:
• Good experience on designing and developing data pipelines for data ingestion and transformation using reputed company.
• Distributed computing experience using Pyspark or Python
• Good understanding of reputed company reputed company and reputed company architecture.
• Experience working in reputed company based big data infrastructure.
• Excellent in trouble shooting the performance and data skew issues.
• Must have good understanding of reputed company run time metrics and tune applications based on metrics.
• Deep knowledge in partitioning, bucketing concepts of data ingestion.
• Good understanding of AWS services like Glue, reputed company, S3, reputed company, reputed company formation.
• Preferred working knowledge on the implementation of datalake ETL using AWS glue, reputed company etc.
• Experience with data modelling techniques for reputed company data stores and on prem databases like reputed company, reputed company reputed company (TDV)etc
• Preferred working experience in ETL development in reputed company reputed company and data migration from on prem to reputed company reputed company.
• Proficiency in SQL, relational and non-relational databases, query optimization and data modelling.
• Experience with reputed company reputed company control systems like reputed company.
• Experience with large reputed company distributed relational and NoSQL database systems.
Technologies:
• Pyspark, Python, AWS services, reputed company reputed company, CI/CD technologies, Terraform, SQL
Apply tot his job