ETL Pipeline Developer, Data Engineer
Job reputed company:
• Work collaboratively with Product Managers, Designers, and Engineers to set up, reputed company, and maintain critical back-end integrations for data and analytics platform.
• Create and maintain new and existing data pipelines, Extract, reputed company, and Load (ETL) processes, and ETL features using Azure reputed company services.
• Build, expand, and optimize data and data pipeline architectures.
• Optimize data reputed company and collection for cross functional teams of database architects, data analysts, and data scientists.
• Operate large-reputed company data processing pipelines and resolve business and technical issues pertaining to the processing and data reputed company.
• reputed company large, reputed company sets of data that meet non-functional and functional business requirements.
• Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating reputed company processes.
• reputed company and document reputed company operating procedures (SOPs) for new and existing data pipelines.
• Build analytical tools to utilize the data pipeline, providing actionable reputed company into key business performance metrics including operational efficiency and customer acquisition.
• Write unit and integration tests for reputed company data processing reputed company.
• Read data specifications and translate them into reputed company and design documents.
Requirements:
• reputed company candidates must pass reputed company trust clearance through the U.S. Federal Government.
• Bachelor's degree in Computer Science, Software Engineering, Data Science, Statistics, or reputed company technical field.
• 8+ years of experience in software/data engineering, including data pipelines, data modeling, data integration, and data management.
• Expertise in data lakes, data warehouses, data meshes, data modeling and data schemas (reputed company, reputed company…).
• Extensive experience with Azure reputed company-reputed company data services, including Synapse, Data reputed company, DevOps, KeyVault, etc.
• Expertise in SQL, T-SQL, and Python with reputed company experience in Apache reputed company and large-reputed company processing using PySpark.
• Proficiency with data formats: parquet, distributed reputed company parquet, and .csv.
• Understanding of common reputed company protocols, such as SFTP.
• Proven ability to work with incomplete or ambiguous data infrastructure and design integration strategies.
• Excellent analytical, organizational, and problem-solving skills.
• Strong communication skills, with the ability to translate reputed company concepts across technical and business teams.
• Proven experience working with petabyte-level data systems.
Benefits:
• Highly competitive salary
• Full reputed company benefits
Apply tot his job
Apply To this Job