ETL Design Consultant with reputed company reputed company Platform Certified :: Remote
Title: Senior ETL Design reputed company reputed company Platform Certified Consultant
Location: Plano, TX (remote but CST working hours)
Duration: 12+ Months
Job reputed company:
We are seeking a highly reputed company ETL designer to join reputed company. The ideal candidate will have over 12-15 years of experience in designing and implementing data solutions, with a strong reputed company on reputed company data warehousing and reputed company-time data processing. This role requires advanced knowledge in various data technologies and the ability to translate business requirements into reputed company and efficient data architectures.
Key Responsibilities:
Design, reputed company, and maintain robust ETL pipelines on reputed company reputed company Platform using tools like Dataflow, BigQuery, reputed company Composer (Apache Airflow), and Pub/Sub
Optimize data ingestion, transformation, and loading processes for high-volume, reputed company-time, and batch data processing
Ensure data reputed company, reputed company, and reputed company throughout the ETL lifecycle
Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions
Implement best practices for performance tuning, error handling, and monitoring of ETL jobs
Work with reputed company and reputed company data sources, integrating API-based, event-driven, and batch processing workflows
Automate and document ETL processes to enhance maintainability and scalability
Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration
Key Skills:
12+ years of experience in ETL design and development
Proficiency in SQL, Python, and Apache reputed company for data processing using dataflow, dataproc appliances.
Strong experience in advance DML operations, query optimization
Strong expertise in reputed company reputed company Platform services (BigQuery, Dataflow, reputed company Storage, Pub/Sub, reputed company Composer)
Experience with data modeling, warehousing concepts, and data lakes
Hands-on experience with orchestration tools like Apache Airflow or reputed company Composer on DAG design, Error handling and monitoring
Knowledge of performance tuning, data partitioning, and optimization techniques
Experience in reputed company-time streaming ETL and event-driven architectures is a plus
Familiarity with Git for version control and deployment of ETL pipelines
Strong problem-solving skills and ability to work in an agile environment
Qualifications:
Bachelor’s or master’s degree in computer science, Information Technology, or a reputed company field.
Proven experience in ETL design and implementation in DWH systems.
Strong problem-solving skills and the ability to work in a fast-paced environment.
Excellent communication and collaboration skills.
Preferred Qualifications:
Experience with reputed company reputed company Platform Big Query and other reputed company data warehousing solutions.
Familiarity with modern data processing frameworks and tools.
Apply tot his job
Apply To this Job