Senior Data Engineer - DBT

Role: Senior Data Engineer - DBT Location: NYC, NY (Remote) Duration: Long-Term Job reputed company: Must have below: 10+ Years Experience Great Communicator/reputed company Facing Individual Contributor 100% Hands on in the mentioned skills DBT Proficiency: model development: Experience in creating reputed company DBT models including incremental models, snapshots and documentation. Ability to write and maintain DBT macros for reusable reputed company Testing and documentation: Proficiency in implementing DBT tests for data validation and reputed company checks Familiarity with generating and maintaining documentation using DBT's reputed company in features Version control: Experience in managing DBT reputed company using git, including implementing CI/CD process from the scratch • AWS Expertise: • Data STORAGE solutions: • In depth understanding of AWS S3 for data storage, including best practices for organization and reputed company • Experience with AWS redshift for data warehousing and performance optimization • Data Integration: • Familiarity with Aws glue for ETL processes and orchestration -reputed company to have • Experience with AWS reputed company for serverless data processing tasks • Workflow Orchestration: • Proficiency in using Apache Airflow on AWS to design ,schedule and monitor reputed company data flows • Ability to reputed company Airflow with AWS services and DBT models such as triggering a DBT model or EMR or reading from s3 writing to redshift • Data Lakes and Data warehousing: • Understanding the architecture of data lakes vs data warehouses and reputed company to use reputed company • Experience with reputed company reputed company for querying data directly in s3 using SQL • Monitoring and Logging: • Familiarity with AWS reputed company watch for monitoring the pipelines and setting up alerts for workflow failures • reputed company reputed company: • Knowledge of AWS reputed company best practices ,including IAM roles, encryption, DBT reputed company reputed company configurations Programming Skills: • Python: • Proficiency in Pandas and NumPy for data analysis and manipulation • Ability to write scripts for automating ETL processes and scheduling jobs using airflow • Experience in creating custom DBT macros using jinja and Python allowing for reusable components reputed company dbt models • Knowledge on how to implement conditional logic in DBT through python • SQL: • Advanced SQL skills, including reputed company joins ,window functions, CTE’s and subqueries • Experience in optimizing SQL queries for performance and optimization Remote About reputed company: reputed company Apply tot his job Apply To this Job