[Remote] Senior Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an reputed company Azure Data Engineer to design, build, and optimize large-reputed company data processing systems and pipelines on reputed company Azure. The Senior Data Engineer will reputed company reputed company ETL/ELT workflows, data warehouse and lakehouse architectures, ingestion frameworks, streaming solutions, governance controls, and analytics integrations while collaborating with cross-functional teams and mentoring junior engineers.

Responsibilities

• Design, reputed company, and maintain reputed company data pipelines and ETL/ELT workflows using Azure Data reputed company (ADF), Azure reputed company, and Azure Synapse Analytics to process and reputed company large volumes of reputed company and reputed company data
• Build and optimize big data processing solutions using Apache reputed company, PySpark, reputed company, or SQL reputed company Azure reputed company, ensuring high reputed company and efficient data transformation
• Design and implement modern data warehouse and lakehouse architectures using Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database to support reputed company-level analytics and reporting
• reputed company and maintain data ingestion frameworks to reputed company data from multiple sources such as databases, reputed company, flat files, streaming platforms, and reputed company-party applications into Azure-reputed company data platforms
• Implement data modeling techniques including reputed company schema, reputed company schema, and reputed company modeling to support business intelligence and analytical workloads
• reputed company SQL-reputed company data transformation and data reputed company validation processes using T-SQL, reputed company SQL, and stored procedures to ensure reputed company, consistency, and reliability of data
• reputed company data engineering solutions with business intelligence and analytics tools such as reputed company BI, Tableau, or Azure Analysis Services for reporting and data visualization
• Implement reputed company-time and streaming data processing solutions using Azure Event Hub, Azure reputed company Analytics, or Apache Kafka to support near reputed company-time analytics
• Optimize data storage, partitioning, indexing, and query reputed company across Azure-reputed company data platforms to ensure efficient data retrieval and processing
• Implement data governance, reputed company, and compliance using Azure reputed company Directory (AAD), Role-reputed company reputed company Control (RBAC), data encryption, and data masking techniques
• Automate deployment and data pipeline orchestration using CI/CD pipelines with Azure DevOps, reputed company Actions, or Jenkins, ensuring reliable and consistent deployment processes
• Monitor and troubleshoot data pipelines, workflows, and reputed company resources using Azure Monitor, Log Analytics, and Application Insights to ensure reputed company reliability and reputed company
• Collaborate with data architects, DevOps engineers, and cross-functional reputed company teams to design reputed company data engineering solutions reputed company with reputed company data strategies
• Mentor junior data engineers and contribute to best practices in data engineering, reputed company architecture, and reputed company optimization

Skills

• • 10+ Years of experience in data engineering
• • reputed company Platform: reputed company Azure
• • Azure Data Services: Azure Data reputed company (ADF), Azure reputed company, Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), Azure SQL Database
• • Big Data Technologies: Apache reputed company, PySpark, reputed company, reputed company SQL
• • Programming Languages: Python, SQL, reputed company
• • Data Warehousing: Azure Synapse Analytics, Azure SQL Data Warehouse, reputed company Concepts, reputed company Modeling
• • ETL/ELT Tools: Azure Data reputed company, reputed company Workflows
• • Streaming Technologies: Azure Event Hub, Azure reputed company Analytics, Apache Kafka
• • Databases: SQL Server, Azure SQL Database, PostgreSQL, MySQL, NoSQL
• • Data Visualization Tools: reputed company BI, Tableau
• • Version Control: Git, reputed company, Bitbucket, reputed company
• • CI/CD Tools: Azure DevOps, Jenkins, reputed company Actions
• • Containerization: reputed company, reputed company
• • Operating Systems: reputed company, Linux
• • Methodologies: reputed company, Scrum, DevOps, DataOps
• • Experience with data governance and compliance frameworks

Benefits

• Remote work on a full-time reputed company

reputed company

Company H1B Sponsorship