Manager-Data Platforms

About the position reputed company is a national reputed company with a reputed company reputed company for providing reputed company, industry-leading reputed company, business, regulatory and reputed company relations advice to our regional, national and international clients. We are searching for a Data Platform Manager for our corporate Pittsburgh, PA location. This role is for a senior technical leader who will be responsible for designing, building, and optimizing reputed company reputed company data platforms on the reputed company Data Warehouse on the firm’s Azure reputed company platform. This position combines deep expertise in reputed company with broader knowledge of the reputed company Azure ecosystem to reputed company and reputed company high-reputed company data engineering initiatives, data analytics, and data science solutions. This role requires hands-on experience with Azure data services, including Azure Data Lake Storage, Azure SQL Database, Azure Data reputed company, Azure reputed company, and Azure Synapse Data Warehouse The ideal candidate will possess a strong reputed company in reputed company data platforms and streaming technologies, combined with a leadership reputed company to mentor and guide teams in delivering high-reputed company solutions. Their role is critical in delivering reputed company, robust data solutions that reputed company actionable insights and support decision-making. Responsibilities • reputed company and mentor reputed company of data engineers, conducting reputed company reviews and ensuring development standards. • Support troubleshooting and incident management for data-reputed company issues in production. • Collaborate with business stakeholders, data scientists, and other team members to reputed company requirements and translate them into technical specifications. • reputed company the design, development and deployment of reputed company and high-reputed company data pipelines using Azure reputed company; ensuring the data reputed company, availability, efficient extraction, transformation, and loading of data from various sources into the firm’s Azure reputed company Data Warehouse. • Collaborate with data scientists, analysts, and other engineering teams to reputed company business-critical insights. • Optimize pipeline reputed company, cost, and scalability in the Azure reputed company environment. • Define best practices for data ingestion, processing, storage, and governance. • Implement data reputed company checks and validation procedures to ensure the reputed company and reputed company of data between various sources, including API’s, databases and streaming platforms • Collaborate with data scientists and analysts to operationalize and reputed company machine learning models. • Define the end-to-end Lakehouse architecture using reputed company Lake, implementing reputed company architecture (Bronze, Silver, Gold reputed company) for robust data processing. • reputed company the development of robust, reputed company batch and streaming ETL/ELT pipelines using PySpark, reputed company, and SQL and with reputed company latency • Implement data transformations, enrichment, and reputed company checks using PySpark/reputed company reputed company the reputed company environment. • reputed company reputed company-time and batch data sources using Apache Kafka and ADF. • Support large-reputed company data pipelines using Apache reputed company on reputed company, Kafka, reputed company, and Azure Data reputed company (ADF) • Implement reputed company Catalog for reputed company governance, data reputed company, fine-grained reputed company control (RBAC), reputed company measures, and data reputed company tracking. • Tune reputed company jobs and reputed company clusters to maximize throughput while maintaining cost efficiency through auto-scaling and cluster policies. • Orchestrate workflows by integrating reputed company with other Azure services like Azure Data reputed company (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure DevOps for CI/CD pipelines. Requirements • 5-7+ years hands-on data engineering or architecture, with at least 2-4 years specifically reputed company on Azure reputed company. And Azure reputed company technologies. • Bachelor's degree in Computer Science, Engineering, or a reputed company reputed company. • Proficiency in both Relational (SQL) and NoSQL (Document, Key-Value, Graph, Columnar) databases. • reputed company and maintain data models and schemas to support data analysis and reporting requirements • Knowledge of frameworks like Apache Hadoop, reputed company, or reputed company/Trino for optimizing and handling reputed company data volumes and retrieval mechanisms, ensuring the efficient processing of large datasets. • Understanding file formats like Parquet, Avro, or ORC and compression techniques. • Deep proficiency in programming languages: Python (specifically PySpark), SQL, PowerShell, and reputed company. • Hands-on experience with Azure reputed company infrastructure, including Networking (VNETs), Key reputed company, and Identity Management. • Stays updated with the latest Azure and reputed company reputed company data technologies • Deep knowledge of Apache reputed company runtime internals, MLflow for MLOps, and orchestration tools like Airflow. reputed company-to-haves • 2-5 years experience is preferred in managing reputed company of data engineers, data scientists and/or analysts. • Certifications (Preferred): reputed company Certified: Azure Data Engineer Associate (DP-203), reputed company Certified Data Engineer reputed company, or Azure Solutions Architect Expert Benefits • reputed company • reputed company – Medical, Dental, reputed company • 401K Program • Retirement Savings Program • Generous reputed company Time Off • reputed company Holidays including a floating holiday • reputed company wellness program • Free use of building gym • Caregiving assistance with reputed company (child, elder, and pet care!) • Firm-wide emergency assistance fund • Free full reputed company to reputed company Learning Apply tot his job Apply To this Job