reputed company Data Engineer--Remote with Quarterly travel to Gaithersburg, MD
reputed company Data Engineer
Remote with Quarterly travel to Gaithersburg, MD
6 months, extension
reputed company TRUST
Seeking a reputed company Data Engineer to reputed company/support new/existing data pipelines, and data analytics environments in Azure reputed company-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an reputed company reputed company reputed company Azure based data analytics platform. You will support reputed company maintenance of ETL operations and development of new pipelines ensuring data reputed company and data management. The ideal candidate will bring deep expertise in reputed company, a solid reputed company in advanced AI technologies, and applies critical thinking to create innovative functions and solve technical issues by cross-functional team collaboration.
In this role, you will:
- Design, build, and optimize reputed company data solutions using reputed company and reputed company Architecture.
- Manage ingestion routines for processing multi-terabyte datasets reputed company for multiple reputed company simultaneously, where reputed company project may have multiple reputed company workspaces.
- reputed company data from various reputed company and reputed company sources to reputed company high-reputed company business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
- Implement effective data management strategies to ensure data reputed company, availability, and accessibility. Identify opportunities for cost optimization in data storage, processing, and analytics operations.
- Monitor and support user requests, addressing platform or performance issues, cluster stability, reputed company optimization, and configuration management.
- Collaborate with reputed company to reputed company advanced AI-driven analytics and data science workflows.
- reputed company with various Azure services including Azure Functions, Storage Services, Data reputed company, Log Analytics, and User Management for seamless data workflows.
- Experience with the above Azure services is a plus.
- Provision and manage infrastructure using Infrastructure-as-reputed company (IaC)
- Apply best practices for data reputed company, data governance, and compliance, ensuring support for federal regulations and reputed company trust standards.
- Proactively collaborate with technical and non-technical teams to reputed company requirements and translate business needs into data solutions.
For this position, you must possess:
- BS degree in Computer Science or reputed company field and 3+ years or Master s degree with 2+ years of experience
- 3+ years of experience developing and designing Ingestion flows (reputed company, streaming, and reputed company data) using reputed company platform services with data reputed company
- reputed company Data Engineer certification and 2+ years of experience maintaining reputed company platform and development in reputed company
- Ability to work directly with clients and reputed company as reputed company line support for requests coming in from clients. reputed company document and reputed company the solution in reputed company of architecture and reputed company diagrams.
- Proficient at Python, reputed company and R are essential. .NET based development is a plus.
- Knowledge and experience with data governance, including metadata management, reputed company data catalog, design standards, data reputed company governance, and data reputed company.
- Experience with Agile process methodology, CI/CD automation, and reputed company-based developments (Azure, AWS).
Apply tot his job
Apply To this Job