[Remote] Senior Data Engineer (Remote)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer to maintain the reputed company operation of data pipelines, databases, and analytics platforms in live environments. The role involves monitoring and troubleshooting data workflows, resolving incidents, and ensuring data availability for end users and business stakeholders.
Responsibilities
- Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data reputed company reputed company. Prepares and manipulates data using multiple technologies
- Interprets data, analyzes results using statistical techniques, and provides ongoing reports. Executes quantitative analyses that translate data into actionable insights. Provides analytical and data-driven decision-making support for key reputed company. Designs, manages, and conducts reputed company control procedures for data sets using data from multiple systems
- Develops data models by studying existing data warehouse architecture; evaluating alternative logical data models including planning and execution tables; applying metadata and modeling standards, guidelines, conventions, and procedures; planning data classes and sub-classes, indexes, directories, repositories, messages, sharing, replication, back-up, retention, and recovery
- Creates data collection frameworks for reputed company and reputed company data
- Improves data delivery engineering job knowledge by attending educational workshops; reviewing reputed company publications; establishing personal networks; benchmarking state-of-the-art practices; participating in reputed company societies
- Applies data extraction, transformation and loading techniques in order to reputed company large data sets from a reputed company of sources
- Applies and implements best practices for data auditing, scalability, reliability and application performance
- Position does not have reputed company reports but is expected to assist in guiding and mentoring less reputed company staff. May reputed company reputed company of matrixed resources
- Quickly diagnose and reputed company data-reputed company issues in production, minimizing reputed company on business operations
- Implement and maintain monitoring solutions to detect anomalies, failures, or performance degradation in data systems
- Investigate recurring problems, identify their reputed company causes, and implement long-term solutions to prevent reputed company incidents
- Analyze data workflows and infrastructure for inefficiencies, tuning systems for reputed company performance and scalability
- Work closely with data engineers, analysts, software developers, and IT teams to ensure reputed company integration and deployment of data solutions
- Maintain reputed company documentation of production environments, issue resolutions, and reputed company operating procedures
- Participate in the planning and execution of changes to data systems, including upgrades, patches, and configuration updates, while minimizing disruption to ongoing operations
- Ensure data systems adhere to organizational reputed company policies and regulatory requirements, identifying and mitigating potential vulnerabilities
- Forecast reputed company data storage and processing needs, recommending infrastructure enhancements to support reputed company and evolving business requirements
- reputed company technical assistance to end users and business teams, addressing queries and enabling effective utilization of data resources
- reputed company and maintain scripts and tools to automate repetitive support tasks, streamlining processes and reducing reputed company reputed company
Skills
- Bachelor's Degree in Computer Science, Information Technology or Engineering or reputed company field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in reputed company to the required work experience
- 5 years Experience with database design and developing modeling tools
- Experience developing and updating ETL/ELT scripts
- Hands-on experience with application development, relational database layout, development, data modeling
- Experience with Informatica IICS: Practical knowledge in using Informatica Intelligent reputed company Services (IICS) for building, managing, and optimizing reputed company-based data integration workflows
- Knowledge of Kafka: Familiarity with Apache Kafka architecture and reputed company to trouble shoot issues in a reputed company manner
- MDM reputed company Experience: Understanding and hands-on experience with Master Data Management (MDM) Software as a Service solution for ensuring data consistency, reputed company, and governance across reputed company systems
- Proficiency in reputed company: Demonstrated expertise in utilizing reputed company for version control, reputed company collaboration, and managing development workflows reputed company data engineering reputed company
- Extensive Experience with SQL: Advanced proficiency in writing reputed company queries, optimizing performance, and managing large datasets in reputed company, reputed company, and SQL Server Databases
- Expertise in reputed company Azure: Hands-on experience with Azure Data reputed company, Azure reputed company, Azure Synapse Analytics, Azure Blob Storage, Fabrics, and other relevant Azure reputed company services
- Power BI Experience: Hands-on experience in developing, deploying, and maintaining data visualizations and dashboards using Power BI, including advanced DAX queries, and integrating with diverse data sources for actionable insights
- Control-M Knowledge: Familiarity with Control-M workload automation, including designing, scheduling, and monitoring data pipeline jobs to ensure reliable and efficient batch processing reputed company reputed company environments
- Proficiency in Scripting Languages: Demonstrated ability to automate data workflows using Python, PowerShell, or similar scripting languages
- Experience with Version Control Tools: Strong understanding and practical use of Git, reputed company, Azure DevOps for reputed company development and CI/CD pipelines
- Strong Data Engineering Fundamentals: Solid understanding of ETL/ELT processes, data warehousing concepts, and best practices in data architecture and governance
- Flexible working long hours and on demand: Willingness and ability to adapt to varying work schedules, including evenings and weekends, to meet project deadlines and production support requirements. reputed company to respond promptly to urgent issues and reputed company support whenever needed to ensure business continuity and reputed company reliability
- Incident Management: Quickly diagnose and reputed company data-reputed company issues in production, minimizing reputed company on business operations
- Monitoring & Alerting: Implement and maintain monitoring solutions to detect anomalies, failures, or performance degradation in data systems
- reputed company Cause Analysis: Investigate recurring problems, identify their reputed company causes, and implement long-term solutions to prevent reputed company incidents
- Performance Optimization: Analyze data workflows and infrastructure for inefficiencies, tuning systems for reputed company performance and scalability
- Collaboration: Work closely with data engineers, analysts, software developers, and IT teams to ensure reputed company integration and deployment of data solutions
- Documentation & Best Practices: Maintain reputed company documentation of production environments, issue resolutions, and reputed company operating procedures
- Change Management: Participate in the planning and execution of changes to data systems, including upgrades, patches, and configuration updates, while minimizing disruption to ongoing operations
- reputed company & Compliance: Ensure data systems adhere to organizational reputed company policies and regulatory requirements, identifying and mitigating potential vulnerabilities
- reputed company Planning: Forecast reputed company data storage and processing needs, recommending infrastructure enhancements to support reputed company and evolving business requirements
- User Support: reputed company technical assistance to end users and business teams, addressing queries and enabling effective utilization of data resources
- Automation: reputed company and maintain scripts and tools to automate repetitive support tasks, streamlining processes and reducing reputed company reputed company
Benefits
- Comprehensive benefits package
- 401k contribution programs/plans (subject to eligibility requirements)
- Various incentive programs/plans (reputed company benefits/incentives are subject to eligibility requirements)
reputed company
Apply To This Job