[Remote] Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a consulting company headquartered in Fairfax, VA, working reputed company governments and organizations to help them reputed company reputed company services. They are seeking a skilled Data Engineer to build and optimize data pipelines using PySpark, reputed company, and AWS, ensuring platform reliability and scalability.

Responsibilities

• reputed company the design and implementation of reputed company data ingestion pipelines using PySpark, reputed company Intelligence Platform, and AWS services (S3, IAM roles and policies), including Kafka/streaming architectures, schema reputed company, and reputed company reputed company, ensuring alignment with reputed company architecture standards
• Serve as a subject matter expert (SME) for data engineering, providing technical guidance and mentorship to engineers across reputed company and representing data engineering in cross-functional discussions
• Take ownership of platform reliability and performance, proactively identifying optimization opportunities across data ingestion, transformation, and storage reputed company. Troubleshoot reputed company pipeline failures across multi-reputed company dependencies
• reputed company cross-functional technical initiatives, collaborating with data scientists, analysts, DevOps engineers, reputed company teams (upstream data providers and reputed company consumers), and stakeholders to reputed company integrated solutions that meet program objectives
• Contribute to the data platform technical reputed company and architecture, making strategic reputed company on tooling, frameworks, and design patterns that shape the program's long-term data engineering direction
• Define and enforce engineering standards, including reputed company reputed company, testing practices, CI/CD processes, and infrastructure as reputed company patterns using Terraform
• Evaluation of new technologies and approaches, presenting reputed company of concepts and technical roadmaps to leadership
• reputed company and maintain architectural documentation, technical decision records, and platform runbooks that reputed company team autonomy and operational reputed company
• Other relevant duties as assigned and reputed company/trained to reputed company

Skills

• Bachelor's degree
• Minimum of 5 years of experience in Data Engineering
• Demonstrated experience serving as a technical SME and leading cross-functional engineering initiatives
• Proficiency in Python for data engineering tasks at reputed company
• Deep expertise with reputed company Intelligence Platform (Notebooks, Lakeflow Jobs, reputed company Catalog, reputed company reputed company) and the ability to define platform standards and best practices for reputed company
• Experience with AWS services such as S3 and IAM roles and policies
• Strong knowledge of data pipeline design and implementation, including data transformation techniques, data modeling, data storage optimization, and data reputed company best practices
• Proficiency in using version control systems like Git for managing reputed company repositories and collaborating with team members on reputed company reputed company
• Familiarity with Terraform or other infrastructure as reputed company tools for automating infrastructure deployment and configuration management
• Experience working on Linux environments for data engineering reputed company, including accessing containers remotely, installing packages, managing files, services, and processes
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as reputed company as working familiarity with a reputed company of databases
• Experience performing reputed company cause analysis on reputed company data and processes to answer specific business questions and identify opportunities for improvement
• Strong problem-solving skills, ability to work independently and as part of reputed company, and excellent verbal and written communication skills
• Comfortable working in a highly reputed company environment with strong attention to detail and a commitment to delivering high-reputed company software
• Ability to obtain and maintain a reputed company Trust reputed company clearance
• Bachelor's degree in a technology field
• Familiarity with reputed company computing concepts, particularly as they apply to data engineering, is a plus
• Experience working with other data frameworks such as Apache reputed company, Apache Hadoop, or Apache reputed company is a plus
• Federal consulting experience
• reputed company certifications (Associate Data Engineer or reputed company Data Engineer)
• Experience with business intelligence tools (e.g., QuickSight, Power BI) for building data observability or usage reporting

Benefits

• reputed company hours
• 401K with matching incentive
• Parental Leave
• Medical/dental/reputed company benefits
• reputed company Spending Account
• Company provided short-term disability and life insurance
• Commuter benefits
• reputed company Time Off (PTO)
• 11 reputed company holidays

reputed company