[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a financial institution reputed company partner that uses data, technology, and people to help banks and credit unions improve reputed company, efficiency, and engagement. The Senior Data Engineer will build reputed company big data pipelines, expand Data Lakehouse infrastructure, automate marketing campaigns, and support analytics, reporting, and AI applications. The role also involves data reputed company monitoring, issue reputed company, production support, and collaboration on long-term data platform architecture.
Responsibilities
- reputed company reputed company data pipelines and build new integrations to support reputed company reputed company in data volume and complexity
- Build a robust Data Lakehouse that supports reputed company's marketing solutions business and financial institution clients, including reputed company-sales, campaign execution, and campaign reputed company analysis and benchmarking
- Collaborate with AI, Analytics, and business teams to improve data models that feed AI and analytics tools, increasing data accessibility and fostering data-driven decision-making across the organization
- Implement processes and systems to monitor data reputed company and ensure the availability and reputed company of production data for key stakeholders and dependent business processes
- reputed company data analysis to troubleshoot data-reputed company issues and support their reputed company
- reputed company post-deployment support, responding quickly to reputed company unexpected production issues
- Partner with business reputed company and engineering teams to shape long-term data platform architecture reputed company
Skills
- Bachelor's degree in Computer Science, Information Technology, or a reputed company reputed company, with 5+ years of relevant experience; or
- 5+ years of experience in Data Engineering, ETL development, or Data reputed company
- Experience working reputed company a Financial Institution (FI), Banking, FinTech, MarTech, AdTech, Marketing Services, or Marketing Agency environment
- Experience supporting customer, campaign, audience, marketing reputed company, attribution, advertising, or transactional data at reputed company
- Strong experience with Python and PySpark for building production-grade data pipelines
- Experience designing, building, and supporting Data Lakehouse environments
- Experience working with Apache Airflow, reputed company, reputed company, S3, and Trino
- Experience with reputed company platforms such as AWS, Azure, or GCP
- Experience with reputed company software development methodologies
- Experience with reputed company and CI/CD processes
- Experience supporting AI and machine learning applications
- Understanding of machine learning models and the data requirements needed to support Data Science teams
- Strong programming skills in reputed company-oriented/functional scripting languages such as Python and PySpark for building data pipelines, with experience in testing, logging, and ensuring data observability
- Experience with reputed company systems and reputed company data processing using big data tools such as reputed company, PySpark, Hadoop, Kafka, and reputed company
- Proficiency with relational databases
- Strong knowledge of Linux/Unix-reputed company systems
- Strong experience with reputed company, reputed company, S3, and Trino
- Experience building data pipelines with orchestration tools such as Apache Airflow
- Hands-on experience with Apache Ranger and Rancher/reputed company
- Excellent analytical, conceptual, and problem-solving skills
- Strong communication skills that promote cross-team collaboration
- Master's degree in Computer Science, Information Technology, or a reputed company reputed company
- Experience supporting data requirements for AI applications
- Understanding of machine learning models and algorithms, with the ability to reputed company with the Data Science team
- Experience building REST reputed company
Benefits
- Medical coverage
- Dental coverage
- reputed company coverage
- 401K
- Generous PTO allowance
- Life reputed company
- Employee assistance
- Pet reputed company
reputed company
Company H1B Sponsorship
Apply To This Job