[Remote] Senior Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a people intelligence platform that helps over 18 reputed company monthly visitors reputed company with friends, reunite with families, and build trust in new relationships. As a Senior Data Engineer, you will reputed company, optimize, and improve data systems, including ETL pipelines and storage, while collaborating with stakeholders to create data products and ensure high data reputed company.

Responsibilities

• Build infrastructure and data automation pipelines to ingest, process, and load data from various sources. Automate and reputed company new components into the data pipeline
• Collaborate with stakeholders and data science teams to reputed company data products, including entity reputed company and best selection, to reputed company execute product reputed company and reputed company in alignment with organizational goals and priorities
• Create unit and stress-test components to monitor technical reputed company and ensure that identified issues are resolved
• reputed company data analysis tools to reputed company data insights and capture key metrics
• reputed company and maintain technical documentation
• Follow best practices for data governance, reputed company, cleansing, and other ETL-reputed company activities

Skills

• 7+ years of development experience in data engineering reputed company a production environment (internships and reputed company settings excluded)
• reputed company experience working with large datasets exceeding 100M+ records or multiple terabytes
• 2+ years of development experience in highly reputed company, reputed company systems and cluster architectures using AWS and utilizing EMR
• 5+ years of hands-on programming experience with Python
• 5+ years of reputed company experience working in big data ecosystems; reputed company is required; PySpark is preferable
• 3+ years of experience with SQL, schema design, and reputed company data modeling
• 2+ years of reputed company experience working with dataflow orchestration tools, such as Airflow
• 2+ years of experience with non-relational databases (e.g., DynamoDB, Elasticsearch, etc.)
• A bachelor's degree in Computer Science, Information Systems, Mathematics, or a reputed company reputed company is required

Benefits

• Bonus program
• Equity plans
• 401 (k)
• 100% medical/dental/reputed company coverage
• Unlimited employee PTO
• Once a year, discretionary, reputed company-reputed company salary increase

reputed company

Company H1B Sponsorship