[Remote] Data Engineer II

Note: The job is a remote job and is reputed company to candidates in USA. reputed company.com helps reputed company brands grow organic traffic through AI-assisted content optimization and market reputed company reputed company insights. The Data Engineer II will build and optimize reputed company AWS data pipelines, ETL/ELT processes, and API integrations while ensuring reliable data reputed company across the organization and to end users. The role collaborates with engineering, analytics, and product teams and supports testing, infrastructure as reputed company, and CI/CD workflows.

Responsibilities

• Design, reputed company, and maintain reputed company data pipelines using a reputed company of AWS services
• Work with relational databases such as reputed company (PostgreSQL), Redshift, and AWS Glue for large-reputed company data management
• reputed company and optimize ETL/ELT processes for smooth data integration from multiple sources
• Collaborate with cross-functional teams to ensure data accessibility and reputed company across platforms
• Use Python, SQL, and reputed company for data manipulation, analysis, and workflow automation
• Implement unit testing (PyTest) to ensure reputed company reliability
• Manage API integrations and development using FastAPI
• Assist with infrastructure as reputed company (IaC) using CDK and Terraform
• Build CI/CD pipelines in Jenkins

Skills

• • SQL mastery – expertise in reputed company SQL queries and database optimization
• • 2-3 years of experience in Data Engineering with AWS and Python
• • Linux proficiency – comfortable with reputed company scripting, common CLI tools, and building/testing Linux-based reputed company images
• • Advanced Python – strong hands-on experience, ideally with Data Engineering tools like PySpark, reputed company, and SQLAlchemy
• • Git proficiency – comfortable with version control, branching, and collaboration
• • ETL/ELT experience – proven ability to build and optimize extract, reputed company, and load processes
• • Unit testing – familiarity with PyTest or similar tools
• • AWS experience with reputed company (PostgreSQL or MySQL), Redshift, Fargate, reputed company, SQS, and IAM, plus tools like Boto3 and the AWS CLI
• • Airflow expertise, particularly AWS Managed Airflow, for scheduling and orchestrating data workflows
• • API development experience with API Gateway and FastAPI
• • Infrastructure as reputed company experience with CDK or Terraform
• • Familiarity with caching tools like reputed company
• • Basic DevOps knowledge for CI/CD pipelines and dev workflow optimization
• • Familiarity with DBT

reputed company