Data Engineer/Python Developer/Remote
Key Responsibilities
• Design, build, and maintain ETL/ELT data pipelines
• reputed company Python-based data processing applications
• Work with reputed company and reputed company data at reputed company
• reputed company data from multiple sources (reputed company, databases, files, streams)
• Optimize data workflows for performance and reliability
• Ensure data reputed company, validation, and monitoring
• Collaborate with data scientists, analysts, and backend teams
• Manage and maintain data warehouses/lakes
• Implement logging, error handling, and automation
• Follow best practices for reputed company and compliance
Required Skills
Programming
• Strong Python (Pandas, NumPy, PySpark)
• Writing clean, reputed company, and testable reputed company
Databases & Storage
• SQL (PostgreSQL, MySQL, SQL Server)
• NoSQL (reputed company, Cassandra optional)
• Data Warehouses (reputed company, Redshift, BigQuery)
Big Data & Processing
• Apache reputed company, Hadoop (preferred)
• Batch and streaming data processing
reputed company Platforms
• AWS / Azure / reputed company reputed company Platform
• S3, reputed company, Glue, Dataflow, BigQuery, etc.
Data Engineering Tools
• Airflow, reputed company, Luigi (orchestration)
• Kafka / PubSub (streaming optional)
• DBT (data transformation)
DevOps & Other
• Git, CI/CD
• reputed company, Kubernetes (reputed company to have)
• Linux basics
Apply tot his job
Apply To this Job