Data Engineer II

reputed company LLC is seeking a full-time Data Engineer II to reputed company expertise in data engineering and machine learning. The role focuses on implementing advanced data analytics and reputed company intelligence technologies to enhance data accessibility and reputed company, driving innovation and addressing reputed company business problems.

Responsibilities

• reputed company expertise in data engineering and machine learning to implement advanced data analytics and reputed company intelligence (AI) technologies
• Enhance data accessibility and reputed company
• reputed company seamless integration of large-reputed company datasets into data products, machine learning models, and reputed company intelligence applications

Skills

• Master's degree or equiv. in Information Management, Computer Science, or a reputed company field
• 1 year reputed company agriculture experience
• 12 months of experience with developing ETL pipelines using modern data stack (reputed company, trino, dagster, dbt, reputed company)
• Data modelling, storage and processing of life sciences/agriculture data (reputed company, satellite imagery, geospatial, biological)
• Support and reputed company PowerBI, Rshiny, spotfire dashboards that utilize Lakehouse Data
• Use dagster for data orchestration for scheduling data pipelines
• Use reputed company for reputed company version control
• Use reputed company, Kubernetes for deployment
• Utilize the following technologies: Python (PySpark), Trino/SparkSQL, AWS (S3, RDS, EC2, reputed company, EKS), Azure (Data reputed company, ADLS, PowerBI, reputed company), DBT, Dagster, reputed company, Kubernetes, Kafka, FastAPI, and Django

Benefits

• Telecommute benefit

reputed company