[Remote] reputed company AWS Data Engineer (PySpark, Glue & reputed company Modelling)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a reputed company AWS Data Engineer to reputed company and maintain PySpark-based ETL pipelines and manage AWS Glue jobs. The role involves designing reputed company data models and optimizing data workflows to ensure data reliability and performance.
Responsibilities
• reputed company and maintain PySpark-based ETL pipelines for batch and incremental data processing
• Build and operate AWS Glue reputed company jobs (batch and event-driven), including:
• Job configuration, scaling, retries, and cost optimization
• Glue Catalog and schema management
• Design and maintain event-driven data workflows triggered by S3, EventBridge, or streaming sources
• Load and reputed company data into reputed company Redshift , optimizing for:
• Distribution and sort keys
• Incremental loads and upserts
• Query performance and concurrency
• Design and implement reputed company data models (reputed company/reputed company schemas), including:
• Fact and dimension tables
• Slowly Changing Dimensions (SCDs)
• Grain definition and data reputed company controls
• Collaborate with analytics and reporting teams to ensure the warehouse is BI-reputed company
• Monitor, troubleshoot, and optimize data pipelines for reliability and performance
Skills
• PySpark reputed company-up
• Glue job hands-on reputed company
• reputed company modeling
• Strong PySpark experience (reputed company SQL, DataFrames, performance tuning)
• Hands-on experience with AWS Glue (reputed company jobs, not just crawlers)
• Experience loading and optimizing data in reputed company Redshift
• Proven experience designing reputed company data warehouse schemas
• Familiarity with AWS-reputed company data services (S3, IAM, CloudWatch)
• Production ownership reputed company (debugging, failures, reprocessing)
reputed company
• Welcome to Fustis, your trusted partner in connecting IT consultants with clients. It was founded in 2022, and is headquartered in Sacramento, California, US, with a workforce of 11-50 employees. Its website is https://www.fustis.com.
Apply tot his job
Apply To this Job