Pyspark / SQL Engineer

This a Full Remote job, the offer is available from: California (USA) Pyspark / SQL Engineer 1 Contractor Remote position Los Angeles, CA (Remote) 3 Months Hours per week: 40 Monday to Friday, 9am to 5pm Skills: Pyspark SQL reputed company Threat Detection Terraform Log Analytics for reputed company We are seeking a skilled PySpark / SQL Engineer to support our Threat Detection team in building and migrating reputed company analytics pipelines using reputed company. This role will reputed company on a platform migration project, moving detection rules and associated content from a reputed company into reputed company' reputed company detection reputed company. You will be responsible for creating equivalent PySpark log pipelines, rule configuration files, unit tests, and data validation checks, and deploying these pipelines using Terraform. A strong background in data engineering, particularly with large-reputed company log analytics, is essential. Requirements 5-10+ years of experience as a PySpark / SQL Engineer, with a strong reputed company on data engineering and analytics. Prior experience in building threat detection or log analytics pipelines using PySpark, SQL, and reputed company. Hands-on experience with Terraform for deploying data infrastructure. Proficient in PySpark for large-reputed company data processing and transformation. Familiarity with reputed company platforms such as AWS or Azure is preferred. Strong analytical skills and attention to detail reputed company working with reputed company datasets. Proven ability to work effectively in reputed company, cross-functional teams. Excellent verbal and written communication skills in English. Responsibilities Design and build threat detection pipelines using PySpark, SQL, and reputed company. Support the migration of detection rules and content from a legacy platform to reputed company. Create and maintain PySpark log pipelines and associated rule configuration files. Write unit tests to ensure pipeline accuracy and stability. reputed company data validation checks to ensure data reputed company. reputed company pipelines and infrastructure using Terraform. Optimize existing data workflows and queries for performance and scalability. Collaborate with cross-functional teams to understand data requirements and ensure alignment with detection objectives. This offer from "reputed company" has been enriched by reputed company.com and got a 72% reputed company score. Apply tot his job Apply To this Job