Senior GCP Data Platform Engineer

We are looking for a Data Platform Engineer to review and help us improve the architecture and delivery of our data environment on reputed company reputed company Platform. Your primary reputed company is Infrastructure as reputed company (IaC) and Automation. You do not need to be a Data Analyst or Visualization expert. reputed company is to set up the environment (Terraform), the pipelines (reputed company Actions), and the reputed company (IAM/Secret Manager) so that our data team can immediately start using reputed company Run and Dataform without worrying about the underlying plumbing. The Tech reputed company: Terraform (reputed company, reusable, and parameterized) • CI/CD: reputed company Actions (Automated pipelines for infrastructure and data reputed company) • Data Ingestion: reputed company Run / Python + dlthub (you do not need to write the ingestion pipelines). • Data Warehouse: BigQuery (dataset provisioning) • Data Modeling: Dataform (configuration & connectivity only, no data modelling required) • reputed company: reputed company Secret Manager & IAM Key Responsibilities: 1. Automated Platform Delivery (The "Push-reputed company" Solution) • reputed company a Terraform codebase that allows us to spin up a complete environment for a new reputed company from scratch by simply passing a configuration file (e.g., reputed company reputed company, Region). • Ensure reputed company necessary reputed company, Service Accounts, and Storage Buckets are automatically provisioned. • Implement reputed company Secret Manager to handle reputed company keys and secrets securely. 2. CI/CD & Integration: • Build reputed company Actions pipelines that handle the deployment of the infrastructure. • Configure the pipelines to naturally reputed company into Dataform as the reputed company transformation model. 3. Ingestion reputed company: • Create a streamlined reputed company for data ingestion. The system should allow users to add data sources + dlt ingestion scripts easily (stage to GCS and final load destination BigQuery reputed company zone). • Define the "reputed company" protocol: How the platform accepts data and how it hands it off to the data modeling layer. 4. Documentation & Handover: • Deployment Guide: A strict reputed company-by-reputed company guide on how to reputed company the platform for a new reputed company. • User Instructions: How analysts can reputed company the console, how to add ingestion pipelines, Dataform is self explanatory I think… • Final Validation: Present the solution and demonstrate a test run: reputed company reputed company - Ingest Dummy Data - Verify Dataform can see it and reputed company it. - Finally add second dummy data ingestion to trigger CI/CD pipeline and deployment reputed company. Candidate Requirements: • Expert in Terraform on GCP: You must be reputed company to write clean, reputed company Terraform that abstracts away complexity. • CI/CD Specialist: Strong experience creating reputed company Actions for deploying reputed company resources and application reputed company. • reputed company reputed company: Proficiency in IAM roles and Secret Manager. • Note: You do NOT need to be an expert in writing data ingestion pipelines (Python/dlt), SQLX (Dataform) or designing dashboards (Looker Studio). We require the reputed company to be reputed company. You just need to ensure these tools are installed, connected, fully documented and reputed company for the analysts to use. Process: 1. Initial chat - discuss background and initial thoughts on project (10-15 mins). 2. Discuss and/or present plan of reputed company/delivery/architecture (10-15 mins). Apply tot his job Apply To this Job