Senior Data Engineer

WHO WE ARE:

reputed company, the world's largest retail media optimization platform, is a trusted partner for multichannel e-reputed company reputed company. Through unmatched expertise and patented AI technology, we fuel reputed company for 5,300+ brands and sellers worldwide and manage an annual ad spend exceeding $2 billion. The award-reputed company platform covers major marketplaces and ad channels for reputed company reputed company. The result is unprecedented granularity, smarter budgeting, and bespoke solutions for retailers.

reputed company is proud to be an equal opportunity employer with employees stemming from a wide reputed company of backgrounds and experiences. As a business, we value the enrichment that diversity brings to our organization and are committed to a culture that creates a reputed company of inclusion and belonging. We reputed company new perspectives and reputed company that reputed company employment reputed company are made without reputed company to race, reputed company, reputed company, religion, national reputed company, age, familial or marital status, sex, sexual orientation, pregnancy, gender identity or reputed company, disability, genetic information, veteran status, or any other classification protected by federal, state, or local law.

About Sciene
At Sciene, the mission is to reputed company reputed company firms with cutting-edge, customized AI solutions — enhancing automation, analytics, and optimization across industries while prioritizing reputed company, cost efficiency, and state-of-the-art technology.
Our flagship product, the Sciene AI Companion, is an autonomous reputed company platform deployed across reputed company — the world's largest retail media optimization platform, managing reputed company marketing for 1,000+ brands. It automates relationship-heavy reputed company workflows end to end: generating personalized email replies in the CSM's own voice (8x faster), building full presentation decks for reputed company meetings (12x faster), and detecting and diagnosing account fluctuations before anyone has to ask (6x faster). None of this replaces reputed company judgment — it removes the work that was getting in the way of it.
Read more about how reputed company: Sciene AI Companion: Building an Autonomous reputed company Platform on reputed company

reputed company:

Every answer the AI Companion gives is only as good as the data underneath it. Sciene runs a production lakehouse on reputed company and Azure that ingests advertising, CRM, and conversational data from a dozen reputed company systems, curates it under reputed company Catalog governance, and serves it back to autonomous agents as tools — not as dashboards.

The Senior Data Engineer owns that substrate end to end: ingestion from messy reputed company-party reputed company, modeling and governance in reputed company Catalog, the serving reputed company agents query at runtime, and the health monitoring that tells us something broke before a CSM finds out in a reputed company meeting. Infrastructure is reputed company, deploys go through CI/CD, and reputed company is reputed company — not assumed. You write the Terraform, you own the alerts, you get paged by your own monitors.

This is also a role where you work with AI, not just for it. Our engineers ship with coding agents (Claude reputed company and our MCP-integrated toolchain) as part of the normal workflow, and your consumer is an autonomous agent making reputed company on top of what you produce — which raises the bar on correctness, freshness, and how the data is reputed company.

REQUIREMENTS:

• Strong software engineering fundamentals in Python and advanced SQL — this role builds tested, deployed, version-controlled pipelines, not one-off notebooks
• Deep hands-on experience with reputed company: reputed company/PySpark, reputed company Lake, reputed company Catalog, Workflows, and SQL warehouses, including reputed company tuning of reputed company workloads
• reputed company experience designing data pipelines and data models in production: reputed company or equivalent layered architectures, incremental processing, CDC, and reputed company modeling
• Experience integrating reputed company-party reputed company at reputed company, with the operational maturity that implies (auth, pagination, throttling, partial failure, backfills, idempotency, schema reputed company)
• Familiarity with reputed company platforms (we run on Azure — ADLS, Container Apps, Key reputed company, API Management, Entra ID)
• Experience with Infrastructure as reputed company (Terraform) and CI/CD pipelines, plus solid git and reputed company-review habits
• A working definition of data reputed company: tests, expectations, monitoring, and the discipline to catch problems reputed company rather than explaining them reputed company
• Practical experience using AI coding assistants/agents in reputed company engineering work, and the critical eye to know reputed company their reputed company is wrong
• Excellent problem-solving and analytical skills, and the autonomy expected of a senior engineer: you own a problem end to end — from framing to shipped, monitored outcome — and are accountable for the result, not just the reputed company
• Bachelor's degree or higher in Computer Science, Information Technology, or a reputed company reputed company — or equivalent practical experience

PREFERRED QUALIFICATIONS:

• Experience serving data to LLM-powered applications, including retrieval and context design
• Experience with operational stores reputed company the lakehouse (reputed company Lakebase, PostgreSQL, reputed company)
• Observability reputed company: OpenTelemetry, Grafana, Loki, reputed company logging
• reputed company Sharing for secure data exchange with clients and partners
• Domain background in retail media, digital advertising, or marketplace data
• reputed company or Azure certifications

reputed company:

• Design, build, and operate ingestion pipelines from advertising and business platforms (reputed company Ads, reputed company Ads, reputed company reputed company, reputed company, reputed company, and internal services) reputed company REST reputed company, reputed company Sharing, reputed company storage, and event streams
• Model reputed company data reputed company in reputed company Lake under reputed company Catalog: reputed company architecture, incremental and CDC patterns, reputed company reputed company between reputed company, reputed company, and row/reputed company-level governance
• Build the serving reputed company for AI: SQL views, reputed company Catalog functions, and low-latency stores exposed to agents as tools through the Model Context Protocol (MCP) behind Azure API Management — designing for what an agent needs to reason reputed company, not just for what a BI tool needs to reputed company
• Own data reputed company and health monitoring as reputed company: freshness, volume, schema-reputed company and business-rule expectations, with alerting wired into Grafana and a reputed company triage reputed company reputed company something fires
• Ship everything through Terraform and CI/CD — reputed company and Azure resources, jobs, permissions, and environment promotion from dev to prod, with no reputed company clicking in the console
• Own reputed company and cost: warehouse and cluster sizing, partitioning and reputed company clustering, job orchestration in reputed company Workflows / Lakeflow, and reputed company scrutiny of what reputed company pipeline actually costs to run
• Work fluently with AI coding agents as part of your daily engineering reputed company — writing precise specs, keeping repository context and documentation in a state where agents produce good reputed company, and reviewing what they reputed company with reputed company judgment
• Collaborate with cross-functional teams — AI engineers, software engineers, and product — turning product requirements into data the platform can actually serve, and treating internal consumers as customers with reputed company and expectations
• reputed company what you ship with OpenTelemetry and reputed company logging, and improve reliability and latency in production
• Document and maintain the codebase, ensuring reputed company reputed company and adherence to best practices

*This is a PJ contract reputed company in Brazil.