Senior Software Engineer, Data Infrastructure Compute

About this role

Roblox · careers.roblox.com · checked today

Senior Software Engineer, Data Infrastructure Compute

San Mateo, CA, United StatesSenior*5+ yrs*Data Platformposted 3 d ago

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device.

Skills, with evidence

• Spark

Spark on Kubernetes: Hands-on experience running Apache Spark on Kubernetes (EKS, GKE, or self-managed) as a platform, including executor and driver behavior, resource tuning, and troubleshooting failed or slow jobs.must have

• AWS

Cloud fluency: Experience with AWS (EKS, EC2, IAM, S3) or GCP equivalents, and infrastructure-as-code.must have · not practised here

• Kubernetes

Kubernetes depth: Strong experience operating production Kubernetes clusters at scale, such as upgrades, node lifecycle, autoscaling, and operators or controllers.must have · not practised here

• Python

Python is a plus, since much of our tuning and analysis tooling uses it.

• Cost & performance

Launch interactive Spark at scale: Deliver Spark Connect to support notebook workflows, including provisioning and managing the EKS compute that backs them, with sensible isolation, resource limits, and cost controls.

• Data quality

Be an owner of reliability and cost: Define SLOs and metrics, build observability, and drive down toil, incidents, and compute spend across a multi-tenant platform.

• Failure handling

Be an owner of reliability and cost: Define SLOs and metrics, build observability, and drive down toil, incidents, and compute spend across a multi-tenant platform.

• GCP

Cloud fluency: Experience with AWS (EKS, EC2, IAM, S3) or GCP equivalents, and infrastructure-as-code.not practised here

• Java

Engineering foundations: Strong proficiency in at least one of Go, Java, Scala, or Clojure , with a track record of writing clean, well-tested, maintainable backend code.not practised here

• Scala

Engineering foundations: Strong proficiency in at least one of Go, Java, Scala, or Clojure , with a track record of writing clean, well-tested, maintainable backend code.not practised here

• Terraform

Experience with the Spark Operator, Karpenter, Helm, Terraform, or Argo.not practised here

Your plan

1. The SQL screen: correct, then fast

Data quality

• Late arriving event auditIntermediate
• Order anomaly auditIntermediate
• Premium and free listening by countryIntermediate
• Interview audit union capstoneAdvanced
• Airbnb: converting on a day with no published rateAdvanced

≈ 2 h

1. Python: the data-wrangling round

Python

• Diff two snapshots of a tableIntermediate
• Explode an array column into rowsIntermediate
• Flatten nested event payloadsIntermediate
• Keep only the latest row for each eventIntermediate
• Pivot a long metrics table to wideIntermediate

≈ 3 h

1. Pipeline design: safe to run twice

Failure handling

• Is this change safe?Intermediate
• The source will not let youIntermediate
• Changing a pipeline that’s already runningIntermediate
• SLA-aware alerting flowIntermediate
• The table everyone depends onIntermediate

≈ 4 h

1. Spark: read the plan Spark actually ran

Spark · Cost & performance

• broadcast() with auto-broadcast off, and the case where Spark ignores itIntermediate
• autoBroadcastJoinThreshold compares an estimate: flip a join with select() and one settingIntermediate
• Does Spark really run your EXISTS subquery once per row?Intermediate
• left\_semi and left\_anti: "customers who did / never did" without a full joinIntermediate
• A self-join on a real key that still multiplies rowsIntermediate

≈ 2 h

1. Say it out loud

Rehearse: SQL · Query formulation

≈ 1 h

20 drills · Intermediate + Advanced≈ 11 hours

Not covered by the plan: AWS, Kubernetes, GCP, Java, Scala, Terraform.

Readiness

0 of 20 drills already done elsewhere on D8LooP.

Apply on careers.roblox.com

leaves in 10 dremoved the moment Roblox closes it