Prudhvi Vatala

Head of Engineering Platforms at Snap, focused on large-scale data and ML infrastructure; publicly discussed Snap’s modernization of experimentation data pipelines using NVIDIA GPU-accelerated Apache Spark on Google Cloud.

Snap Cut Experimentation Job Costs 76% With GPU-Accelerated Spark

Prudhvi Vatala, Snap’s head of engineering platforms, argues that the company’s 10-plus-petabyte daily experimentation pipeline became a cost and scale problem that could not be solved by adding more CPUs. In an NVIDIA AI Podcast interview, he says Snap cut job costs by 76% by moving Spark workloads to NVIDIA GPU-accelerated infrastructure on Google Cloud, reusing idle inference GPUs overnight, and doing so without application code changes.

NVIDIAMay 13, 20269 min read