Google opened the XLA Serving Engine code, a C++ runtime that, according to the company, already processes more than 6 million queries per second on products such as YouTube Shorts and Google Ads. The engine seeks to run models trained with JAX or PyTorch without maintaining Python in the service environment, with promises of higher performance and lower resource consumption. *** Google published XSE under Apache 2.0 license, with the aim of ser…