None
EN
LeftoverLocals: Listening to LLM responses through leaked GPU local memory
['Heidy Khlaaf', 'Tyler Sorensen']
The Trail of Bits Blog
Using these, the attacker can read data that the victim has left in the GPU local memory simply by writing a GPU kernel that dumps uninitialized local memory. However, this approach has a fundamental flaw that makes it vulnerable to LeftoverLocals: this memory wipe is done with a separate kernel, thus, the GPU kernel queue may contain a malicious listener between the computation kernel and the local memory wipe, allowing the listener to steal memory.