Google Research has developed a compression algorithm called TurboQuant, which reduces the memory footprint of large language models (LLMs) while simultaneously increases speed and accuracy. The system is designed to reduce the size of the key-value cache, which is often used to store important information. Early tests show an 8x performance increase and 6x reduction in memory usage without losing quality.