OpenScience is an AI workbench for scientific research. You give it a goal, and it works through the research loop the way a ...
Introduces a low-rank-based approach to KV cache compression, one of the key bottlenecks in long-context AISpeeds up attention computation by up to 6.9x and overall generation throughput by up to 3.1x ...