IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...
Geeky Gadgets

GPT-4 Turbo 128K context length performance tested

Recently, OpenAI unveiled its latest advancement in the realm of artificial intelligence: the GPT-4 Turbo. This new AI model boasts a substantial 128K context length, offering users the ability to ...
VentureBeat

MosaicML launches MPT-7B-8K, a 7B-parameter open-source LLM with 8k context length

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More MosaicML has unveiled MPT-7B-8K, an open-source large language model (LLM ...