ShadowKV: A high-performance inference system for long-context LLM inference
Large language models (LLMs) are getting better at scaling and handling long contexts. Since they are used on a large ...
Tag: longcontext
This Google DeepMind AI article explores inference scaling in long-context RAG
long context Large Language Models (LLM) They are designed to handle long sequences of input, allowing them to process and ...
From Long-context, RAG to Agentic RAG
So far, various models have served distinct purposes in artificial intelligence. These models have significantly impacted human life, from understanding ...
LongBench-Cite and LongCite-45k: Leveraging CoF (Coarse-to-Fine) methodology to improve long-context LLMs with fine-grained sentence-level citations to improve QC accuracy and reliability
Large language models (LLMs) have become essential tools for tasks such as question-answering (QA) and text summarization. These models are ...
AI21 Labs has launched the Jamba 1.5 family of open models: Jamba 1.5 Mini and Jamba 1.5 Large, redefining long-context AI with unmatched speed, quality, and multilingual capabilities for global enterprises.
AI21 Labs has taken a major step into the ai landscape by launching the Jamba 1.5 Open Model Familywhich includes ...
MMLongBench-Doc: A comprehensive benchmark for evaluating long-context document understanding on large language and vision models
Document understanding (DU) focuses on the automatic interpretation and processing of documents, which encompass complex layout structures and multimodal elements ...
Google DeepMind researchers present Mobility VLA: Multimodal instruction navigation with long-context VLMs and topological graphs
Technological advancements in sensors, artificial intelligence, and processing power have propelled robotic navigation to new heights in the past decades. ...
LongRAG: A New Artificial Intelligence AI Framework Combining RAG with Long-Context LLM to Improve Performance
Retrieval-augmented generation (RAG) methods improve the capabilities of large language models (LLMs) by incorporating external knowledge retrieved from vast corpora. ...
This AI research introduces flash decoding: a new FlashAttention-based AI approach to perform long-context LLM inference up to 8x faster
Large language models (LLMs), such as ChatGPT and Llama, have attracted substantial attention due to their exceptional natural language processing ...
MIT and CUHK researchers propose LongLoRA (long low-rank adaptation), an efficient tuning AI approach for long-context large language models (LLMs)
The introduction of large language models (LLM) has brought a significant level of advancement in the field of artificial intelligence. ...
Recommended.
