Collection by 
Nov 4, 2023
Collections
Discover the best community collections!
Collections including paper arxiv:2309.00071
Collection by 
Apr 12, 2024
-
Detecting Pretraining Data from Large Language Models
Paper • 2310.16789 • Published • 11 -
Let's Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models
Paper • 2310.13671 • Published • 19 -
AutoMix: Automatically Mixing Language Models
Paper • 2310.12963 • Published • 14 -
An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper • 2310.12962 • Published • 13
Collection by 
Feb 15
-
TRAMS: Training-free Memory Selection for Long-range Language Modeling
Paper • 2310.15494 • Published • 2 -
A Long Way to Go: Investigating Length Correlations in RLHF
Paper • 2310.03716 • Published • 10 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
Giraffe: Adventures in Expanding Context Lengths in LLMs
Paper • 2308.10882 • Published • 1
Collection by 
Feb 22, 2024
Collection by 
Sep 8, 2025
-
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
NousResearch/Yarn-Mistral-7b-128k
Text Generation • Updated • 1.73k • 570 -
NousResearch/Yarn-Solar-10b-64k
Text Generation • Updated • 76 • 15 -
NousResearch/Yarn-Llama-2-70b-32k
Text Generation • Updated • 21 • 37
Collection by 
Apr 9, 2024
-
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
Paper • 2108.12409 • Published • 5 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
MIMIC-IT: Multi-Modal In-Context Instruction Tuning
Paper • 2306.05425 • Published • 12 -
Music ControlNet: Multiple Time-varying Controls for Music Generation
Paper • 2311.07069 • Published • 45
Collection by May 28, 2024
-
Cure the headache of Transformers via Collinear Constrained Attention
Paper • 2309.08646 • Published • 14 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Paper • 2309.10400 • Published • 26 -
Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit
Paper • 2205.13522 • Published • 1
Collection by 
Oct 15, 2023
-
CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages
Paper • 2309.09400 • Published • 87 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84
Collection by 
Oct 1, 2023
Collection by 
Sep 25, 2023
-
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84 -
Baichuan 2: Open Large-scale Language Models
Paper • 2309.10305 • Published • 22 -
Chain-of-Verification Reduces Hallucination in Large Language Models
Paper • 2309.11495 • Published • 40 -
LMDX: Language Model-based Document Information Extraction and Localization
Paper • 2309.10952 • Published • 67
Collection by Nov 4, 2023
Collection by Apr 9, 2024
-
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
Paper • 2108.12409 • Published • 5 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
MIMIC-IT: Multi-Modal In-Context Instruction Tuning
Paper • 2306.05425 • Published • 12 -
Music ControlNet: Multiple Time-varying Controls for Music Generation
Paper • 2311.07069 • Published • 45
Collection by Apr 12, 2024
-
Detecting Pretraining Data from Large Language Models
Paper • 2310.16789 • Published • 11 -
Let's Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models
Paper • 2310.13671 • Published • 19 -
AutoMix: Automatically Mixing Language Models
Paper • 2310.12963 • Published • 14 -
An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper • 2310.12962 • Published • 13
Collection by May 28, 2024
-
Cure the headache of Transformers via Collinear Constrained Attention
Paper • 2309.08646 • Published • 14 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Paper • 2309.10400 • Published • 26 -
Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit
Paper • 2205.13522 • Published • 1
Collection by Feb 15
-
TRAMS: Training-free Memory Selection for Long-range Language Modeling
Paper • 2310.15494 • Published • 2 -
A Long Way to Go: Investigating Length Correlations in RLHF
Paper • 2310.03716 • Published • 10 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
Giraffe: Adventures in Expanding Context Lengths in LLMs
Paper • 2308.10882 • Published • 1
Collection by Oct 15, 2023
-
CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages
Paper • 2309.09400 • Published • 87 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84
Collection by Feb 22, 2024
Collection by Oct 1, 2023
Collection by Sep 8, 2025
-
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 81 -
NousResearch/Yarn-Mistral-7b-128k
Text Generation • Updated • 1.73k • 570 -
NousResearch/Yarn-Solar-10b-64k
Text Generation • Updated • 76 • 15 -
NousResearch/Yarn-Llama-2-70b-32k
Text Generation • Updated • 21 • 37
Collection by Sep 25, 2023
-
Language Modeling Is Compression
Paper • 2309.10668 • Published • 84 -
Baichuan 2: Open Large-scale Language Models
Paper • 2309.10305 • Published • 22 -
Chain-of-Verification Reduces Hallucination in Large Language Models
Paper • 2309.11495 • Published • 40 -
LMDX: Language Model-based Document Information Extraction and Localization
Paper • 2309.10952 • Published • 67