Full Text Available

Note: Clicking the button above will open the full text document at the original institutional repository in a new window.

Long Context Pre-Training with Lighthouse Attention

Saved in:
Bibliographic Details
Published in:ArXiv cs.CL Recent Papers
Format: Online Article RSS Article
Published: 2026
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1864764977701715972
collection WordPress RSS
FRELIP Feed Integration
container_title ArXiv cs.CL Recent Papers
description
discipline_display Engineering & Technology
discipline_facet Engineering & Technology
format Online Article
RSS Article
genre Journal Article
id rss_article:50476
institution FRELIP
journal_source_facet ArXiv cs.CL Recent Papers
publishDate 2026
publishDateSort 2026
record_format rss_article
spellingShingle Long Context Pre-Training with Lighthouse Attention
ArXiv cs.CL Recent Papers
Civil & Construction
Engineering & Technology
sub_discipline_display Civil & Construction
sub_discipline_facet Civil & Construction
subject_display ArXiv cs.CL Recent Papers
Civil & Construction
Engineering & Technology
ArXiv cs.CL Recent Papers
Civil & Construction
Engineering & Technology
subject_facet ArXiv cs.CL Recent Papers
Civil & Construction
Engineering & Technology
title Long Context Pre-Training with Lighthouse Attention
title_auth Long Context Pre-Training with Lighthouse Attention
title_full Long Context Pre-Training with Lighthouse Attention
title_fullStr Long Context Pre-Training with Lighthouse Attention
title_full_unstemmed Long Context Pre-Training with Lighthouse Attention
title_short Long Context Pre-Training with Lighthouse Attention
title_sort long context pre-training with lighthouse attention
topic ArXiv cs.CL Recent Papers
Civil & Construction
Engineering & Technology
url https://arxiv.org/abs/2605.06554v1