Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
GELATO: Generative Entropy- and Lyapunov-based Adaptive Token Offloading for Device-Edge Speculative LLM Inference
Saved in:
| Published in: | ArXiv cs.IT Recent Papers |
|---|---|
| Format: | Online Article RSS Article |
| Published: |
2026
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
Similar Items: GELATO: Generative Entropy- and Lyapunov-based Adaptive Token Offloading for Device-Edge Speculative LLM Inference
- AHASD: Asynchronous Heterogeneous Architecture for LLM Adaptive Drafting Speculative Decoding on Mobile Devices
- LLM-Enhanced Deep Reinforcement Learning for Task Offloading in Collaborative Edge Computing
- VitaLLM: A Versatile and Tiny Accelerator for Mixed-Precision LLM Inference on Edge Devices
- Entropy-informed Decoding: Adaptive Information-Driven Branching
- NVLLM: A 3D NAND-Centric Architecture Enabling Edge on-Device LLM Inference
- Real-Time Text Transmission via LLM-Based Entropy Coding over Fixed-Rate Channels