Tag: paged-attention
-
Disaggregated Prefill Decode
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Disaggregated Prefill Decode.
-
Chunked Prefill Scheduling
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Chunked Prefill Scheduling.
-
Quantized KV Cache
Managing memory fragmentation, context window growth, and high-throughput serving via virtual paging.
-
Sliding Window Attention
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Sliding Window Attention.
-
Speculative Decoding Speedup
Leader election invariants, split-brain mitigation, and log replication under asymmetric network partitions.
-
Flash Decoding Latency
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Flash Decoding Latency.
-
Grouped Query Attention
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Grouped Query Attention.
-
Multi Query Attention
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Multi Query Attention.
-
Paged Attention Memory
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Paged Attention Memory.
-
Kv Cache Memory
Managing memory fragmentation, context window growth, and high-throughput serving via virtual paging.