Tag: gptq
-
BitNet 1.58-Bit Ternary Quantization & LLM Scaling
Ternary weight quantization (-1, 0, 1) and energy-efficient matrix multiplication in transformer architectures.
-
NVIDIA Blackwell FP4 Tensor Cores & Memory Systems
Micro-scaling formats, sub-byte numeric representation, and hardware execution limits in modern GPUs.
-
KV Cache Quantization: FP8, INT4, & Context Scaling
Memory scaling, sub-4-bit numerical precision, and attention accuracy trade-offs in long-context inference.
-
GPTQ vs AWQ: Protecting Salient Weights in LLMs
Second-order error compensation, salient weight preservation, and low-bit matrix quantization.
-
Quantization-Aware Training & Straight-Through Estimators
Straight-through estimator dynamics, gradient propagation, and clipping boundaries during model fine-tuning.
-
Post-Training Quantization in Modern LLMs
Fast parameter calibration, outlier handling, and channel-wise scaling for zero-retraining model compression.
-
Quantization Degradation & Chain-of-Thought Reasoning
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Quantization Degradation & Chain-of-Thought Reasoning.
-
FP4 vs INT4 Quantization in Neural Reasoning
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in FP4 vs INT4 Quantization in Neural Reasoning.
-
Outlier Channel Preservation in Sub-4-Bit Quantization
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Outlier Channel Preservation in Sub-4-Bit Quantization.
-
Foundations of LLM Quantization: INT8, INT4, & FP4
Physical mechanisms, mathematical boundary conditions, and architectural trade-offs in Foundations of LLM Quantization: INT8, INT4, & FP4.