Category: Science
-
Out-of-Distribution Generalization & Production AI Failure
Physical mechanisms, mathematical boundary conditions, and experimental evidence in Out-of-Distribution Generalization & Production AI Failure.
-
LLM-as-a-Judge Evaluation & Systematic Assessment Bias
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
Dynamic Benchmarks & Moving-Target Evaluation in AI
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
Adversarial Robustness & Gradient Perturbations in Neural Nets
Physical mechanisms, mathematical boundary conditions, and experimental evidence in Adversarial Robustness & Gradient Perturbations in Neural Nets.
-
Verbosity Bias & Length Exploitation in LLM Evaluation
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
RLHF Sycophancy Traps & User Agreement Confirmation
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
The GSM8K Reasoning Ceiling & Synthetic Mathematical Evals
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
AI Benchmark Data Contamination & Memorization Traps
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
Goodhart’s Law & Benchmark Gaming in Machine Learning
Metascientific measurement frameworks, distributional shifts, and evaluation biases in machine intelligence.
-
The Silicon Scaling Wall: Landauer Limits in Compute
Information-theoretic entropy bounds, microscopic irreversibility, and thermodynamic work extraction.