Understanding Confabulation and Rethinking Reconstruction in Activation Explanations
Flow-NLA moves beyond point reconstruction in Natural Language Autoencoders by modeling distributions of activations compatible with an explanation, retaining utility gains while reducing confabulation and writing defects.