Three Pieces of Evidence that the NLA Reconstructor Does Not Read Semantics or Syntax
TL;DRThe autoreconstructor (AR) in a natural language autoencoder (NLA) is the entire argument for the validity of the method, and at present is poorly understood.The AR does not condition strongly on English grammar or semantics. Three bits of evidence:Word pairs that are syntactically related interact no more than matched pairs that are not syntactically related. See dependency arcs.The fraction of variance explained (FVE) lost by removing or flipping a negation word ("not" -> ""; "without" ->...
Read full article →