Three Pieces of Evidence that the NLA Reconstructor Does Not Read Semantics or Syntax

·LessWrong··

TL;DRThe autoreconstructor (AR) in a natural language autoencoder (NLA) is the entire argument for the validity of the method, and at present is poorly understood.The AR does not condition strongly on English grammar or semantics. Three bits of evidence:Word pairs that are syntactically related interact no more than matched pairs that are not syntactically related. See dependency arcs.The fraction of variance explained (FVE) lost by removing or flipping a negation word ("not" -> ""; "without" ->...

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 6h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 14h ago
The recently proposed o(n log n) integer multiplication algorithm [pdf]
craigcitro · Hacker News · 20h ago
Security Disclosure
passenger · Hacker News · 1d ago
Show HN: Run full iOS 16.5 firmware on Android Devices
aghuang · Hacker News · 7h ago