Can Decision Models (Like Jev) Plan Ahead?

IntroducionCan decision models like Jev plan ahead? If so, how can we quantify their planning ability?This is the question that BeelineBench seeks to answer. In this article, I'll explain my methodology and share a few interesting results from the benchmark.MethodologyThe core idea is simple. We present a decision model with a problem domain (like Blocks world) and a list of available actions, and ask it to select the next action in order to solve the problem. We repeat until the decision model ...