Do Neural Language Representations Learn Physical Commonsense?

Ari Holtzman
Ari Holtzman

Cognitive Science, pp. 1753-1759, 2019.

Cited by: 30|Views12
EI
Weibo:
Given the depth of the networks used in models such as ELMo and BERT, complex inter-parameter structure arises, but the latent semantic patterns that describe physical commonsense are much weaker than more superficial patterns that arise due to grammar or domain

Abstract:

Humans understand language based on the rich background knowledge about how the physical world works, which in turn allows us to reason about the physical world through language. In addition to the properties of objects (e.g., boats require fuel) and their affordances, i.e., the actions that are applicable to them (e.g., boats can be dr...More

Code:

Data:

0
Your rating :
0

 

Tags
Comments