Visual Heuristics for Verb Production: Testing a Deep‐Learning Model With Experiments in Japanese

Cognitive Science 47 (8):e13324 (2023)
  Copy   BIBTEX

Abstract

Tense/aspect morphology on verbs is often thought to depend on event features like telicity, but it is not known how speakers identify these features in visual scenes. To examine this question, we asked Japanese speakers to describe computer‐generated animations of simple actions with variation in visual features related to telicity. Experiments with adults and children found that they could use goal information in the animations to select appropriate past and progressive verb forms. They also produced a large number of different verb forms. To explain these findings, a deep‐learning model of verb production from visual input was created that could produce a human‐like distribution of verb forms. It was able to use visual cues to select appropriate tense/aspect morphology. The model predicted that video duration would be related to verb complexity, and past tense production would increase when it received the endpoint as input. These predictions were confirmed in a third study with Japanese adults. This work suggests that verb production could be tightly linked to visual heuristics that support the understanding of events.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,475

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Gender Prediction from Retinal Fundus Using Deep Learning.Ashraf M. Taha, Qasem M. M. Zarandah, Bassem S. Abu-Nasser, Zakaria K. D. AlKayyali & Samy S. Abu-Naser - 2022 - International Journal of Academic Information Systems Research (IJAISR) 6 (5):57-63.
Classification of Real and Fake Human Faces Using Deep Learning.Fatima Maher Salman & Samy S. Abu-Naser - 2022 - International Journal of Academic Engineering Research (IJAER) 6 (3):1-14.
Testing Sripada's Deep Self model.Florian Cova & Hichem Naar - 2012 - Philosophical Psychology 25 (5):647 - 659.
Diagnosis of Pneumonia Using Deep Learning.Alaa M. A. Barhoom & Samy S. Abu-Naser - 2022 - International Journal of Academic Engineering Research (IJAER) 6 (2):48-68.

Analytics

Added to PP
2023-08-01

Downloads
12 (#1,075,977)

6 months
8 (#350,876)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Citations of this work

No citations found.

Add more citations

References found in this work

Finding Structure in Time.Jeffrey L. Elman - 1990 - Cognitive Science 14 (2):179-211.
Linguistics in Philosophy.Zeno Vendler - 1967 - Ithaca, N.Y.,: Cornell University Press.
From “thought and language” to “thinking for speaking”.Dan I. Slobin - 1996 - In J. Gumperz & S. Levinson (eds.), Rethinking Linguistic Relativity. Cambridge University Press. pp. 70--96.
On the psychophysical law.S. S. Stevens - 1957 - Psychological Review 64 (3):153-181.

View all 22 references / Add more references