Language. robots. Intelligence

OUR STORY

multisensory perception

embodied language processing

embodied language processing

multimodal cognition

About Us

Welcome to our Language and Robots Lab! Here, Language is explored from within its natural environment,  that of Embodied and Enactive Interaction.  Robots are developed with a human-centric perspective, to assist, interact and contribute to a better world. We embrace the new Generative AI era that has just started, searching though for cognitive ways to make it better.  We believe that the embodied cognition approach can provide a real breakthrough for achieving Artificial General Intelligence; thus, we focus on multimodal, multisensory cognition and the fundamental role of Natural Language.  Join us in this trip for research and development that integrates Language, Perception and Action taking into consideration how the human brain works. Let’s build together the next generation of intelligent agents that can engage into verbal interaction with humans and correlate what they perceive, do and say/hear.

MORE

Research   highlights

The Minimalist Grammar of Action. A formal specification of the structure of action, which employs the Chomskyan generative transformation grammar paradigm and is corroborated by neurobiological evidence. It comprises a set of terminals, features, non-terminals, and a minimal set of production rules in the sensorimotor domain, in which the tool and affected object complements of an action have a primary role. Recursion, merge and move apply not only in human language, but in human action too.

minimalist grammar of action

The PRAXICON Semantic Memory. A dynamic, recursive and referential semantic network with biological basis that aims to address the representation and integration challenges of embodied and enactive cognition. Nodes in the PRAXICON may have a physical or abstract reference pertaining to entities, movements and features with multiple representations (symbolic, perceptual, motoric). Associations are simple or recursive in nature and pertain to a finite set of pragmatic relation types .

PRAXICON Semantic Network

The COSMOROE Cross Modal Relations. A Framework for modeling the semantic interplay between different means of expression, when formulating multimodal messages. Verbal and perceptual representations of objects, agents, movements, gestures, events, and abstract concepts engage into a semantic interplay that ranges from simple one-to-one equivalence relations to forced equivalence (metonymic and metaphoric cases), contradiction, and complementarity.

COSMOROE cross media semantics framework

The Poeticon Lithic Tools Multimodal Object Affordances Dataset. A Nature-published, large scale dataset on object affordances which resulted from a series of naturalistic cognitive experiments. Lithic tools as stimuli and a thinking aloud method elicited 95 hours of spontaneous speech from 120 participants comprising semantic information on object features, affordances and related argumentation (justification, cause etc.) , as well as a rich set of pantomimes, gestures and exploratory acts.

POETICON Lithic Tools Object Affordances Experiments

Snapshots in time

Poeticon Project - the poetics of everyday life

Poeticon++ Project - Robots Need Language

Human-Robot Interaction demos by the POETICON project Series

The Cognitive The Cognitive Systems Research Institute (2011-2021) has now integrated into the Language and Robotics Lab of the Institute for Language and Speech Processing, Athena Research Center.