Katerina Pastra

Katerina Pastra

Katerina Pastra is the Director of the Cognitive Systems Research Institute, a Senior Researcher at the Institute for Language and Speech Processing, ATHENA Research Center and a Visiting Associate Professor at the University of Plymouth, U.K. She has coordinated a number of  European and national research and development projects, including POETICON++ (FP7-ICT), its predecessor POETICON (FP7-ICT) and a distinguishing Latsis Foundation award for research on “Image-Language Dialectics”. Her research is focused on the computational integration of language, perception and action based on experimental findings from neuroscience. Among others, she has developed the first ‘Minimalist Grammar of Action’, the PRAXICON semantic memory model, the PLT affordances network and the COSMOROE image-language semantic interplay framework. 

Katerina holds a BA in Linguistics (University of Athens, Greece), an MSc in Machine Translation (UMIST, UK) and a PhD in Artificial Intelligence (University of Sheffield, U.K.) in which she explored the integration of vision and language within artificial agents engaged in everyday interaction.  She has worked on information extraction and automatic text-based image/video indexing and retrieval in a number of projects (CONCERTO/IST, SOCIS/EPSRC, REVEAL THIS/IST). She has lectured on Human-Computer/Human-Robot Interaction and the use of cognitive and psychological methods in software engineering (University of Sheffield) and has organised international workshops on image-language association with sponsorships from GOOGLE, the EU-Cognition Network and other international foundations. She is the author of a number of publications on the above topics, one of which has won a distinction by the British Computer Society. She is a Senior IEEE Member, the vice-chair of the European Network on Vision and Language Integration, and co-editor of the Language and Cognition Research Topic in Frontiers in Robotics and Artificial Intelligence.


Conference Proceedings

Moens, M. - F. , Pastra, K. , Saenko, K. , & Tuytelaars, T. . (2018). Vision and Language Integration Meets Multimedia Fusion. IEEE MultiMedia. presented at the 04/2018. https://www.computer.org/csdl/magazine/mu/2018/02/mmu2018020007/13rRUwjGoIk
Moens, M. - F. , Pastra, K. , Saenko, K. , & Tuytelaars, T. . (2016). Vision and Language Integration Meets Multimedia Fusion: Proceedings of ACM Multimedia 2016 Workshop. Proceedings of ACM Multimedia 2016 Workshop. presented at the 10/2016, New York, NY, USA: ACM. https://dl.acm.org/citation.cfm?id=2983563


Pastra, K. , Balta, E. , Dimitrakis, P. , Mpandavanou, E. , & Lada, M. . (2009). Image-Language Dialectics in Greek Caricatures. Research Studies. John Latsis Foundation. http://www.latsis-foundation.org/content/actions/action_342/inline/ell/actionInline_342_555342ebe4c24.pdf

Journal Papers

Zlatintsi, N. , Koutras, P. , Evangelopoulos, G. , Malandrakis, N. , Efthymiou, N. , Pastra, K. , et al. (2017). COGNIMUSE: a multimodal video database annotated with saliency, events, semantics and emotion with application to summarization. EURASIP Journal on Image and Video Processing, 2017. presented at the 12.
Vatakis, A. , & Pastra, K. . (2016). A multimodal dataset of spontaneous speech and movement production on object affordances. Scientific Data, 3(150078). presented at the 01/2016. http://www.nature.com/articles/sdata201578
Pastra, K. , & Aloimonos, Y. . (2012). The minimalist grammar of action. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 367, 103–117. http://www.csri.gr/files/publications/philoTrans-pastra.pdf
Pastra, K. , & Piperidis, S. . (2006). Video Search: New Challenges in the Pervasive Digital Video Era. Journal of Virtual Reality and Broadcasting, 3. http://www.csri.gr/files/publications/videoSearch-pastra.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2003). Extracting Relational Facts for Indexing and Retrieval of Crime-Scene Photographs. Knowledge-Based Systems, 16, 313–320. http://www.csri.gr/files/publications/BSAI02-pastra.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2003). Intelligent indexing of crime scene photographs. Intelligent Systems, IEEE, 18, 55–61. http://www.csri.gr/files/publications/IEEE-pastra.pdf

Book Chapters

Kavouras, M. , Kokla, M. , Tomai, E. , Darra, A. , & Pastra, K. . (2016). GEOTHNK: A Semantic Approach to Spatial Thinking. In Progress in Cartography: EuroCarto 2015 (pp. 319–338). Springer. http://www.csri.gr/files/publications/Kavouras_etal2016.pdf
Pastra, K. . (2014). Beware..of the Label!. In Newsletter on Autonomous Mental Development (Vol. 11). IEEE Computational Intelligence Society. http://www.cse.msu.edu/amdtc/amdnl/AMDNL-V11-N1.pdf
Pastra, K. . (2013). Autonomous Acquisition of Sensorimotor Experiences: Any Role for Language?. In Newsletter on Autonomous Mental Development (Vol. 10). IEEE Computational Intelligence Society. http://www.cse.msu.edu/amdtc/amdnl/AMDNL-V11-N1.pdf
Pastra, K. . (2010). From Lexicon to PRAXICON: language-action-image semantic relations. In Conversations on Language and Action (pp. 143–172). Synapsis Publishers.
Pastra, K. . (2006). An alternative suggestion for vision-language integration in intelligent agents. In G. Antoniou (Ed.), Advances in Artificial Intelligence (pp. 588–591). Springer Berlin Heidelberg. http://www.csri.gr/files/publications/SETN06-pastra.pdf


Aloimonos, Y. , Fermueller, C. , Yang, Y. , Li, Y. , & Pastra, K. . (2015). Patent: Learning Manipulation Actions from Unconstrained Videos.

Conference Papers

Zlatintsi, A. , Koutras, P. , Efthymiou, N. , Maragos, P. , Potamianos, A. , & Pastra, K. . (2015). Quality Evaluation of Computational Models for Movie Summarization. In Seventh International Workshop on Quality of Multimedia Experience, QoMEX 2015. Pilos, Messinia, Greece. http://www.csri.gr/files/publications/ZlatintsiEtAl_MovieSumEval-QoMEX2015_cr.pdf
Efstathiou, V. , & Pastra, K. . (2015). Early language acquisition: an enactive cognition analysis on CDI understanding scores of infants aged 8-18 months. In Workshop on Extensive and Intensive Recordings of Children's Language Environment. http://www.csri.gr/files/publications/WEIRCLE-abstract.pdf
Kavouras, M. , Sotiriou, S. , Baglatzi, A. , Darra, N. , Kokla, M. , Lazoudis, A. , et al. (2014). Semantic Pathways for Geospatial Thinking. In International Conference on Learning Innovations and Learning Quality (LINQ). https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/LINQ_2014_Proceedings_final.pdf#page=100
Vatakis, A. , Pastra, K. , & Dimitrakis, P. . (2014). Acquisition of object knowledge through Exploratory Acts. In 15th International Multisensory Research Forum (IMRF).
Veskos, P. , & Pastra, K. . (2014). Perspectives of Robot Action Generalisation: Challenges and Achievements. In International IEEE Workshop on Autonomous Cognitive Robotics. Stirling, UK. http://www.csri.gr/files/publications/AutonCogRob2014.cameraready.pdf
Pastra, K. , Balta, E. , Dimitrakis, P. , & Karakatsiotis, G. . (2011). Embodied Language Processing: A New Generation of Language Technology. In Language-Action Tools for Cognitive Artificial Agents. http://www.csri.gr/files/publications/EmboLa-pastra.pdf
Wallraven, C. , Schultze, M. , Mohler, B. , Vatakis, A. , & Pastra, K. . (2011). The POETICON enacted scenario corpus –- A tool for human and computational experiments on action understanding. In IEEE International Conference on Automatic Face Gesture Recognition (FG 2011) (pp. 484–491). presented at the March, IEEE. http://poeticoncorpus.kyb.tuebingen.mpg.de/pub/fg2011.pdf
Pastra, K. , Wallraven, C. , Schultze, M. , Vatakis, A. , & Kaulard, K. . (2010). The POETICON Corpus: Capturing Language Use and Sensorimotor Experience in Everyday Interaction. In 7th International Conference on Language Resources and Evaluation (LREC). http://www.csri.gr/files/publications/lrec10.pdf
Wallraven, C. , Schultze, M. , Mohler, B. , Volkova, E. , Alexandrova, I. , Vatakis, A. , & Pastra, K. . (2010). Understanding Objects and Actions - A VR Experiment. In Joint Virtual Reality Conference of EuroVR - EGVE - VEC (2010). The Eurographics Association. http://www.kyb.mpg.de/fileadmin/user_upload/files/publications/2011/JVRC-2010-Wallraven.pdf
Pastra, K. , Dimitrakis, P. , Balta, E. , & Karakatsiotis, G. . (2010). PRAXICON and its language-related modules. In Proceedings of companion volume of the 6th Hellenic conference on artificial intelligence (SETN) (pp. 27–32). http://www.csri.gr/files/publications/SETN10-pastra.pdf
Pastra, K. , & Balta, E. . (2009). A text-based search interface for Multimedia Dialectics. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics: Demonstrations Session (pp. 53–56). Association for Computational Linguistics. http://www.csri.gr/files/publications/EACL09-pastra.pdf
Pastra, K. . (2008). PRAXICON: the development of a grounding resource. In Proceedings of the International Workshop on Human-Computer Conversation. Bellagio, Italy. http://www.csri.gr/files/publications/Bellagio08_pastra.pdf
Piperidis, S. , Papageorgiou, H. , Pastra, K. , Netousek, T. , Gaussier, E. , Tuytelaars, T. , et al. (2006). Multimedia Content Processing and Retrieval in the REVEAL THIS Setting. In 2nd International Conference on Semantic Annotation and Multimedia Technologies (SAMT). http://www.csri.gr/files/publications/samt06.pdf
Pastra, K. . (2006). Image-Language Association: are we looking at the right features?. In OntoImage Workshop on Language Resources for Content-based Image Retrieval, Language Resources and Evaluation Conference (LREC). http://www.csri.gr/files/publications/LREC06wsh-pastra.pdf
Pastra, K. . (2006). Beyond multimedia integration: corpora and annotations for cross-media decision mechanisms. In Proceedings of the 5th Language Resources and Evaluation Conference (LREC) (pp. 499–504). http://www.csri.gr/files/publications/LREC06-pastra.pdf
Pastra, K. , & Piperidis, S. . (2006). Crossing-Media for Video Search: enabling usability beyond traditional broadcast and TV. In Proceedings of the 4th European Interactive TV Conference (pp. 25–26). http://www.csri.gr/files/publications/EuroITV06-pastra.pdf
Pastra, K. , & Wilks, Y. . (2004). Image-Language Multimodal Corpora: needs, lacunae and an AI synergy for annotation. In Proceedings of the 4th Language Resources and Evaluation Conference (pp. 767–770). http://www.csri.gr/files/publications/LREC04-pastra.pdf
Pastra, K. , & Wilks, Y. . (2004). Vision-Language Integration in AI: a reality check. In Proceedings of the 16th European Conference in Artificial Intelligence (Vol. 16, pp. 937–941). http://www.csri.gr/files/publications/ECAI04-pastra.pdf
Pastra, K. . (2004). Viewing Vision-Language Integration as a Double-Grounding Case. In Proceedings of the AAAI Fall Symposium on "Achieving Human-Level Intelligence through Integrated Systems and Research" (pp. 62–67). http://www.csri.gr/files/publications/AAAI04-pastra.pdf
Pastra, K. , & Saggion, H. . (2003). Colouring summaries BLEU. In Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable? (pp. 35–42). Association for Computational Linguistics. http://www.csri.gr/files/publications/EACL03wsh-pastra.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2003). NLP for Indexing and Retrieval of Captioned Photographs. In Proceedings of the Tenth Conference on European Chapter of the Association for Computational Linguistics - Volume 2 (pp. 143–146). Stroudsburg, PA, USA: Association for Computational Linguistics. http://dx.doi.org/10.3115/1067737.1067769
Pastra, K. , Maynard, D. , Hamza, O. , Cunningham, H. , & Wilks, Y. . (2002). How feasible is the reuse of grammars for Named Entity Recognition?. In 3rd International Conference on Language Resources and Evaluation (LREC) (pp. 1412–1418). Canary Islands, Spain. http://www.csri.gr/files/publications/LREC02-pastra.pdf
Pastra, K. , & Saggion, H. . (2001). The language at the scene of the crime -Analysing Crime-Scene reports. In 5th Biennial Meeting of the International Association of Forensic Linguistics. Valetta, Malta.


Pastra, K. , Balta, E. , & Dimitrakis, P. . (2015). COSMOROE Annotated Data Corpus. Athens: Cognitive Systems Research Institute. http://csri.gr/downloads/CMR
Pastra, K. , Balta, E. , & Dimitrakis, P. . (2015). COSMOROE Language-Visual Element Parallel Corpus. Athens: Cognitive Systems Research Institute. http://csri.gr/downloads/CMR

Technical Reports

Pastra, K. . (2015). COSMOROE Annotation Guide. Athens, Greece: Cognitive Systems Research Institute. http://www.csri.gr/files/publications/CSRI-TRS1-20150201.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2001). Socis: Scene of crime information system. University of Sheffield. http://www.computing.surrey.ac.uk/ai/socis/

PhD Theses

Pastra, K. . (2005). Vision-Language Integration: a Double-Grounding Case. University of Sheffield.

Master Theses

Pastra, K. . (2000). Basic Semantic Element Extraction: the rule-writing experience. University of Manchester Institute of Science and Technology (UMIST), Manchester, U.K. http://www.csri.gr/files/publications/Dissertation_pastra_2000.pdf
Pastra, K. . (1999). The Language of Caricature: Language and Drawing interaction. Department of Greek Philology and Linguistics, University of Athens.