Research

My scientific interests include multimodal dialogue, paralinguistic components of communication, perception of prosody in multimodal context, prosody in speech and music, and some other topics that can be identified (or not) below in the list of my publications and projects.

Current projects:

  • MuMoStance: Multimodal Stancetaking: Expressive Movement and Affective Stance. Political Debates in German Bundestag and Polish Sejm (Head of the AMU Poznań team; project in collaboration with Prof. Cornelia Mueller and her team at EUV).

Past/finished projects:

  • COLING: Minority Languages, Major Opportunities, Collaborative Research, Community Engagement and Innovative Educational Tools (member of the project team)
  • Cyfrowa infrastruktura badawcza dla humanistyki i nauk o sztuce DARIAH-PL (POIR) (Digital research infrastructure for humanities and art studies DARIAH-PL) (co-ordinator of the MultiCo Multimodal Corpus of Polish Language team)
  • NeuroPerKog: Development of the phonematic hearing and working memory in infants and children (Head of the AMU Poznań Team).
  • Borderland: Language of boundaries – boundaries of language. Paralinguistic aspects of intercultural communication. An NPRH-funded research project (Head of the Project)
  • PAGE: Prosodic and gestural entrainment in conversational interaction across diverse languages (Principal Investigator; project funded by Volkswagen Stiftung, project co-ordinator: Jonathan Harrington);
  • Linguistic Heritage of Rzeczpospolita: Database of Endangered Languages (led by T. Wicherkiewicz) where I worked on the multimodal data collection and annotation as well as on some suprasegmental analyses.
  • INNET: Innovative Networking in Infrastructure for Endangered Languages (Member of the Polish Team);
  • Acquisition and processing of verbal information in military and police systems for crime and terrorism prevention (led by G. Demenko) where I worked on the role of paralinguistic features in speaker and speaker’s state identification/recognition.
  • DiaGest2: Modelling Dialogue Acts in Task-oriented Dialogues (2009-2010; Head of the Project)
  • Multilingual and Intercultural Database of Gestures (within COST2102 Action, 2008-2009, co-ordinated by Anna Esposito)
  • DiaGest: Speech and Gesture in Task-oriented Dialogues (a pilot study) (2007)
  • Pol’n’Asia: A comparative study of intonation and tone in Korean, Polish, Thai and Vietnamese (based on a quasi-parallel corpus of map task dialogues; Head of the Project)
  • PoInt – Polish Intonational Database (based on read texts, quasi-spontanoues monologues and three types of task-oriented dialogues; Head of the Project)

Publications (for pdfs, go to academia.edu)

Maciej Karpiński, Katarzyna Klessa, Brygida Sawicka-Stępińska, Hanna Kasperek 2023. The prosody of high and low affective engagement in Polish and German parliamentary speeches. In: Radek Skarnitzl & Jan Volín (Eds.), Proceedings of the 20th International Congress of Phonetic Sciences (pp. 1658–1663). Guarant International. ISBN 978-80-908 114-2-3

Karpiński, M. & Jarmołowicz-Nowikow, E. 2023. Dzielenie gestu na czworo. Intuicyjne i eksperckie określanie granic frazy gestowej. [Dividing gesture into four. Intuitive and expert detection of gesture phrase boundaries]. [In:] Przestrzenie komunikacji. Tom jubileuszowy dedykowany Profesor Jolancie Antas. Kraków: Wydawnictwo akademickie, s. 147–164, https://doi.org/10.12797/9788381388351.09

Karpiński, M., Jarmołowicz-Nowikow, E., Klessa, K., Piosik, M., Taborek, J. 2023. DARIAH-PL MultiCo Multimodal Corpus. In: Zygmunt Vetulani i Patrick Paroubek (Eds.) Human Language Technologies as a Challenge for Computer Science and Linguistics, Poznań: Wydawnictwo Naukowe UAM, pp. 136-140, DOI 10.14746/amup.9788323241775

Karpiński, M., Jarmołowicz-Nowikow, E., & Klessa, K. 2022. High-pitched prominences in the speeches of the male Polish members of parliament. Proc. Speech Prosody 2022, 367-371.

Karpiński, M., & Klessa, K. 2021. Linguist in the field: a practical guide to speech data collection, processing, and management. Dąbrówka, Wydawnictwo Rys Tomasz Paluszyński, 110 s., ISBN 978-83-66666-89-4

Karpiński, M., & Klessa, K. 2020. The perception of non-native phonological categories in adult-directed and infant-directed speech: An experimental study. Logopedia Silesiana, 9, p. 1-20. https://doi.org/10.31261/LOGOPEDIASILESIANA.2020.09.13

Karpiński, M., Andreeva, B., Asu, E. L., Daugavet, A., Benuš, Š., and Mády, K. 2020. Central and Eastern Europe. In: C. Gussenhoven & A. Chen (Eds.) The Oxford Handbook of Language Prosody, Oxford: Oxford University Press.

Klessa, K. & Karpiński, M. 2020. Hesitation markers in a corpus of Polish-German,German-German and Polish-Polish task-oriented dialogues in the context of communicative alignment. In: C. Coons, Z.-Ch. Guo, S. Park and E. Wood (Eds.) The Proceedings of 19th Meeting of Texas Linguistic Society, pp. 17-26.

Karpiński, M., Podlipniak, P., Wysocka, M. 2020. Prozodia mowy a muzyka [Speech prosody and music]. In: M. Wysocka, B. Kamińska, and St. Milewski (Eds.) Prozodia – przyswajanie, badanie, zaburzenia, terapia, Gdańsk: Harmonia, pp. 102-122.

Jarmołowicz-Nowikow, E. & Karpiński, M. 2020. Prozodia a gestykulacja [Prosody and gesticulation]. In: M. Wysocka, B. Kamińska, and St. Milewski (Eds.) Prozodia – przyswajanie, badanie, zaburzenia, terapia, Gdańsk: Harmonia, pp. 88-101.

Klessa, K., Karpiński, M., & Bigi, B. (2019, May). Annotation and annotation mining tools for analyzing speech prosody in the Polish-German Borderland database. In 9th Language & Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics (pp. 15-16). [long abstract]

Karpiński, M. & Klessa, K. 2018. Methods, Tools and Techniques for Multimodal Analysis of Accommodation in Intercultural Communication, CMST 24(1), pp. 29–41. DOI:10.12921/cmst.2018.0000006

Klessa, K., Karpiński, M. (2018) Speaking style variation in laboratory speech: A perception study. Proc. 9th International Conference on Speech Prosody 2018, 517-521, DOI: 10.21437/SpeechProsody.2018-105.

Karpiński, M., Czoska, A., Jarmołowicz-Nowikow, E., Juszczyk, K., & Klessa, K. (2018). Aspects of gestural alignment in task-oriented dialogues. Cognitive Studies | Études cognitives, 2018(18). https://doi.org/10.11649/cs.1640

Gorzelańczyk EJ, Podlipniak P, Walecki P, Karpiński M and Tarnowska E (2017). Pitch syntax violations are linked to greater skin conductance changes, relative to timbral violations – the predictive role of the reward system in perspective of cortico-subcortical loops. Front. Psychol. 8:586.

Karpiński, M. 2016. Dimensions of intonation. Wiktor Jassem’s contribution to the studies on the melody of speech. Lingua Posnaniensis, vol. 58 no. 1, pp. 25-38.

Podlipniak, P., Karpiński, M., Walecki, P., Tarnowska, E., Gorzelańczyk, E.J. 2016. Bodźce mowne i muzyczne w badaniach osób uzależnionych. Episteme, no. 31 vol. 2, pp. 87-110.

Czoska, A., Klessa, K., Karpiński, M., Jarmołowicz-Nowikow, E. 2015. Prosody and gesture in dialogue: Cross-modal interactions. Proceedings of GESPIN 2015 Conference, Nantes, France.

Karpiński, M., Jarmołowicz-Nowikow, E., Czoska, A. 2015. Gesture annotation scheme development and application for entrainment analysis in task-oriented dialogues in diverse cultures. Proceedings of GESPIN 2015 Conference, Nantes, France.

Czoska, A., Klessa, K., Karpiński, M. 2015. Polish Infant Directed vs. Adult Directed Speech Selected Acoustic-Phonetic Differences. Proceedings of the 18th International Congress of Phonetic Sciences, Glasgow, UK.

Karpinski, M. 2014. New challenges in psycholinguistics: Interactivity and alignment in interpersonal communication. Lingua Posnaniensis, vol. 54, issue 1, pp. 97-106.

Bonacchi, S. & Karpiński, M. 2014. Remarks about the use of the term “multimodality”. Journal of Multimodal Communication Studies, vol 1, pp. 1-7.

Karpinski, M., Klessa, K., Czoska, A. 2014. Local and global convergence in the temporal domain in Polish task‑oriented dialogue. [In:] N. Campbell, D. Gibbon, and D. Hirst (Eds.) Speech Prosody 7, 2014, Dublin, pp. 743-747. ISSN 2333-2042

Nicole, N., Michael, M., Karpiński, M., Klessa, K., Wicherkiewicz, T., Wójtowicz, R. 2014. Języki w niebezpieczeństwie: księga wiedzy. (wydanie internetowe)

Nicole, N., Michael, M., Karpiński, M., Klessa, K., Wicherkiewicz, T., Wójtowicz, R. 2014. Languages in Danger: Book of Knowledge (web edition)

Klessa, K., Karpiński, M., Wagner, A. 2013. Annotation Pro – a new software tool for annotation of linguistic and paralinguistic features [forthcoming in:] Proceedings of TRASP: Tools and Resources for the Analysis of Speech Prosody, a satellite event for Interspeech 2013, Aix-en-Provence.

Klessa, K., Wagner, A., Oleśkowicz-Popiel, M., Karpiński, M. 2013. Paralingua – a new speech corpus for the studies of paralinguistic features. Procedia – Social and Behavioral Science. Elsevier ISSN: 1877-0428

Karpiński, M. 2013. О дискурс-аналитической практике (пер. с англ. Т.И. Свищук, Е.В. Савич) [w:] Le Table Ronde, БГ У, ISSN 2218-8002.

Karpiński, M. 2013. Acoustic Features of Filled Pauses in Polish Task-Oriented Dialogues. Archives of Acoustics, vol. 38, pp. 63-73.

Karpiński, M. Szalkowska-Kim, E 2012. On Intonation of Korean and Polish Questions. Speech and Language Technology, vol. 14/15, pp. 137-148.

Karpiński, M. 2012. The Boundaries of Language: Dealing with Paralinguistic Features. Lingua Posnaniensis, vol. LIV (2)/2012. PL ISSN 0079-4740, ISBN 978-83-7654-252-2, pp. 37-54.

Karpiński, M.  2012. Language in Action: The review of: Reinterpreting Gesture as Language “in Action”, Avant, vol. 3(1), pp. 403—417, ISSN: 2082-6710.

Karpiński, M. 2011/12. Acoustic properties and functions of phrase-final rises in Polish task-oriented dialogues. [in:] Ed. D. Gibbon, N. Campbell & D. Hirst (Eds.) Speech and Language Technology Special Issue: Festschrift for Prof. Wiktor Jassem, vol. 14/15, pp. 147-156.

Jarmołowicz-Nowikow, E. & Karpiński, M. 2011. Communicative intentions behind pointing gestures in task-oriented dialogues. [in:] P. Wagner, Z. Malisz, C. Kirchhof (Eds.) Proceedings of GESPIN 2011: Gesture and Speech in Interaction Conference.

Szczyszek, M., Karpiński, M. 2010. Jakościowa i ilościowa analiza słownictwa oraz jednostek quasi- i nieleksykalnych wypowiedzi w dialogach zadaniowych „origami”. Investigationes Linguisticae, vol. XXII, pp. 139-156.

Klessa, K., Karpiński, M., Bałdys, O., Demenko, G. 2009/2010. Architecture for Creating and Development of Lexical  Databases for Speech Technology. Speech and Language Technology , vol. 12/13.

Karpiński, M., Jarmołowicz-Nowikow, E. 2010. Prosodic and Gestural Features of Phrase-internal Disfluencies in Polish Spontaneous Utterances. Proceedings of Speech Prosody 2010, Chicago.

Malisz, Z. & Karpiński, M. 2010. Multimodal Aspects of Positive and Negative Responses in Polish Task-oriented Dialogues. Proceedings of Speech Prosody 2010, Chicago.

Karpiński, M. 2009. From Speech and Gestures to Dialogue Acts. [In:] A. Esposito, A. Hussain, M. Marinaro, R. Martone (Eds.) Multimodal Signals: Cognitive and Algorithmic Issues, Springer LNAI Series 5398, pp. 164-169.

Karpiński, M. 2009. Preliminary Prosodic and Gestural Characteristics of Instructing Acts in Polish Task-Oriented Dialogues [In:] A. Esposito and R. Vích (Eds.): Cross-Modal Analysis of Communication, Springer LNAI Series 5641, pp. 227–238.

Karpiński, M., Jarmołowicz-Nowikow, E., Malisz, Z., Szczyszek, M., Juszczyk, K. 2010. Rejestracja, transkrypcja i tagowanie mowy oraz gestów w narracji dzieci i dorosłych (Recording and transcription of speech and gesture in the narration of Polish adults and children), Investigationes Linguisticae, vol. XVI, pp. 83-98.

Karpiński, M., Jarmołowicz-Nowikow, E. & Malisz, Z. 2008. Aspects of Gestural and Prosodic Structure of Multimodal Utterances in Polish Task-oriented Dialogues. [In:] G. Demenko, K. Jassem, St. Szpakowicz (Eds.) Speech and Language Technology, vol. XI, pp. 113-122.

Kleśta, J., Karpiński, M. 2006/2007. Disfluences in Polish and Thai task-oriented dialogues. Proceedings of Speech Signal Annotation, Processing and Synthesis Conference, September 2006, Poznań.

Jarmołowicz, E., Karpiński, M., Malisz, Z., Szczyszek, M. 2007. Gesture, Prosody and Lexicon in Task-oriented Dialogues: Multimedia Corpus Recording and Labelling. [w:] Verbal and Nonverbal Communication Behaviours, LNAI 4775, Berlin: Springer Verlag, str. 99-110.

Karpiński, M. 2007. The Intonational Realization of Requests in Polish Task-Oriented Dialogues. [w:] V.Matousek, P. Mautner et al. (red.) Text, Speech and Dialogue, Plzen. LNAI 4629, str. 556-563.

Karpiński, M. 2007. Selected quasi-lexical and non-lexical units in Polish map task dialogues, Archives of Acoustics, 32, 1, str. 51-65.

Karpiński, M. (editor) and co-author (with K. Juszczyk J. Kleśta, E. Szalkowska and M. Włodarczak) 2007. Pol’n’Asia Corpus of Korean, Polish, Thai and Vietnamese Map Task Dialogues. Poznań: Institute of Linguistics AMU. ISBN 978-83-926446-0-6.

Karpiński, M. (editor) and co-author (with K. Juszczyk J. Kleśta, E. Szalkowska and M. Włodarczak) 2007. A Brief Guide to Intonation and Tone in Korean, Polish, Thai and Vietnamese Dialogues.  Poznań: Institute of Linguistics AMU. ISBN 978-83-926446-1-3.

Karpiński, M., Juszczyk, K., Kleśta, J., Szalkowska, E., Włodarczak, M. 2007. Categorization and Labelling of Dialogue Acts in Pol’n’Asia Project (extended abstract in PLM 2007 Book of Abstracts).

Karpiński, M., Jarmołowicz, E., Malisz, Z., Szczyszk, M. 2007. Gesture, Prosody and Lexicon in Task-oriented Dialogues: Progress Report. (extended abstract in PLM 2007 Book of Abstracts).

Karpiński, M. 2006. Struktura i intonacja polskiego dialogu zadaniowego. Poznań: Wydawnictwo Naukowe UAM, ISBN 83-232-1662-2.

Karpiński, M., Kleśta, J., Szalkowska, E. 2006. Non- and Quasi-lexical Realizations of “Positive Response” in Korean, Polish and Thai. Proceedings of Speech Prosody 2006 Conference, Dresden.

Karpiński, M. 2005. The form and function of selected non-lexical and quasi-lexical units in Polish map task dialogues. Proceedings of SASR Conference, Kraków.

Francuzik, K., Karpiński, M., Kleśta, J., Szalkowska, E. 2004. Nuclear Melody in Polish Semi-spontaneous and Read Speech; Evidence from the Polish Intonational Database PoInt. Studia Phonetica Posnaniensia, str. 97–128.

Karpiński, M. 2004. Segmentacja, transkrypcja i anotacja dialogu zadaniowego. [w:] G. Demenko, M. Karpiński (red.) Speech and Language Technology, vol. VIII.

Karpiński, M. & Kleśta, J. 2004. Interphrase Pause Realization Rules for the Purpose of High Quality Polish Speech Synthesis [in:] Proceedings of SASR Workshop in Szczyrk.

Grabe, E. & Karpiński, M. 2003. Universal and Language-specific Aspects of Intonation in English and Polish. [w:] E. Grabe i D. G. S. Wright: Oxford University Working Papers in Linguistics, Philology & Phonetics, vol. 8.

Karpiński, M., Baranowska, E., Francuzik, K., Kleśta, J. 2003. Identification of Nuclear Melody Placement in Polish Read Texts [w:] A. Mettouchi i G. Ferre (red.) Interfaces Prosodiques, Nantes.

Grabe, E. & Karpiński, M. 2003. Universal and language-specific aspects of intonation in English and Polish. M. J. Sole, D. Recasens i J. Romero (red.) The Proceedings of ICPhS 2003. Barcelona.

Baranowska, E., Francuzik, K., Karpiński, M., Kleśta, J. 2003. Determining Phrase Boundaries in Written Texts for the Purpose of Polish Speech  Synthesis. [w:] Speech and Language Technology, vol. VII, Poznań: Polskie Towarzystwo Fonetyczne.

Karpiński, M. 2002: POLENG: Polish-English Machine Translation (a review). CEEC EUROMAP Newsletter, Issue 2, December.

Karpiński, M. 2002. Szukając partnera do rozmowy. Computerworld Polska, No 37.

Karpiński, M. 2002. The Corpus of the Polish Intonational Database: Technical Specifications. Investigationes Linguisticae, vol. VIII.

Francuzik, K., Karpiński, M., Kleśta, J. 2002. A Preliminary Study of the Intonational Phrase, Nuclear Melody and Pauses in Polish Semi-Spontaneous Narration. Speech Prosody 2002 Proceedings. Aix-en-Provence.

Karpiński, M. 2001. Humor as a means of stratifying the web community. Stylistyka, vol. X, Uniwersytet Opolski.

Karpiński, M. &  Kleśta, J. 2001. The Project of Intonational Database for the Polish Language [w:] St. Puppel, G. Demenko (red.), Prosody 2000. Poznań: Faculty of Modern Languages and Literature, UAM.

Karpiński, M. 2001. The prosodic expression of surprise and astonishment in jokes: A listening task. [w:] St. Puppel, G. Demenko (red.) Prosody 2000. Poznań: Faculty of Modern Languages and Literature, UAM.

Karpiński, M. 2000. Prozodyczne wykładniki zaskoczenia i zdziwienia w narracji dowcipów. [w:] St. Gajda, D. Brzozowska (red.): Świat Humoru, Uniwersytet Opolski.

Karpiński, M. 2000. Speech Technology in Poland. Proceedings of WERA Workshop. Technical University of Cluj: Cluj-Napoca.

Karpiński, M. 1999. Operowanie środkami fonetycznymi w wypowiedziach skierowanych do komputera [w:] W. Jassem, Cz. Basztura, G. Demenko, K. Jassem (red.) Speech and Language Technology, vol. III, Poznań: Polskie Towarzystwo Fonetyczne.

Karpiński, M. 1999. Badania dyskursu a komunikacja człowiek-komputer, Investigationes Linguisticae, vol. VII. Instytut Językoznawstwa UAM.

Karpiński, M. 1998: Coherence and redundancy in human-computer communication. The Proceedings of Speech and Hearing Conference, Windermere.

Karpiński, M. 1998. Psycholingwistyczne aspekty komunikacji człowiek-komputer. (niepublikowana rozprawa doktorska, dostępna w Bibliotece Uniwersyteckiej w Poznaniu).

Karpiński, M. 1997. Conversational Devices in Human-Computer Communication Using WIMP UI. [w:] R. Murawski, J. Pogonowski (red.) Euphony and Logos. Amsterdam – Atlanta: Rodopi, str. 245 – 362.

Karpiński, M. 1995. Kohortalna struktura leksykonu umysłowego użytkownika języka polskiego. Weryfikacja hipotezy Marslena-Wilsona. [w:] J. Pogonowski (red.) Eufonia i Logos. Poznań: Wydawnictwo Naukowe UAM.

Karpiński, M. 1993. Z historii badań indologicznych na Uniwersytecie im. Adama Mickiewicza w Poznaniu. Acta Universitatis Wratislaviensis, No 1465, vol. XVI, str. 55 – 60.