Dr Jessica Korte

Honorary Senior Res Fellow

School of Electrical Engineering and Computer Science
Faculty of Engineering, Architecture and Information Technology

Overview

Dr Jessica Korte is passionate about the ways good technology can improve lives. To ensure technology is “good”, she advocates involving end users in the design process; especially when those people belong to “difficult” user groups - which usually translates to “minority” user groups. Her philosophy for technology design (and life in general) is that the needs of people who are disempowered or disabled by society should be considered first; everyone else will then benefit from technology that maximises usability. Her research areas include Human-Computer Interaction, Machine Learning, and Participatory & Collaborative Design.

Jessica was drawn to research by a desire to explore some of the ways technology and design can empower and support people from marginalised groups. She has worked with Deaf children and members of the Deaf community to create a technology design approach, and successfully organised and run international workshops on Pushing the Boundaries of Participatory Design, leading to the World’s Most Inclusive Distributed Participatory Design Project.

Jessica has recently been awarded a TAS DCRC Fellowship to create an Auslan Communication Technologies Pipeline, a modular, AI-based Auslan-in, Auslan-out system capable of recognising, processing and producing Auslan signing.

Jessica is currently looking to recruit research students with an interest in exploring topics in an Auslan context, including machine learning, natural language processing, chatbots, video GAN, or procedural animation.

Research Interests

  • Auslan Communication Technologies Pipeline
    Sign language recognition, human-like artificial sign production, sign language processing
  • Human-Computer Interaction (HCI) / Computer-Human Interaction
    The many ways humans interact with and use technologies.
  • Collaborative Design / Participatory Design / Co-Design
    Designing with, rather than for, the users of a new technology means that technology should be better suited to the users' needs, abilities and expectations. I am particularly interested in co-design with children and marginalised groups.
  • Design with Deaf children
    There is relatively little educational technology designed for young Deaf children and their families. By undertaking collaborative design with Deaf children, their families and educators, my research can create technologies to assist with early learning.
  • Women in STEM
    Women remain under-represented in STEM fields.

Research Impacts

Working with members of marginalised groups in the design of new technologies helps to ensure the technologies created address the needs, expectations and abilites of members of that group. This can in turn support their involvement and empowerment in every day life.

Research (including my own) has shown that children benefit from involvement in collaborative design activities. Such benefits can include increased language skills, increased confidence, improved teamworking skills and increased technological skills.

Qualifications

  • Doctor of Philosophy, Griffith University
  • Bachelor (Honours) of Information Technology, Griffith University

Publications

  • Zelenskaya, Maria, Whittington, Scott, Lyons, Julie, Vogel, Adele and Korte, Jessica (2023). Visual-gestural Interface for Auslan Virtual Assistant. New York, NY, USA: ACM. doi: 10.1145/3610541.3614566

  • Vithanage, Shashindi, Dey, Arindam and Korte, Jessica (2023). 'Auslan Alexa': A case study of VR Wizard of Oz prototyping for requirements elicitation with Deaf participants. 30th IEEE Conference Virtual Reality and 3D User Interfaces (IEEE VR), Shanghai, China, 25-29 March 2023. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers.. doi: 10.1109/VRW58643.2023.00298

  • Korte, Jessica, Sim, Gavin, Constantin, Aurora, Eriksson, Eva, Fails, Jerry Alan, Alexandru, Cristina Adriana, Read, Janet C. and Wilson, Cara (2023). Editorial: pushing the boundaries of Participatory Design with children. International Journal of Child-Computer Interaction, 35 100547, 1-3. doi: 10.1016/j.ijcci.2022.100547

View all Publications

Available Projects

  • A machine learning project to recognise Auslan signing.

  • An AI approach to video segmentation, using the entropy of movement to identify signs and sign segements in Auslan video and live stream.

  • Applying natural language processing techniques to Auslan

View all Available Projects

Publications

Journal Article

Conference Publication

  • Zelenskaya, Maria, Whittington, Scott, Lyons, Julie, Vogel, Adele and Korte, Jessica (2023). Visual-gestural Interface for Auslan Virtual Assistant. New York, NY, USA: ACM. doi: 10.1145/3610541.3614566

  • Vithanage, Shashindi, Dey, Arindam and Korte, Jessica (2023). 'Auslan Alexa': A case study of VR Wizard of Oz prototyping for requirements elicitation with Deaf participants. 30th IEEE Conference Virtual Reality and 3D User Interfaces (IEEE VR), Shanghai, China, 25-29 March 2023. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers.. doi: 10.1109/VRW58643.2023.00298

  • Korte, Jessica and Lyons, Julie (2023). What do Deaf people want in a smart assistant?. TEDxUQ, St Lucia, QLD Australia, 13 August 2022. The University of Queensland.

  • Constantin, Aurora, Korte, Jessica, Good, Judith, Sim, Gavin, Read, Janet, Fails, Jerry Alan and Eriksson, Eva (2022). A distributed participatory design research protocol for co-designing with children. IDC '22: Interaction Design and Children, Braga, Portugal, 27-30 June 2022. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3501712.3535286

  • Constantin, Aurora, Andries, Valentina, Korte, Jessica, Alexandru, Cristina Adriana, Good, Judith, Sim, Gavin, Read, Janet, Fails, Jerry Alan and Eriksson, Eva (2022). Ethical considerations of distributed participatory design with children. IDC '22: Interaction Design and Children, Braga, Portugal, 27-30 June 2022. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3501712.3536386

  • Korte, Jessica L., Constantin, Aurora, Wilson, Cara, Alexandru, Cristina Adriana, Sim, Gavin, Read, Janet, Good, Judith, Fails, Jerry Alan and Eriksson, Eva (2021). Participatory design of the world's largest DPD project with children. IDC '21: Interaction Design and Children, Athens, Greece, 24-30 June 2021. New York, NY, USA: Association for Computing Machinery. doi: 10.1145/3459990.3460514

  • Constantin, Aurora, Korte, Jessica, Wilson, Cara, Alexandru, Cristina Adriana, Good, Judith, Sim, Gavin, Read, Janet, Fails, Jerry Alan and Eriksson, Eva (2020). Planning the world's most inclusive PD project. IDC '20: 2020 ACM Interaction Design and Children Conference, London, United Kingdom, June 2020. New York, NY, United States: ACM. doi: 10.1145/3397617.3398066

  • Nguyen, Jameson and Korte, Jessica (2020). Multimodal machine learning for sign language recognition. CoEDL Fest, Brisbane, QLD Australia, 3-6 February 2020. ARC CoEDL.

  • Korte, Jessica, Newton, Jacob, Goel, Rudraksh and Pounds, Pauline (2020). Physical requirements for Auslan robots and avatars: “Handy” hands. CoEDL Fest, Brisbane, QLD Australia, 3-6 February 2020. ARC CoEDL.

  • Korte, Jessica, Bender, Axel, Gallasch, Guy, Wiles, Janet and Back, Andrew (2020). A plan for developing an Auslan communication technologies pipeline. ECCV 2020: Computer Vision – ECCV 2020 Workshops, Glasgow, Scotland, 23–28 August, 2020. Cham, Switzerland: Springer International Publishing. doi: 10.1007/978-3-030-66096-3_19

  • Nguyen, Jameson, Oei, Keyne K. and Korte, Jessica (2019). Real-time machine learning Auslan recognition to promote social robotic interaction. CoEDL Fest, Sydney, NSW Australia, 4-8 February 2019. ARC CoEDL.

  • Constantin, Aurora, Fails, Jerry Alan, Good, Judith, Eriksson, Eva, Korte, Jessica, Alexandru, Cristina Adriana, Mihaela Dragomir,, Pain, Helen, Garzotto, Franca and Waller, Annalu (2019). Expecting the unexpected in participatory design. CHI Conference on Human Factors in Computing Systems (CHI), Glasgow, Scotland, 4-9 May, 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3290607.3311758

  • Korte, Jessica, Constantin, Aurora, Alexandru, Cristina Adriana, Fails, Jerry Alan, Eriksson, Eva, Good, Judith, Pain, Helen, Hourcade, Juan Pablo, Garzotto, Franca and Waller, Annalu (2019). Pushing the boundaries of participatory design. INTERACT 2019, Paphos, Cyprus, 2–6 September, 2019. Cham: Springer International Publishing. doi: 10.1007/978-3-030-29390-1_74

  • Constantin, Aurora, Korte, Jessica, Fails, Jerry Alan, Good, Judith, Alexandru, Cristina Adriana, Dragomir, Mihaela, Pain, Helen, Hourcade, Juan Pablo, Eriksson, Eva, Waller, Annalu and Garzotto, Franca (2019). Pushing the boundaries of participatory design with children with special needs. IDC '19 18th ACM International Conference on Interaction Design and Children, Boise, ID, United States, 12 - 15 June, 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3311927.3325165

  • Constantin, Aurora, Georgiou, Nicholas, Alexandru, Cristina Adriana and Korte, Jessica (2019). S2C2: toward an app to support Social StoryTM comprehension checking in children with ASD. 17th IFIP TC 13 International Conference, Paphos, Cyprus, 2-6 September 2019. Cham, Switzerland: Springer Cham. doi: 10.1007/978-3-030-29381-9_10

  • Korte, Jessica and Thompson, Alexandra (2018). Visual juggling : reflective recommendations for observers working with Deaf children in design research. 30th Australian Conference on Computer-Human Interaction - OzCHI '18, Melbourne, VIC, Australia, 4–7 December 2018. New York, NY United States: ACM Press. doi: 10.1145/3292147.3292198

  • Korte, Jessica, Potter, Leigh Ellen and Nielsen, Sue (2017). How design involvement impacts Deaf children. 2017 International Conference on Research and Innovation in Information Systems (ICRIIS), Langkawi, Malaysia, 16-17 July 2017. Piscataway, NJ United States: IEEE. doi: 10.1109/icriis.2017.8002527

  • Korte, Jessica, Potter, Leigh Ellen and Nielsen, Sue (2017). The impacts of Deaf culture on designing with Deaf children. 29th Australian Conference on Computer-Human Interaction, Brisbane, QLD, Australia, 28 November - 1 December 2017. New York, NY, United States: ACM Press. doi: 10.1145/3152771.3152786

  • Potter, Leigh Ellen, Korte, Jessica and Nielsen, Sue (2014). Design with the Deaf: do Deaf children need their own approach when designing technology?. 2014 Conference on Interaction Design and Children, Aarhus, Denmark, 17-20 June 2014. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2593968.2610464

  • Korte, Jessica, Potter, Leigh Ellen and Nielsen, Sue (2014). Great expectations: what do children expect from their technology?. 52nd ACM Conference on Computers and People Research, Singapore, 29-31 May 2014. New York, NY, United States: ACM. doi: 10.1145/2599990.2600008

  • Korte, Jessica , Potter, Leigh Ellen and Nielsen, Sue (2012). Designing a mobile video game to teach preliterate Deaf children Australian Sign Language (Auslan). British Computer Society Conference on Human-Computer Interaction, Birmingham United Kingdom, 10-14 September 2012. Swindon, United Kingdom: BCS Learning & Development.

  • Potter, Leigh Ellen, Korte, Jessica and Nielsen, Sue (2012). Sign my world: lessons learned from prototyping sessions with young Deaf children. 24th Australian Computer-Human Interaction Conference, Melbourne, VIC, Australia, 26 - 30 November 2012. New York, NY, United States: ACM Press. doi: 10.1145/2414536.2414613

  • Potter, Leigh Ellen, Korte, Jessica and Nielsen, Sue (2011). Seek and sign: an early experience of the joys and challenges of software design with young Deaf children. 23rd Australian Computer-Human Interaction Conference, Canberra, Australia, 28 November - 2 December 2011. New York, NY, United States: ACM Press. doi: 10.1145/2071536.2071577

Other Outputs

Grants (Administered at UQ)

PhD and MPhil Supervision

Possible Research Projects

Note for students: The possible research projects listed on this page may not be comprehensive or up to date. Always feel free to contact the staff for more information, and also with your own research ideas.

  • A machine learning project to recognise Auslan signing.

  • An AI approach to video segmentation, using the entropy of movement to identify signs and sign segements in Auslan video and live stream.

  • Applying natural language processing techniques to Auslan

  • Designing a platform to generate Auslan signs through procedural animation

  • Applying the technology behind DeepFakes to create synthetic Auslan communication