An Experiential Learning Approach to Learning Manual Communication Through a Virtual Reality Environment

Show simple item record Rho, Edison Chan, Kenney Varoy, Elliot John Giacaman, Nasser 2022-05-17T01:24:30Z 2022-05-17T01:24:30Z 2020-04-20
dc.identifier.citation (2020). IEEE Transactions on Learning Technologies, 13(3), 477-490.
dc.identifier.issn 1939-1382
dc.description.abstract There is a pressing need for effective pedagogical methods of manual languages, as evident in the decline of manual languages, such as New Zealand Sign Language (NZSL). Despite being recognized as one of New Zealand's official languages, recent censuses have shown that fluent NZSL signers have been steadily decreasing. There is a cultural responsibility to preserve such languages, yet the combination of barriers to acquisition and the limited availability of effective teaching methods are standing in the way. In light of this, this article proposes a computer-assisted sign language learning system that incorporates virtual reality and validation-based feedback as tools to implement the experiential learning model. An implementation in the form of virtual reality NZSL is presented, targeting the set of NZSL alphabet. Results show that a vision-based classification method, using the Leap Motion controller, is a scalable, accurate, and usable solution for feedback-assisted manual language learning. A formative usability evaluation of $n=10$ participants showed promising results for engagement, confidence, and memory retention. The results indicate that virtual reality technology is uniquely situated as an innovative medium for the self-directed acquisition of manual languages. It is hoped this article inspires technology researchers to pursue collaborations with the deaf/Deaf community to design and develop pedagogical technology solutions for manual communication.
dc.language English
dc.publisher Institute of Electrical and Electronics Engineers (IEEE)
dc.relation.ispartofseries IEEE Transactions on Learning Technologies
dc.rights Items in ResearchSpace are protected by copyright, with all rights reserved, unless otherwise indicated. Previously published items are made available in accordance with the copyright policy of the publisher.
dc.rights © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
dc.subject Networking and Information Technology R&D
dc.subject Science & Technology
dc.subject Social Sciences
dc.subject Technology
dc.subject Computer Science, Interdisciplinary Applications
dc.subject Education & Educational Research
dc.subject Computer Science
dc.subject Educational technology
dc.subject neural networks
dc.subject sign language
dc.subject virtual reality (VR)
dc.subject LANGUAGE
dc.subject MOTIVATION
dc.subject FRAMEWORK
dc.subject 0806 Information Systems
dc.subject 1005 Communications Technologies
dc.subject 1303 Specialist Studies in Education
dc.title An Experiential Learning Approach to Learning Manual Communication Through a Virtual Reality Environment
dc.type Journal Article
dc.identifier.doi 10.1109/tlt.2020.2988523
pubs.issue 3
pubs.begin-page 477
pubs.volume 13 2022-04-13T09:48:12Z
dc.rights.holder Copyright: IEEE en
pubs.end-page 490
pubs.publication-status Published
dc.rights.accessrights en
pubs.subtype Article
pubs.subtype Journal
pubs.elements-id 818109 Engineering Department of Electrical, Computer and Software Engineering
dc.identifier.eissn 1939-1382
pubs.number 3
pubs.record-created-at-source-date 2022-04-13

Files in this item

Find Full text

This item appears in the following Collection(s)

Show simple item record


Search ResearchSpace