image

Current PhD Students

Image
Jonathan Pigrem

Materiality in Digital Musical Interfaces
Image
Mei Zhang

ETextiles For Fashion Designers
Image
Jianing Zheng

Deformable Digital Musical Instrument Design
Image
Jiali Zhang

VR for Intangible Cultural Heritage
Image
Teo Dannemann

Complex networks to assess music collaboration
Image
Nicole Robson

Exploring Audience Interaction and Engagement with Sound Installation Artworks
Image
Corey Ford

Exploring Reflection and Engagement in Children's Digital Music Composition with AI
Image
Ashley Noel-Hirst

Explainable AI for Music
Image
Shuoyang Zheng

Design and Analysis of Real-Time Visual Explanations for Neural Synthesiser Instruments
Image
Muhan Xu

AI-assisted Academic Reading Tools
Image
Carl Harrison

Experiential Learning in Mixed Reality Gaming
Image
Yijing Yang

Generative AI for User Experience Design
Image
Mengzhi He

Exploring virtual identity through immersive-tech and non-human avatars in digital organic forms
Image
Ziqing Xu

Exploring real-time explainable AI music creation with novice musicians through deformable interfaces

PhD Graduates

Image
Francesco Soave
2023, Supervisor

Exploring how sound and haptics affect movement in Virtual Reality
Image
Anto Daniele
2022, Supervisor

Learning to model expressive gestures from automatic drawing techniques
Image
An Liang
2022, Supervisor

Garment-integrated smart textile sensor design for body movement
Image
Hazar Emre Tez
2022, Supervisor

Investigating synchrony and co-dependency through design constraints in DMIs in expert music interaction
Image
Antonella Nonnis
2021, Supervisor

Tangible Interactions for Children with Autism

Image
Liang Men
2020, Supervisor

Exploring Collaborative Music Making in Virtual Reality

Image
Katja Knecht
2019, Supervisor

Micro-Atmospheres: Investigating Portable and Wearable Solutions to Support Individual Thermal Comfort in Open-Plan Offices
Image
Yongmeng Wu
2018, Supervisor

Engaging Creativity - Supporting Non-Musicians' Creative Engagement with Musical Interfaces

Image
Astrid Bin
2018, Supervisor

The Show Must Go Wrong: Towards an understanding of audience perception of error in digital music instrument performance
Image
Antonella Mazzoni
2017, Supervisor

Mood Glove: Enhancing mood in film music through haptic sensations for an enriched film experience

Image
Sara Heitlinger
2016, Supervisor

Talking Plants and a Bug Hotel: Participatory Design of ludic encounters with an urban farming community
Image
Evan Morgan
2016, 2nd Supervisor

Instrumenting the Musician: Measuring and Enhancing Affective and Behavioural Interaction During Collaborative Music Making
Image
Ben Bengler
2015, Supervisor

Let’s Walk Up and Play! Design and Evaluation of Collaborative Interactive Musical Experiences for Public Settings
Image
David Meckin
2014, Supervisor

Designing Novel Technologies for Group Music Making by Young People Who Have Complex Needs
Image
Robin Gareth Whiteley Fencott
2012, Supervisor


Multi-person musicking

Image
Tim Peter Erastus Murray-Browne
2012, 2nd Supervisor

Evaluating interactive audio experiences
Image
Oussama Metatla
2010, Supervisor

Interactive sonification of diagrams
Image
Shahin Nabavian
2010, Supervisor

The nature of collaborative composition
Image
Dan Stowell
2010, 2nd Supervisor

Making music through real-time voice timbre analysis
Image
Jean-Baptiste Thiebaut
2009, 2nd Supervisor

Sketching music: representation and composition
Image
Andrew Robertson
2009, 2nd Supervisor

Interactive real-time musical systems

Become My Student

My projects are all in the areas of Creative Computing and Human-Centred AI. All projects involve programming (some more than others). No projects necessarily require musical knowledge or experience.

KEYWORDS
Explainable AI, Creative AI, Sonic Interaction Design, UX Design for Creativity, Iterative Prototyping of Novel Creative Interfaces, UX Evaluation, Music, Interaction, HCI, Visualisation

PROJECT TOPICS

  • EXPLAINABLE AI FOR THE ARTS

    A key challenge for Artificial Intelligence (AI) is the opaqueness of the datasets and AI models used, especially neural nets, which make them very difficult for humans to understand. This project will explore how user interfaces for creative domains of AI use can be designed to be more transparent and understandable. It will question whether conventional approaches to designing explainable AI are suitable for creative applications of AI, and if not, what alternative approaches to explanation are appropriate for creative domains. This would involve the user-centred design and evaluation of interactive visualisations of explainable models of AI, and will focus specifically on creative AI and digital media. The student would need to have or to develop skills in AI and Machine Learning as well as some skills or interest in HCI user study techniques and visualisation design. Digital media skills are not necessary but would be advantageous.

  • REIMAGINING INTANGIBLE CULTURAL HERITAGE

    In 2019 I ran a workshop in China which focussed on the Duxianqin, a traditional a Solo String instrument popular in southern Guangxi and Vietnam, and explored the use of Digital Music Technology and Interaction Design to reimagine this one-stringed traditional instrument in a creative way. 3 reimagined Duxianqin were produced, and I have the augmented Duxianqin (Polyqin) here at QMUL. The project would involve co-design with musicians, rebuilding and expanding the digital elements of this reimagined instrument and testing it with musicians in their creative practice.
    See the webpage for the project

  • VR FOR INTANGIBLE CULTURAL HERITAGE

    Project involves the co-design and evaluation of VR experiences in which users can interact with VR versions of traditional musical instruments in different interaction settings (e.g. museum vs. game-like setting). This project would involve building other traditional instruments and environments in VR and testing users' engagement with them to develop guidelines for the use of VR to increase access to, and engagement with, ICH.

  • VISUALISING CREATIVITY

    Designing and evaluating interactive visualisations and data mining of patterns of human interaction with creativity support tools, e.g. in collaborative music making.

  • COLLABORATIVE MUSIC MAKING

    Designing and evaluating collaborative music making interfaces e.g. online, or in VR, or physical interaction, or mixed reality.

Image