MAD Logo

Develop your technical literacy
and creative design skills

For more information, visit:
www.mat.ucsb.edu/mad

Media Arts and Technology

Graduate Program

University of California Santa Barbara

Events

Abstract

With haptic technologies increasingly embedded in commercially available devices, vibrotactile feedback is now appearing in streaming music platforms, gaming environments, VR/AR systems, and assistive devices. Haptic feedback has been shown to enhance the music listening experience [1], and recent musical haptics research has pursued greater tactile specificity and multi-feature extraction [2]. Despite these developments, relatively few musical works are composed specifically for audio–haptic realization.

The research undertaken in this Master’s project is a practice-based exploration of musical composition for coupled audio–haptic media through a multimodal gallery installation, Feel4UTM. The work renders music simultaneously as acoustic sound and distributed bodily vibration through three stereo haptic stations—two wearable systems and one handheld device. Haptics and sound were developed in tandem, with each modality mutually informing the content and structure of the composition. All synthesis, sequencing, and signal processing were custom designed for the installation. Filtering and transient detection are used to derive the haptic signal directly from the audio, allowing harmonic, rhythmic, and textural decisions to shape both sound and vibration. The composition unfolds across five large-scale sections, each oriented toward a distinct affective direction. The installation was presented in an open gallery setting where visitors engaged with the work independently over extended exhibition hours, introducing practical constraints distinct from a traditional seated concert performance.

As vibration becomes an increasingly common component of mediated listening, compositional methodologies must expand to account for how musical structures translate onto the body. This project presents observations from the process of creating an audio–haptic composition and installation. Musical, technical, and interaction design considerations are discussed, and several preliminary compositional guidelines for audio–haptic media are proposed.

Past Events  

News

Çağlarcan described his winning piece "Shadows" as an audiovisual transdisciplinary artwork that explores spiritual and social connections as his music overlays a selection of oil paintings by his brother, Güneş Çağlarcan, an accomplished painter and pianist.

For more information please read the article in the UCSB Current online magazine.

Image

The fellowship allows Croskey to pursue a project that she is passionate about - enabling marginalized communities to secure their place in the future historical record, ensuring that emergent technologies, such as AI, elevate and empower these groups by reflecting their histories.

"Receiving the NSF GRFP amid our current political climate has given me an even greater sense of responsibility to pursue my research with full force,” Croskey said."

Image

Read more in the UCSB College of Engineering Newsletter.

This year’s theme was “Myths and Legends”. Other artists receiving the award with Professor Kuchera-Morin were Mary Heebner, Gabriela Ruiz, Manjari Sharma, and Diana Thater.

Image Image

The software creates personalized visuals and abstract art in an immersive landscape that is based on the memories of the crew members. The news articles highlight their work on a software pipeline that was being used at the St. Kliment Ohridski base on Livingston Island, Antarctica.

For more information, please see:

UCSB's The Current news magazine article:
New frontiers for well-being in Antarctica and isolated spaces.

Santa Barbara Independent article:
UC Santa Barbara Researchers Design Tools to Combat Isolation in Extreme Environments.

www.iasonpaterakis.com

nefeliman.com

Image
Image

Iason Paterakis, Nefeli Manoudaki - AI driven visuals: Icescape

Image

Iason Paterakis, Nefeli Manoudaki - AI driven visuals: Beach

Image

Iason Paterakis, Nefeli Manoudaki - AI driven visuals: Plains

The title of the NSF award is Dynamic Control Systems for Manual-Computational Fabrication. Professor Jacobs was awarded the NSF Career Award to further her research in integrating skilled manual and material production with computational fabrication.

The CAREER Program offers the NSF's most prestigious awards in support of early-career faculty who have the potential to serve as academic role models in research and education and to lead advances in the mission of their department or organization.

Professor Jacobs thanks all of the amazing members the Expressive Computation Lab whose research contributed the intellectual foundations of this award.

Image

UCSB News: Making Automation More Human Through Innovative Fabrication Tools

NSF link: Dynamic Control Systems for Manual-Computational Fabrication

Expressive Computation Lab

Past News  

Showcase

Exhibition Catalogs

End of Year Show

About MAT

Media Arts and Technology (MAT) at UCSB is a transdisciplinary graduate program that fuses emergent media, computer science, engineering, electronic music and digital art research, practice, production, and theory. Created by faculty in both the College of Engineering and the College of Letters and Science, MAT offers an unparalleled opportunity for working at the frontiers of art, science, and technology, where new art forms are born and new expressive media are invented.

In MAT, we seek to define and to create the future of media art and media technology. Our research explores the limits of what is possible in technologically sophisticated art and media, both from an artistic and an engineering viewpoint. Combining art, science, engineering, and theory, MAT graduate studies provide students with a combination of critical and technical tools that prepare them for leadership roles in artistic, engineering, production/direction, educational, and research contexts.

The program offers Master of Science and Ph.D. degrees in Media Arts and Technology. MAT students may focus on an area of emphasis (multimedia engineering, electronic music and sound design, or visual and spatial arts), but all students should strive to transcend traditional disciplinary boundaries and work with other students and faculty in collaborative, multidisciplinary research projects and courses.

Alumni Testimonials