Media Arts and Technology, UC Santa Barbara

Events

Sketches of Sensorium, an immersive audio visual event, will premier at the AlloSphere on Thursday September 12, 2024, from 5:30 to 7:30pm. The event premieres as a satellite to the UC Irvine Beall Center for Art and Technology’s forthcoming exhibition, Future Tense: Art, Complexity, and Uncertainty, produced in partnership with the 2024 Getty PST Art: Art and Science Collide initiative.

Sketches of Sensorium

Sketches for Sensorium showcases core elements of the late environmental artist Newton Harrison’s (1932 - 2022) long-term project, Sensorium for the World Ocean. It is a project of the Center for the Study of the Force Majeure in collaboration with Virtual Planet Technologies, Almost Human Media, and the AlloSphere Research Group. The installation incorporates immersive audio and visual scientific climate and ocean health data provided by the Ocean Health Index of the Halpern Lab at the Bren School of Environmental Science & Management.

Additional shows at the AlloSphere are on:

To reserve a time, you can sign up on this page.

For more information, please visit:

news.ucsb.edu/2024/021608/immersive-ocean-health-project-premieres-ucsbs-allosphere-part-getty-pst-art

www.independent.com/2024/09/11/sketches-of-sensorium-part-of-getty-pst-art-at-uc-santa-barbara

allosphere.ucsb.edu/research/sketches_of_sensorium/2024.html

Kinematic User Profiling for Interface Design: Reachability and Motion Cost Analysis of Hands for Designing Personalized Grasp Proximate Interfaces., a Master's presentation by Alejandro Aponte. Friday, October 4th, 2024 at 5pm PDT. Elings Hall room 2003 and via Zoom.

Kinematic User Profiling for Interface Design: Reachability and Motion Cost Analysis of Hands for Designing Personalized Grasp Proximate Interfaces

Abstract

Everyday objects and tools, such as power drills and game controllers, are typically designed with interfaces optimized for easy access by the grasping hand, allowing users to interact while maintaining a secure hold. Designing personalized, hand-reachable interfaces tailored to individual grasping conditions remains a significant challenge. Recent advancements in parametric and generative design technologies present new opportunities to reduce the workload of developing customized interfaces. Furthermore, as physical and virtual realities increasingly intersect, designers face complex challenges and opportunities to create hybrid interfaces seamlessly integrating physical and digital UI elements. Understanding and characterizing user-specific hand-object interactions is central to this endeavor. To address these challenges, this work introduces a novel empirical design approach that seeks to shift the design workflow to provide personalized interfaces and adapt the interface to the user instead of the user adapting to a generic interface. By leveraging hand-tracking technology, this approach generates kinematic profiles that capture individual finger reachability during object grasping. Additionally, the approach incorporates physiological signals, such as electromyography (EMG) and displacement costs, to explore how they can characterize physical effort within their reachable space. Building on previous work (Aponte and Caetano et al. 2024), we present a design framework that utilizes volumetric boundaries and trajectories derived from user data to create personalized interaction profiles. These profiles can be integrated into standard 3D modeling tools to assess user-specific hand-object interaction conditions and identify optimal regions of interest for UI element placement, providing a foundational baseline for the interface design process. The results and insights from an initial formative user study on reachability, motion cost, and guidelines for implementing the introduced design methodology are presented. This approach makes personalized interface development more feasible by enabling designers to create new interfaces from standard poses, refine existing designs, and evaluate scenarios involving limited mobility.

Past Events

News

MAT PhD student Weihao Qiu has been awarded the 2024 Mellichamp Initiative in Mind and Machine Intelligence Graduate Student Fellowship.

Weihao is currently a PhD candidate in the Media Arts and Technology (MAT) program, where his research is centered on improving the modularity, customizability, and interactivity of Generative AI tools. His primary goal is to enhance the diversity, expressiveness, and audience connectedness of AI-based artworks. Weihao's research contributions have been published in conferences, such as Neural Information Processing Systems (NeurIPS), The ACM Conference on Human Factors in Computing Systems (CHI), and The International Conference on Robotics and Automation (ICRA). His artwork has been exhibited in venues such as Beijing Times Art Museum, FeraFile, The Wolf Museum of Exploration + Innovation (MOXI), SIGGRAPH, and UCSB MAT End of Year Shows.

The intent of the fellowship is to provide graduate students who are passionate about exploring the intersection of multiple fields related to the initiative with the opportunity to participate in research projects and activities organized as part of the annual summit.

Mellichamp Initiative in Mind & Machine Intelligence Summit 2024

The Second Edition (2023) of a book by Professor Curtis Roads, "The Computer Music Tutorial" has been released.

The Computer Music Tutorial, Second Edition (2023) by Curtis Roads

Curtis Roads, professor in Media Arts and Technology and affiliate faculty in Music at UCSB, has announced the publication of an expanded, updated, and fully revised Second Edition of his textbook The Computer Music Tutorial (2023, The MIT Press, 1257 pages).

Essential and state-of-the-art, The Computer Music Tutorial, Second Edition is a singular text that introduces computer and electronic music, explains its motivations, and puts topics into context. Curtis Roads's step-by-step presentation orients musicians, engineers, scientists, and anyone else new to computer and electronic music.

The new edition continues to be the definitive tutorial on all aspects of computer music, including digital audio, signal processing, musical input devices, performance software, editing systems, algorithmic composition, MIDI, and psychoacoustics, but the second edition also reflects the enormous growth of the field since the book's original publication in 1996. New chapters cover up-to-date topics like virtual analog, pulsar synthesis, concatenative synthesis, spectrum analysis by atomic decomposition, Open Sound Control, spectrum editors, and instrument and patch editors. Exhaustively referenced and cross-referenced, the second edition adds hundreds of new figures and references to the original charts, diagrams, screen images, and photographs in order to explain basic concepts and terms.

Features include:

New chapters on virtual analog, pulsar synthesis, concatenative synthesis, spectrum analysis by atomic decomposition, Open Sound Control, spectrum editors, instrument and patch editors, and an appendix on machine learning.

Two thousand references support the book's descriptions and point readers to further study.

Mathematical notation and program code examples used only when necessary.

Twenty-five years of classroom, seminar, and workshop use inform the pace and level of the material.

As Prof. Roads states: "I finished writing the first edition in 1993. It finally came out in 1996, the year I joined the UCSB Music faculty as a Visiting Associate Professor. Writing the Second Edition required going through the research literature in the field since 1993. It often felt overwhelming but I just had to keep going. In 2017 I devoted all my creative time to the project. I promised myself I would finish it in 2020, and at 10 PM on 31 December 2020 I finished writing. Time for Champagne! The production process took all of 2021 and most of 2022. In a way it was a perfect project for the pandemic lockdown, as it gave me a daily purpose in a time of isolation. The textbook has been the core of my teaching at UCSB."

An article about the release of the 2nd edition was published in the UCSB Current:

news.ucsb.edu/2023/021272/core-textbook-computer-music-distills-vast-information-space-definitive-tutorial

The book can be found at MIT Press:

mitpress.mit.edu/9780262044912/the-computer-music-tutorial

Professor Roads's previous books include Microsound (2001, The MIT Press) and Composing Electronic Music: A New Aesthetic (2015, Oxford University Press).

MAT professor JoAnn Kuchera-Morin will give a presentation titled "From Music Composition to Multimodal Interactive Composition - An Historical Overview" at SIGGRAPH SPARKS 2024, Pioneering Interactive Art and Artists from the 1960s to 2000. February 23rd, 2024 at 9am PST.

This SPARKS session focuses on the innovative interactive digital artwork and pioneering artists prior to the year 2000. Interactive digital art’s roots began forming in the 1960s and blossomed in the following decades. By relinquishing the power to control the outcome of a work of art, digital artists in the 1960-1990s established a democratic, reciprocal relationship with the viewer. Without a defined history, artists were free to experiment and create works that capitalized on the concept of “possibilities”. These individualized personal art experiences took many forms including screen-based art, immersive installation environments, haptic device art, and much more.

Presentations:

Vladimir Bonačić’s interactive digital installations 1969 – 1971
Darko Fritz

Media Art as Thinking Space
Monika Fleischmann and Wolfgang Strauss

Interactive Plant Growing – a journey of an interactive garden created in 1992
Christa Sommerer and Laurent Mignonneau

Searching for Conditions of Possibility: Jeffrey Shaw’s Artistic Practice in Expanded Cinema
Lukasz Mirocha

Engaging Subjectivity Through Interaction
Greg Garvey

The enduring telematic vision of a coexistent third space
Paul Sermon

From Music Composition to Multimodal Interactive Composition – An Historical Overview
JoAnn Kuchera-Morin

https://dac.siggraph.org/sparks/feb-2024-pioneering-interactive-art-and-artists

This event is co-moderated by MAT alumni Dr. Myungin Lee and co-sponsored by the ACM SIGGRAPH History Committee.

A team of MAT students led by MAT Chair and transLAB Director Professor Marcos Novak designed and installed an immersive and interactive exhibit called the "Synaptic Time Tunnel" for the 2023 SIGGRAPH Conference at the Los Angeles Convention Center.

Synaptic Time Tunnel, SIGGRAPH 2023.

Sponsored by Autodesk, the Synaptic Time Tunnel was a tribute to 50 years of innovation and achievement in the field of computer graphics and interactive techniques that have been presented at the SIGGRAPH conferences.

An international audience of more than 14,275 attendees from 78 countries enjoyed the conference and its Mobile and Virtual Access component.

Contributors:

Marcos Novak - MAT Chair and transLAB Director, UCSB
Graham Wakefield - York University, UCSB
Haru Ji - York University, UCSB
Nefeli Manoudaki - transLAB, MAT/UCSB
Iason Paterakis - transLAB, MAT/UCSB
Diarmid Flatley - transLAB, MAT/UCSB
Ryan Millet - transLAB, MAT/UCSB
Kon Hyong Kim - AlloSphere Research Group, MAT/UCSB
Gustavo Rincon - AlloSphere Research Group, MAT/UCSB
Weihao Qiu - Experimental Visualization Lab, MAT/UCSB
Pau Rosello Diaz - transLAB, MAT/UCSB
Alan Macy - BIOPAC Systems Inc.
JoAnn Kuchera-Morin - AlloSphere Research Group, MAT/UCSB
Devon Frost - MAT/UCSB
Alysia James - Department of Theater and Dance/UCSB

More information about the Synaptic Time Tunnel can be found in the following news articles:

Forbes.com: SIGGRAPH, Autodesk Take Time Tunnel Through Computer Graphics History on 50th Anniversary

Forbes.com: SIGGRAPH 2023 Highlights

PR Newswire: SIGGRAPH 2023 Conference Commemorates 50 Years of Innovations With Growth in Contributed Works and In-person Attendees

s2023.siggraph.org

translab.mat.ucsb.edu/S50_SynapticTimeTunnel

translab.mat.ucsb.edu

MAT alumni Andres Burbano has been selected as chair of the 51st annual ACM SIGGRAPH 2024 conference.

ACM SIGGRAPH is the premier conference and exhibition on computer graphics and interactive techniques. This year they celebrate their 50th conference and reflect on half a century of discovery and advancement while charting a course for the bold and limitless future ahead.

Burbano is a native of Pasto, Colombia and an associate professor in Universidad de los Andes’s School of Architecture and Design. As a contributor to the conference, Burbano has presented research within the Art Papers program (in 2017), and as a volunteer, has served on the SIGGRAPH 2018, 2020, and 2021 conference committees. Most recently, Burbano served as the first-ever chair of the Retrospective Program in 2021, which honored the history of computer graphics and interactive techniques. Andres received his PhD from Media Arts and Technology in 2013.

Read more from the ACM SIGGRAPH's website and this article on the ACMSIGGRAPH Blog.

The next ACM SIGGRAPH conference is in August 2023 and will be held in Los Angeles, California s2023.siggraph.org.

Past News

Alumni Testimonials

"With a deep interest in exploring sound, not only creatively, but technically and scientifically, I began my studies at MAT at UCSB. It was here, through academic discipline and perseverance, alongside professors and colleagues, that I was able to hone my skills and begin my successful career.

Years later, I am leading development of game audio and augmented reality technology at Apple.

The strong academic foundations that I gained in spatial audio, sound synthesis, and audio engine architecture have allowed me to achieve even greater success in my career. I will always be grateful to those who helped me take those first steps to success!"

David Thall
Lead Audio Programmer
Game and Augmented Reality Technology
Apple
"As a UCSB MAT Master's student (2002-2004), I benefited greatly from the required and elective courses taught by professional leaders with broad perspectives, both technical and humanistic. This helped me to improve my research skills, and to refine my academic vision, which culminated in a PhD (2009) from UCSB Electrical and Computer Engineering specializing in Digital Signal Processing. Since that time I have been employed at several academic institutions around Europe, where my broad technical and humanistic perspective has been unique and advantageous."

Bob L. Sturm, Associate Professor
School of Electronic Engineering and Computer Science
Royal Institute of Technology KTH
Stockholm, Sweden
"As one of the first graduates of the Media Arts and Technology PhD program, I have found the experiences provided by the MAT community invaluable to both my professional development and personal enjoyment of creating technology-based experiences, throughout life. I have been employed for more than 10 years now in the department of Architecture, Design and Media Technology at Aalborg University Copenhagen, where I teach both interaction design and real-time signal processing for audio and music performance. As Associate Professor, I guide students to create their own software and hardware tools, concepts, and practices for creating new sonic and embodied interactions, as well as running the Augmented Performance Lab. Together with my colleagues, I helped start the Sound and Music Computing masters program in 2014, and co-chaired the international New Interfaces for Musical Expression (NIME) conference in 2017."

Dan Overholt
Associate Professor
Aalborg Univeristy, Copenhagen
Denmark
"MAT is a rare graduate program in that it operates more like an creative ecosystem -- your work as a researcher is significant and connects to others. People care a lot about what you are doing, and invest thought into your own thinking. Throughout my eight years of study, from 2007 to 2015, and as a postdoctoral student afterwards, this supportive environment provided the technological, financial, and intellectual resources necessary for me to take risks in my work. As a result, I was able to dive deep into subjects I thought were off limits to my cognitive function, and achieve the great satisfaction of learning how to learn better. It is a testament to the culture fostered there that an experimental filmmaker such as myself entering the program with very basic programming skills can now make regular contributions to mathematics journals, work as a real-time computer graphics programmer in the DTLA arts district, be asked to consult on science fiction television dramas, and innovate novel geometrical algorithms of use in architecture. I think the MAT program at UCSB is a hidden gem -- you enter it with one direction in mind, and come out brilliantly refracted into a spectrum of possibilities."

Pablo Colapinto
Oblong Industries Inc & Independent Artist
Los Angeles
"The education and mentorship I received as an MAT student gave me the skills to discuss my work critically and in the context of the rich history of media arts; and has been pivotal in having my work accepted in exhibitions around the world, including Dubai, Montreal, Tehran, Hong Kong, New York and cities throughout the US. Further, my PhD in MAT was instrumental in securing my position as Curator of Interactive Media for MOXI, the Wolf Museum of Exploration and Innovation. In that capacity, almost half of the artists I have curated into MOXI have been MAT alumni, MAT faculty, MAT students, and distinguished media artists who I met as part of my work in the MAT program. My collaborations with MAT students and alumni are ongoing, and I continue to be grateful for the education, mentorship and community of the UCSB MAT program."

Marco Pinter
Computational Artist
Curator of Interactive Media, MOXI (The Wolf Museum of Exploration + Innovation)
Director of Software Innovation, InTouch Health

Lavin	CHON	Kinetic
Hive	Allotope Krotona	Autonomous Robots