SOSC1003 - Introduction to Art Tech Design and Interactivity
MIDTERM ASSIGNMENT
2025-2026 Term I
TITLE
- CREATING INTERACTIVE PROTOTYPES -
TASK
The assignment aims to explore the creative potential of integrating physical sensors with digital visuals. Using an Arduino kit and TouchDesigner, students will build an interactive visual prototype that responds to real-world input obtaining from sensor.
In groups of up to three, your task is to create an interactive visual prototype. This exercise invites students to explore real-time interaction and data-driven design by integrating physical sensors—such as light, motion, or pressure with digital visuals. Students will experiment with dynamic visual effects through manipulation of sensor data, transmitted from Arduino to TouchDesigner, and creatively mapped to visual parameters. The goal is to build a responsive system, where physical input transforms digital output in an artistic and expressive way.
DELIVERABLES
• Submit a zip file and clearly name your file using the following format:
• GROUPNAME.zip This folder should include:
o Video: a 1-minute-long video that documents someone interacting with the prototype, highlighting how the system responds to their actions and how this interaction shapes their overall experience on the screen/projector.
o Presentation: Please submit a PowerPoint (GROUPNAME.pptx) file that includes wiring diagrams or photos of your physical setup, a description of how the prototype was made, a brief instruction manual explaining how to operate it, and the source code with clear explanations. Make sure to include visuals and explanations that highlight your design and illustrate the main components and features of your project. All names and student IDs must appear on the first page of presentation.
o TOE file: Your touchdesigner file with proper naming: GROUPNAME.toe
o Folder (source): If you import a visual into touchdesigner. Please include the raw files in this folder. Ensure that the file path in TouchDesigner is correctly set, and that the video is uploaded from this directory.
o Folder (export): Create a subfolder named “export” and place your final exported movie(s) inside. Each file should be named using the format: GROUPNAME.mov. The exported video must be at least 30 seconds long.
NOTES
• You may form. your own group of up to three members. Working individually is also acceptable, but group collaboration is strongly encouraged. Learning from peers and practicing teamwork are valuable skills.
• Once you've uploaded your code to the Arduino board, you're ready to connect it to TouchDesigner. Remember, two serial monitors can't run simultaneously. To access serial data in TouchDesigner, make sure to close the Arduino serial monitor first.
• If you're unfamiliar with coding or working with sensors, you can easily find Arduino code examples online for collecting sensor data and use them as needed. Alternatively, you can ask an AI for assistance with writing or troubleshooting your Arduino code.
• Any operator in TouchDesigner that requires a numeric input in its parameter window can be linked to a Serial DAT, which typically provides those values. To use them, simply convert the data into CHOP format using the ‘DATto’ CHOP operator. If you need to remap the values, use the Math CHOP and adjust the data in the range section accordingly. This is the process by which sensor data is transformed into data that can be used within TouchDesigner.
• If you only need a single numeric value instead of a list, use Select DAT to extract the specific value. You can easily do this by setting the index to "End Row Index".
• It is required to continue sharing your project and progress during the class sessions before the deadline. These are opportunities to help develop your work in two key areas: 1) user experience; 2) technical advancement. Students are expected to share their work in progress and participate in discussions about each project. We will continue to practice this essential learning activity throughout the remainder of the term as our projects advance from midterm prototypes into final artworks.
• You should be able to control your visuals with at least one of the sensors.
• You are encouraged to experiment with different sensors and stay open to the discoveries that emerge through hands-on testing.
• You are also encouraged to explore additional resources to assist with your coding – online forums, use of AI, etc. Please note University policy on correct use and acknowledgement.
• In the next class, we will dive deep with Data Operators (DATS) in TouchDesigner, exploring how they can be used to manage and transform structured data, and build logic-driven interactive systems. To prepare, you can review examples that use tables and scripts to control data management.