In an attempt to digitally recreate historical musical instruments, this thesis explores the combination of microcontroller technology and real-time computer simulations. This work focuses on a Roman relic that is said to produce sound through motion. The system uses an ESP32 microcontroller, MPU-6500 motion sensor and Unity game engine to produce an interactive virtual simulation that restores the functionality of this ancient instrument. The ESP32 platform on which the hardware is built was chosen for its Bluetooth Low Energy (BLE) compatibility and ease of interface with external devices. Accurate motion tracking is made possible by the MPU-6500 sensor collecting real-time gyroscopic and accelerometer data via I2C. Compared to using the limited on-board sensors of the ESP32, this configuration provides higher precision and allows reliable detection of rotational motion, which is necessary to simulate the operation of the device. A 3D simulation was created using Unity as the program. The motion data from the ESP32 is received by a custom C# script that also manages the BLE communication and translates it into the motion of the virtual model. The virtual instrument reacts in real time by animating the 3D model and producing auditory feedback when the physical sensor is rotated. This produces a synchronized experience where motion and sound are translated directly from the movement. A number of technical issues with the system had to be resolved, including noise filtering, sensor calibration and maintaining a stable BLE connection. Smoothing techniques were applied on the software side to minimize vibration and ensure smooth motion in the simulation. Data processing was performed in a different thread to avoid performance issues in Unity's main rendering loop. Apart from the technological implications, this initiative contributes to digital heritage by providing modern methods for interacting with ancient culture. By combining inexpensive microcontrollers with interactive 3D environments, it enables people to experience historical relics through motion and sound, even in situations where real objects are not available. In summary, this thesis presents a new approach to revitalize ancient instruments using interactive media and embedded technologies. Thanks to technical progress, this framework can be extended for more complex simulations or applied to other old objects, providing cultural and educational value.
In an attempt to digitally recreate historical musical instruments, this thesis explores the combination of microcontroller technology and real-time computer simulations. This work focuses on a Roman relic that is said to produce sound through motion. The system uses an ESP32 microcontroller, MPU-6500 motion sensor and Unity game engine to produce an interactive virtual simulation that restores the functionality of this ancient instrument. The ESP32 platform on which the hardware is built was chosen for its Bluetooth Low Energy (BLE) compatibility and ease of interface with external devices. Accurate motion tracking is made possible by the MPU-6500 sensor collecting real-time gyroscopic and accelerometer data via I2C. Compared to using the limited on-board sensors of the ESP32, this configuration provides higher precision and allows reliable detection of rotational motion, which is necessary to simulate the operation of the device. A 3D simulation was created using Unity as the program. The motion data from the ESP32 is received by a custom C# script that also manages the BLE communication and translates it into the motion of the virtual model. The virtual instrument reacts in real time by animating the 3D model and producing auditory feedback when the physical sensor is rotated. This produces a synchronized experience where motion and sound are translated directly from the movement. A number of technical issues with the system had to be resolved, including noise filtering, sensor calibration and maintaining a stable BLE connection. Smoothing techniques were applied on the software side to minimize vibration and ensure smooth motion in the simulation. Data processing was performed in a different thread to avoid performance issues in Unity's main rendering loop. Apart from the technological implications, this initiative contributes to digital heritage by providing modern methods for interacting with ancient culture. By combining inexpensive microcontrollers with interactive 3D environments, it enables people to experience historical relics through motion and sound, even in situations where real objects are not available. In summary, this thesis presents a new approach to revitalize ancient instruments using interactive media and embedded technologies. Thanks to technical progress, this framework can be extended for more complex simulations or applied to other old objects, providing cultural and educational value.
Interactive sound simulation in Unity: the case study of an ancient clay rattle
YILMAZ, TAHSIN CAN
2024/2025
Abstract
In an attempt to digitally recreate historical musical instruments, this thesis explores the combination of microcontroller technology and real-time computer simulations. This work focuses on a Roman relic that is said to produce sound through motion. The system uses an ESP32 microcontroller, MPU-6500 motion sensor and Unity game engine to produce an interactive virtual simulation that restores the functionality of this ancient instrument. The ESP32 platform on which the hardware is built was chosen for its Bluetooth Low Energy (BLE) compatibility and ease of interface with external devices. Accurate motion tracking is made possible by the MPU-6500 sensor collecting real-time gyroscopic and accelerometer data via I2C. Compared to using the limited on-board sensors of the ESP32, this configuration provides higher precision and allows reliable detection of rotational motion, which is necessary to simulate the operation of the device. A 3D simulation was created using Unity as the program. The motion data from the ESP32 is received by a custom C# script that also manages the BLE communication and translates it into the motion of the virtual model. The virtual instrument reacts in real time by animating the 3D model and producing auditory feedback when the physical sensor is rotated. This produces a synchronized experience where motion and sound are translated directly from the movement. A number of technical issues with the system had to be resolved, including noise filtering, sensor calibration and maintaining a stable BLE connection. Smoothing techniques were applied on the software side to minimize vibration and ensure smooth motion in the simulation. Data processing was performed in a different thread to avoid performance issues in Unity's main rendering loop. Apart from the technological implications, this initiative contributes to digital heritage by providing modern methods for interacting with ancient culture. By combining inexpensive microcontrollers with interactive 3D environments, it enables people to experience historical relics through motion and sound, even in situations where real objects are not available. In summary, this thesis presents a new approach to revitalize ancient instruments using interactive media and embedded technologies. Thanks to technical progress, this framework can be extended for more complex simulations or applied to other old objects, providing cultural and educational value.| File | Dimensione | Formato | |
|---|---|---|---|
|
Yilmaz_Tahsin_Can.pdf
accesso aperto
Dimensione
1.11 MB
Formato
Adobe PDF
|
1.11 MB | Adobe PDF | Visualizza/Apri |
The text of this website © Università degli studi di Padova. Full Text are published under a non-exclusive license. Metadata are under a CC0 License
https://hdl.handle.net/20.500.12608/94420