Overview of 'Stellar Dream': 'Stellar Dream' is an immersive interactive art installation that bridges the cosmic wonder with digital technology. The project utilizes a dynamic particle system, PoseNet for real-time human pose estimation, and Arduino-based pressure sensors to create an ethereal space-themed experience. The particle system, consisting of two types - regular and space particles, responds to human movement and pressure inputs, respectively, simulating celestial phenomena like star streams and galactic motion.
Technologies Used:
p5.js: For creating and animating the particle systems.
ml5.js (PoseNet): For real-time pose estimation to control regular particles.
Arduino: With a pressure sensor to trigger the space particles.
Development Process: The development journey included the following steps:
Setting up PoseNet for pose detection and mapping the detected poses to control the movement and behavior of regular particles.
Designing and implementing a particle system using p5.js, featuring two distinct particle types.
Integrating Arduino with a pressure sensor to trigger the transition from regular to space particles.
Developing a flow field algorithm to guide the motion of space particles, creating a visually captivating representation of cosmic flow.
Challenges Encountered:
PoseNet Integration: Initially, there were challenges in efficiently processing PoseNet data to control the particle system, considering the the gestures that will effectively tigger the movement.
Performance Issues: Managing a large number of particles while maintaining smooth animation was a challenge, especially when transitioning between particle types.
Sensor Responsiveness: Ensuring that the Arduino sensor reliably triggered the change in particle systems required fine-tuning of the hardware-software interaction.
Learnings:
Gained proficiency in using PoseNet and p5.js for interactive web-based applications.
Developed a deeper understanding of particle systems, including concepts like flow fields, attractors, and particle behavior under different forces.
Learned about integrating hardware inputs (Arduino pressure sensor) into a digital environment for interactive installations.
Enhanced skills in performance optimization for real-time interactive applications.
Future Development:
Enhancing the Sensor Aesthetic: Planning to redesign the Arduino pressure sensor to resemble a planetary object, enhancing the thematic experience.
Sensor Interaction: Exploring additional interactive elements, like varying the particle behavior based on different pressure levels.
Audio Integration: Adding ambient cosmic sounds that respond to user interaction for a multisensory experience.
Educational Component: Incorporating educational content about different celestial phenomena represented by the particle systems.
Multi-user Interaction: Scaling the installation for multiple users to interact simultaneously, creating a collaborative space exploration experience.
コメント