Final Project Documentation

Overview of 'Stellar Dream': 'Stellar Dream' is an immersive interactive art installation that bridges the cosmic wonder with digital technology. The project utilizes a dynamic particle system, PoseNet for real-time human pose estimation, and Arduino-based pressure sensors to create an ethereal space-themed experience. The particle system, consisting of two types - regular and space particles, responds to human movement and pressure inputs, respectively, simulating celestial phenomena like star streams and galactic motion.

Technologies Used:

• p5.js: For creating and animating the particle systems.

• ml5.js (PoseNet): For real-time pose estimation to control regular particles.

• Arduino: With a pressure sensor to trigger the space particles.

Development Process: The development journey included the following steps:

• Setting up PoseNet for pose detection and mapping the detected poses to control the movement and behavior of regular particles.

• Designing and implementing a particle system using p5.js, featuring two distinct particle types.

• Integrating Arduino with a pressure sensor to trigger the transition from regular to space particles.

• Developing a flow field algorithm to guide the motion of space particles, creating a visually captivating representation of cosmic flow.

Challenges Encountered:

• PoseNet Integration: Initially, there were challenges in efficiently processing PoseNet data to control the particle system, considering the the gestures that will effectively tigger the movement.

• Performance Issues: Managing a large number of particles while maintaining smooth animation was a challenge, especially when transitioning between particle types.

• Sensor Responsiveness: Ensuring that the Arduino sensor reliably triggered the change in particle systems required fine-tuning of the hardware-software interaction.

Learnings:

• Gained proficiency in using PoseNet and p5.js for interactive web-based applications.

• Developed a deeper understanding of particle systems, including concepts like flow fields, attractors, and particle behavior under different forces.

• Learned about integrating hardware inputs (Arduino pressure sensor) into a digital environment for interactive installations.

• Enhanced skills in performance optimization for real-time interactive applications.

Future Development:

• Enhancing the Sensor Aesthetic: Planning to redesign the Arduino pressure sensor to resemble a planetary object, enhancing the thematic experience.

• Sensor Interaction: Exploring additional interactive elements, like varying the particle behavior based on different pressure levels.

• Audio Integration: Adding ambient cosmic sounds that respond to user interaction for a multisensory experience.

• Educational Component: Incorporating educational content about different celestial phenomena represented by the particle systems.

• Multi-user Interaction: Scaling the installation for multiple users to interact simultaneously, creating a collaborative space exploration experience.