‍‍The primary challenge was "Immerse yourself in the technology; understand its workings, and identify potential applications. Create a realistic scenario where the technology can be applied. Build a demonstration that enables the audiences to engage with the technology." The technology in question was mainly;

• Microcontrollers, sensors, and actuators.
• Digital modeling, simulation, and fabrication tools.
• LLM based AI

‍

Design Process:

‍The project journey involved extensive experimentation with motion sensors, AI poetry generation, and multisensory integration. Challenges in technology compatibility and implementation were overcome through iterative testing and teamwork, resulting in a cohesive and engaging experience.

‍

‍‍Poetry in Motion combines Particle's Photon 2, Adafruit’s Triple-axis Accelerometer, and OpenAI’s API for real-time poetry generation, and a carefully crafted multisensory environment. Participants interact with the installation using a motion-sensing wand, with their movements generating unique poetic expressions.

‍

‍Exploration into motion sensors, AI-driven poetry creation, and multi-sensory feedback highlighted the need for precise technology integration. Testing various sensors and AI models was crucial in developing a system that could respond fluidly to participants' movements.

The journey began with an personal idea that turned into a collaborative project, during a pin-up idea critique session for our final semester project.

‍

‍

Towards the end, two of my classmates approached me, saying they would love to work together on my project idea. I was definitely surprised by their unexpected interest.

However, their enthusiasm was both affirming and motivating, transforming my solo venture into a promising team project. This phase was filled with excitement and the shared anticipation of what we could create together.

With the team established, we dove into developing the concept, refining the idea, and exploring its potential. Assigning roles was a natural process, as each team member gravitated towards their strengths and interests.

We faced the challenge of integrating our diverse skills and interests into a cohesive development strategy early on, but I tried to work it out rather quickly, ensuring that each contribution was both valued and pivotal to the project's success.

I also enlisted the help of my mentor, Professor Purin Phanichphant, who contributed to the FigJam board in the planning stage.

‍

‍

The prototyping phase was super important, focusing on the integration of Adafruit’s ADXL326 accelerometer and OpenAI API for real-time poetry generation. We encountered some significant challenges in calibrating the accelerometer to accurately translate physical movements into digital signals.

Additionally, the shift from ZeroWidth (which we initially planned to use) to OpenAI's API just days before the showcase added pressure, necessitating rapid adaptation and extensive testing to ensure seamless interaction.

‍

‍

The final setup looked like this. We had a microcontroller connected to the accelerometer on a breadboard and wires connecting that to a force sensor which we used as a trigger to start generating poetry. The force sensor was attached to the top of the wand for easy access to the user - ergonomics.

‍

‍

‍