cyber squat

Experience Design

VR app that encourages active and mindful engagement with online content

when
duration, year
36 hours, Fall 2024

Where

location, type
Stanford, Hackathon

who

the team
Myself + team of 2

Which

skills, tools
Miro, Figma, Unity 3D, Meta SDK

ROle

my responsibilities
Player Experience & Interface Designer

Methods

techniques used
Brainstorming, User Testing

Project Overview

01

Inspiration

In a world increasingly dominated by technology, sedentary lifestyles have become a significant health concern. Our team was inspired to address this challenge by creating a solution that not only promotes physical activity but also integrates seamlessly into people's daily routines. We recognized the potential of VR to provide immersive experiences and saw an opportunity to leverage AI and mixed reality to make fitness engaging, fun, and accessible to everyone. Our goal was to transform the way people perceive exercise—turning it from a chore into an enjoyable part of their entertainment time.

02

Problem Statement

  • Sedentary Screen Time: With the rise of streaming services and digital content, people spend a substantial amount of time sitting, doom-scrolling and engaging in passive entertainment.
  • Lack of Motivation for Exercise: Traditional workouts can feel monotonous, and many people struggle to stay motivated to maintain a regular fitness routine.
  • Accessibility Challenges: Individuals with mobility issues often face barriers to participating in conventional fitness activities.
  • Integration of Technology and Health: There is a need for innovative solutions that combine technology with health benefits without sacrificing entertainment value.

  • Sedentary Screen Time: With the rise of streaming services and digital content, people spend a substantial amount of time sitting, doom-scrolling and engaging in passive entertainment.
  • Lack of Motivation for Exercise: Traditional workouts can feel monotonous, and many people struggle to stay motivated to maintain a regular fitness routine.
  • Accessibility Challenges: Individuals with mobility issues often face barriers to participating in conventional fitness activities.
  • Integration of Technology and Health: There is a need for innovative solutions that combine technology with health benefits without sacrificing entertainment value.

  • Promote Physical Activity: Encourage users to stay active by integrating exercise into their entertainment time.
  • Enhance User Engagement: Make fitness fun and engaging through interactive gameplay and entertaining features.
  • Ensure Accessibility: Design the game to be inclusive, offering alternative exercises for users with varying mobility levels.
  • Leverage AI and Mixed Reality: Utilize AI for real-time feedback and create experiences unique to mixed reality that cannot be replicated elsewhere.
  • Contribute to Social Good: Address public health concerns related to sedentary lifestyles and promote overall well-being.
  • (And win something at Immerse the Bay hackathon)
  • As part of a multidisciplinary team at the Immerse the Bay 2024 hackathon, my roles included:

    • Concept Development: Collaborated on a 6-hour long team brainstorming session to define the game's core mechanics and features.
    • UX/UI Design: Designed intuitive interfaces and visual elements to enhance user experience.
    • Accessibility Features: Developed alternative exercise options and ensured the game was inclusive for users with mobility issues.
    • Presentation Preparation: Assisted in preparing the demo and presentation that contributed to winning 2nd place in the Meta for Developers primary track.
  • Market Analysis: Identified a gap in the market for VR fitness games that seamlessly integrate with entertainment content.
  • User Needs Assessment: Recognized the importance of making exercise enjoyable and accessible to increase adherence.
  • Technology Exploration: Investigated the capabilities of mixed reality and AI to create unique and engaging user experiences.
  • Accessibility Standards: Researched best practices for designing inclusive fitness programs accommodating various physical abilities.
  • Real-Time Exercise Detection

    • Challenge: Implementing accurate squat detection that responds instantly to user movements.
    • Solution: Utilized AI algorithms and pose estimation models to achieve reliable real-time tracking.

    Keeping Users Engaged

    • Challenge: Ensuring the game remains fun and motivating over time.
    • Solution: Developed a compelling rewards system with points, achievements, and unlockable content to encourage continued play.

    Accessibility for Users with Mobility Issues

    • Challenge: Designing exercises and interactions suitable for users with varying physical abilities.
    • Solution: Included alternative exercises and adjustable difficulty levels, ensuring inclusivity without compromising the game's core mechanics.

    Seamless Integration of AI Coach

    • Challenge: Making the AI coach's interactions feel natural and engaging.
    • Solution: Wrote diverse and personality-rich dialogues for the kitty, incorporating humor and emotional depth to enhance user connection.

    Heading 1

    Heading 2

    Heading 3

    Heading 4

    Heading 5
    Heading 6

    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.

    Block quote

    Ordered list

    1. Item 1
    2. Item 2
    3. Item 3

    Unordered list

    • Item A
    • Item B
    • Item C

    Text link

    Bold text

    Emphasis

    Superscript

    Subscript

    03

    Goals and Objectives

  • Promote Physical Activity: Encourage users to stay active by integrating exercise into their entertainment time.
  • Enhance User Engagement: Make fitness fun and engaging through interactive gameplay and entertaining features.
  • Ensure Accessibility: Design the game to be inclusive, offering alternative exercises for users with varying mobility levels.
  • Leverage AI and Mixed Reality: Utilize AI for real-time feedback and create experiences unique to mixed reality that cannot be replicated elsewhere.
  • Contribute to Social Good: Address public health concerns related to sedentary lifestyles and promote overall well-being.
  • (And win something at Immerse the Bay hackathon)
  • 04

    Roles and Responsibilities

    As part of a multidisciplinary team at the Immerse the Bay 2024 hackathon, my roles included:

    • Concept Development: Collaborated on a 6-hour long team brainstorming session to define the game's core mechanics and features.
    • UX/UI Design: Designed intuitive interfaces and visual elements to enhance user experience.
    • Accessibility Features: Developed alternative exercise options and ensured the game was inclusive for users with mobility issues.
    • Presentation Preparation: Assisted in preparing the demo and presentation that contributed to winning 2nd place in the Meta for Developers primary track.
    05

    Research and Insights

  • Market Analysis: Identified a gap in the market for VR fitness games that seamlessly integrate with entertainment content.
  • User Needs Assessment: Recognized the importance of making exercise enjoyable and accessible to increase adherence.
  • Technology Exploration: Investigated the capabilities of mixed reality and AI to create unique and engaging user experiences.
  • Accessibility Standards: Researched best practices for designing inclusive fitness programs accommodating various physical abilities.
  • 06

    Design Process

    1. Conceptualization

    • Idea Refinement: Decided on the core mechanic of using squats to keep videos playing, blending exercise with entertainment.
    • Character Selection: Chose the AI kitty coach with distinct emotional modes (idle, happy, angry, crying) to interact with the user dynamically.

    2. Prototyping

    • User Interface Design: Developed UI elements that display squat scores, streaks, workout time, and calories burned in intuitive ways.
    • Visual Elements: Designed engaging graphics to enhance the visual appeal of the game.

    3. Development

    • Emotional Responses: Scripted a variety of comments and reactions for the AI coach to provide motivation and humor.
    • Accessibility Features: Included alternative exercises like seated leg raises and arm movements for users with mobility issues.

    4. Testing and Iteration

    • User Testing: Conducted tests to gather feedback on gameplay mechanics, UI clarity, and overall user experience.
    • Refinement: Made iterative improvements based on feedback, focusing on enhancing engagement and accessibility.

    07

    Challenges and Solutions

    Real-Time Exercise Detection

    • Challenge: Implementing accurate squat detection that responds instantly to user movements.
    • Solution: Utilized AI algorithms and pose estimation models to achieve reliable real-time tracking.

    Keeping Users Engaged

    • Challenge: Ensuring the game remains fun and motivating over time.
    • Solution: Developed a compelling rewards system with points, achievements, and unlockable content to encourage continued play.

    Accessibility for Users with Mobility Issues

    • Challenge: Designing exercises and interactions suitable for users with varying physical abilities.
    • Solution: Included alternative exercises and adjustable difficulty levels, ensuring inclusivity without compromising the game's core mechanics.

    Seamless Integration of AI Coach

    • Challenge: Making the AI coach's interactions feel natural and engaging.
    • Solution: Wrote diverse and personality-rich dialogues for the kitty, incorporating humor and emotional depth to enhance user connection.

    08

    Final Product

    Cyber Squat offers a unique and engaging fitness experience that:

    • Transforms Screen Time: Users perform squats and other exercises to keep their videos playing, turning passive entertainment into active engagement.
    • Features a Dynamic AI Coach: The adorable kitty provides real-time feedback, motivation, and humor, reacting to the user's performance.
    • Promotes Accessibility: Alternative exercises and adjustable settings make the game inclusive for users of all mobility levels.
    • Enhances User Engagement: Intuitive UI displays key metrics like squat scores, streaks, workout time, and calories burned, motivating users through visual progress.
    • Works in Mixed Reality: Creates an immersive environment that combines the physical and digital worlds in ways not possible with other mediums.
    09

    Results and Impact

  • Hackathon Success: CyberSquat won 2nd place in the primary track under Meta at Immerse the Bay 2024.
  • Positive Feedback: Received enthusiastic responses from judges and participants, particularly praising the game's fun approach to fitness and inclusivity.
  • Potential for Real-World Impact: Demonstrated the ability to encourage healthier lifestyles by making exercise enjoyable and accessible.
  • 10

    Guiding Principle

    More projects

    this page is still in the works

    Please check back again in a week.
    Thank you :)
    Animation by Artemiy on LottieFiles

    Heading 1

    Heading 2

    Heading 3

    Heading 4

    Heading 5
    Heading 6

    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.

    Block quote

    Ordered list

    1. Item 1
    2. Item 2
    3. Item 3

    Unordered list

    • Item A
    • Item B
    • Item C

    Text link

    Bold text

    Emphasis

    Superscript

    Subscript

    Heading 1

    Heading 2

    Heading 3

    Heading 4

    Heading 5
    Heading 6

    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.

    Block quote

    Ordered list

    1. Item 1
    2. Item 2
    3. Item 3

    Unordered list

    • Item A
    • Item B
    • Item C

    Text link

    Bold text

    Emphasis

    Superscript

    Subscript

    As part of a multidisciplinary team at the Immerse the Bay 2024 hackathon, my roles included:

    • Concept Development: Collaborated on a 6-hour long team brainstorming session to define the game's core mechanics and features.
    • UX/UI Design: Designed intuitive interfaces and visual elements to enhance user experience.
    • Accessibility Features: Developed alternative exercise options and ensured the game was inclusive for users with mobility issues.
    • Presentation Preparation: Assisted in preparing the demo and presentation that contributed to winning 2nd place in the Meta for Developers primary track.
  • Market Analysis: Identified a gap in the market for VR fitness games that seamlessly integrate with entertainment content.
  • User Needs Assessment: Recognized the importance of making exercise enjoyable and accessible to increase adherence.
  • Technology Exploration: Investigated the capabilities of mixed reality and AI to create unique and engaging user experiences.
  • Accessibility Standards: Researched best practices for designing inclusive fitness programs accommodating various physical abilities.
  • Real-Time Exercise Detection

    • Challenge: Implementing accurate squat detection that responds instantly to user movements.
    • Solution: Utilized AI algorithms and pose estimation models to achieve reliable real-time tracking.

    Keeping Users Engaged

    • Challenge: Ensuring the game remains fun and motivating over time.
    • Solution: Developed a compelling rewards system with points, achievements, and unlockable content to encourage continued play.

    Accessibility for Users with Mobility Issues

    • Challenge: Designing exercises and interactions suitable for users with varying physical abilities.
    • Solution: Included alternative exercises and adjustable difficulty levels, ensuring inclusivity without compromising the game's core mechanics.

    Seamless Integration of AI Coach

    • Challenge: Making the AI coach's interactions feel natural and engaging.
    • Solution: Wrote diverse and personality-rich dialogues for the kitty, incorporating humor and emotional depth to enhance user connection.

    Heading 1

    Heading 2

    Heading 3

    Heading 4

    Heading 5
    Heading 6

    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.

    Block quote

    Ordered list

    1. Item 1
    2. Item 2
    3. Item 3

    Unordered list

    • Item A
    • Item B
    • Item C

    Text link

    Bold text

    Emphasis

    Superscript

    Subscript