Experiential Design | Task 1 : Trending Experience
23.9.2024 -15.9.2024 / Week 1- Week 4
Zhao GuanMei / 0363166
Experiential Design / Bachelor of Design (Hons) in Creative Media
Task 1: Trending Experience
INDEX
Lecture 1: AR Design Workshopz
Lecture 2: Designing Experiences
Lecture
3: User Controls and UI (Buttons)
Lecture 4: Markerless AR Experience
Exercise
Task 1: Trending Experience
Research
B. Ideation
C. Development
Final Task 1: Trending
Experience
Reflections
INSTRUCTION
LECTURES
EXERCISE
Week 1
Imagine the scenario in either of the two places. what would the AR experience be and what extended visualization can be useful? What do you want the user to feel? (Kitchen / Shopping Mall / Gym)
1.Kitchen
Problem Statement:
The user enters the kitchen, hoping to prepare
a healthy meal but faces several difficulties:
- Unsure what to cook with the ingredients on hand.
- Struggles with managing time between different cooking processes.
- Worries about overcooking or undercooking the meal.
- Uncertain how to plate the food aesthetically.
Upon entering the kitchen, the AR assistant scans the available ingredients, and suggests a recipe, automatically calculating the nutritional value and calories of the meal. The user confirms the recipe, and AR adjusts the portion sizes based on how many servings are needed.
Once the user confirms the recipe, AR adjusts portion sizes based on the number of servings. Throughout the process, the AR system highlights steps, guiding the user with virtual overlays, timers, and real-time feedback on cooking progress.
The AR system also provides interactive encouragement after each step, ensuring an engaging experience. When the food is ready, AR offers plating suggestions, assisting with aesthetic presentation and garnish placement for a professional look. A final nutritional recap ensures the user can log their meal or share it easily, enhancing both their cooking skills and overall experience.
Extended Visualization
It provides detailed nutritional profiles for ingredients, dynamically adjusts portion sizes on-screen, and offers short instructional videos for complex cooking techniques. A multitasking dashboard displays timers, temperature settings, and progress bars in one place, streamlining the cooking process. Users can access virtual cooking classes in real-time and share pictures of their completed dishes on social media.
User Feelings:
With the help of AR, the user overcomes their initial difficulties. The system simplifies decision-making, manages time efficiently, provides real-time guidance to prevent mistakes, and makes the final plating process enjoyable. The user finishes with a well-cooked, healthy meal, feeling confident, relaxed, and proud of their accomplishment.
reference:https://showcase.tha.de/ia-ims/guided-cooking-with-ar
2. Clothes Shopping
Problem Statement:
- Unsure which clothes will fit well without trying on multiple items.
- Difficulty visualizing how different styles look on their body.
- Overwhelmed by the available options and special offers.
- Uncertain about which sizes and colors would suit them best.
Ideation
1. AR Cooking Assistant (with Interactive Companionship)
Problem Statement: Many novice cooks struggle to follow written or video recipes, leading to frustration due to difficulty in managing timing, techniques, and ingredients. There is also a lack of engaging, real-time support, making the cooking process feel overwhelming and lonely. There’s a need for an interactive guide that not only provides step-by-step instructions but also offers real-time companionship to make cooking more enjoyable and less intimidating.Solution: The AR Cooking Assistant provides an animated virtual chef that not only guides users through recipes but also offers interactive companionship, creating an engaging and supportive cooking experience. The virtual chef appears in AR, demonstrating techniques, giving real-time feedback, and even interacting with users through casual conversation or encouragement. This creates a more social and motivating atmosphere, transforming cooking from a solitary task into a fun, interactive activity.
Key Features:
- Interactive Companionship: The virtual chef offers not just guidance, but also companionship, chatting with users, offering tips, and encouraging them throughout the process.
- Step-by-step Guidance: The virtual chef demonstrates cooking techniques with real-time AR visuals, helping users follow the recipe more easily.
- Hands-free Operation: Users can control the AR assistant with voice commands, making it easy to cook without interrupting the process.
- Real-time Feedback and Reminders: The assistant tracks cooking progress, offers timing reminders, and adjusts instructions based on real-time actions.
-
Customizable Recipes: Users can modify recipes with
ingredient substitutions, portion adjustments, and cooking preferences.
Pros:
- Enhances the cooking experience by making it interactive and engaging.
- Reduces frustration by providing real-time assistance .
- Encourages novice cooks to experiment and gain confidence in the kitchen.
Cons:
- It is not very convenient for users who use mobile phones.
- Development and maintenance could be costly and complex.
- May depend on a stable internet connection for optimal functionality.
2. AR Toothbrushing Guide for Children
Problem Statement: Teaching children proper dental hygiene is often difficult, as they tend to lose interest or fail to brush their teeth effectively. Parents struggle to instill good brushing habits and proper technique in their children. There is a need for a fun, interactive solution to keep children engaged while teaching them to brush their teeth correctly.Solution: This AR app turns toothbrushing into a fun and educational experience for children. By scanning their toothbrushes, animated characters guide them in applying toothpaste and brushing in the right way. Using AR, a 3D tooth model appears when children take selfies, showing areas they need to brush. Fun animations of bacteria on the teeth turn brushing into a game, where kids eliminate the bacteria by brushing properly. The app also tracks progress and rewards good brushing habits, making it a playful yet educational tool for both children and parents.
Key Features:
- AR scanning of toothbrush to trigger animated brushing guides.
- 3D tooth models to visually teach brushing techniques.
- Fun, game-like interaction with bacteria that are "cleaned" away through brushing.
- Progress tracking and rewards to encourage consistent brushing.
- Tips for parents to monitor and support children's dental hygiene.
Pros:
- Makes learning about dental hygiene fun and engaging for children.
- Encourages consistent brushing habits through gamification and rewards.
- Provides parents with tools to track and support their children’s dental care.
Cons:
- May require parental supervision to ensure proper usage.
- Children might become overly reliant on the app instead of developing independent brushing habits.
3. AR Gallery for Interactive Art Exhibitions
Problem Statement: Access to art galleries is often limited due to geographical, financial, or space constraints, and traditional galleries lack interactive elements to engage younger audiences. There is a need for a dynamic, accessible way to experience and engage with art, making it more appealing and interactive for diverse audiences.
Solution:
The AR Gallery allows users to bring art to life by scanning gallery books
or physical art catalogs to reveal 3D and animated versions of the
artwork. Instead of simply viewing static images, users can point their
mobile devices at pages in a gallery book, and the artwork will come to
life in AR, showing 3D sculptures, moving animations, or interactive
installations. Users can zoom in, rotate, or interact with the virtual art
pieces. This enhances engagement, especially for younger audiences, by
providing a dynamic, hands-on experience that bridges physical art with
digital interactivity. The app offers rich information about the artists
and their work, turning any gallery book into a highly immersive and
educational experience.
Key Features:
-
3D & Animated Artworks:
Scanning pages of a gallery book transforms static images into 3D
sculptures or animated art pieces, allowing users to engage with the
art in a more interactive way.
-
Interactive Exploration:
Users can zoom in, rotate, or interact with virtual art to examine
details or discover hidden elements.
-
Educational Information:
The AR Gallery offers pop-up information about the artists, art
techniques, and background of the artwork, enriching the viewing
experience.
-
Customizable Gallery Tours:
Users can curate their own AR gallery experience by selecting artworks
and saving them for later exploration or sharing with friends
online.
-
Space Transformation:
By scanning physical pages, users can place the artwork into their
surroundings, transforming their space into a virtual art
exhibition.
Pros:
-
Increases accessibility to art for a wider audience, including
those unable to visit physical galleries.
-
Engages younger audiences through interactive and dynamic
experiences.
-
Offers educational value, enhancing appreciation for art and
artists.
Cons:
-
The experience could be hindered by technical issues or a lack of
familiarity with AR technology.
-
Development and operational costs could be significant for quality
implementation.
Pros:
- Increases accessibility to art for a wider audience, including those unable to visit physical galleries.
- Engages younger audiences through interactive and dynamic experiences.
- Offers educational value, enhancing appreciation for art and artists.
Cons:
- The experience could be hindered by technical issues or a lack of familiarity with AR technology.
- Development and operational costs could be significant for quality implementation.
4. AR Interactive Storybook - "Magical Forest Adventure"
Project Description: This project is an AR (Augmented Reality) interactive storybook application designed to provide an immersive reading experience for children. By scanning blank spaces or specific illustrations within the book, users can trigger animations or video content related to the storyline, making each page come to life. The story is set in a magical forest where a young girl uses wisdom and magic to help the forest animals solve problems and restore harmony to the land.
2. Target Audience
Children (Ages 5-10): Kids who enjoy stories and interactive experiences, and like to engage with animations, sounds, and simple interactive elements to enhance their understanding of the story.
Parents and Educators: Those looking to foster children's reading interest through fun and interactive methods and to promote their learning and development.
3. Feature Overview
Pattern Recognition to Trigger Animations: Each page's illustrations will trigger corresponding animations or videos when scanned, transforming the static storybook into a dynamic experience that helps children better understand the story.
Video Storytelling: Short videos will narrate each story segment, allowing children to experience the narrative through a combination of animations and text.
Simple Interactive Elements: Each page will contain 1-2 interactive elements (such as buttons or drag-and-drop actions) to trigger animations or transition to the next page, enhancing engagement without making it too complex.
Story Progress Tracking: The app will track the child’s reading progress, allowing them to easily continue where they left off.
Sharing Function (Optional): Parents can share screenshots of the child’s favorite story moments on social media, increasing social interaction.
4. Visual Design Style
Artistic Style: The app will adopt warm, soft colors and a cartoon style, paired with simple and intuitive interface designs. Animations and videos will align with the illustrations in the book to maintain a consistent visual experience. The magical forest will feature whimsical and imaginative elements, such as magical creatures and enchanted trees.
AR Animation Effects: AR technology will be used to render effects like "magic," "healing," and other mystical elements (e.g., light effects when magic is cast, or magical transformations for the animals).
5. User Interface Design
Home Screen:
Displays the storybook cover and a "Start Reading" button. Tapping the button will lead to the first story page.
Reading Screen:
AR Scanning Area: The central area will display the AR camera view. When users scan the designated areas in the book, animations and videos will be triggered.
Control Buttons: There will be pause and continue buttons located at the bottom-right corner for user control.
Progress Indicator: A progress bar will show the user’s current reading progress.
Settings Screen:
Allows volume control and provides instructions for app usage, ensuring a smooth user experience.
Interactive Buttons: Each page will contain 1-2 simple interactive buttons, such as "Help the Deer" or "Cast Magic," which, when tapped, will trigger the corresponding animation or video and move the story forward。
6. Story Structure & Interactive Design
Page 1: The Girl Enters the Magical Forest and Meets the Lost Deer
Interactive Elements:
Button: "Help the Deer" button. Tapping this will trigger an animation of the deer walking toward the girl, and a comforting dialogue will be played.
Auto-transition: After the animation, the app will automatically transition to the next page.
Page 2: The Deer Leads the Girl to an Ancient Tree
Interactive Elements:
Drag-and-Drop: Users will drag fruits from the tree, triggering an animation of the girl collecting them.
Button: "Continue the Adventure" button. Tapping this will transition to the next page.
Page 3: The Girl Uses Magic to Heal a Fox
Interactive Elements:
Button: "Cast Magic" button. Tapping this will trigger an animation of the girl casting a healing spell.
Auto-transition: After the animation, the app will transition to the next page.
Page 4: The Girl Finds the Magical River
Interactive Elements:
Button: "Touch the River" button. Tapping this will trigger an animation of the river sparkling with magical light.
Auto-transition: After the animation, the app will transition to the next page.
Page 5: The Magical Forest is Restored to Harmony
Interactive Elements:
Button: "Celebrate Success" button. Tapping this will trigger an animation of the forest animals gathering in celebration.
Auto-transition: The story ends, and a thank-you message is displayed to the reader.
Visual Reference
Final Task 1: Trending Experience
Project Description: This project is an AR (Augmented Reality) interactive storybook application designed to provide an immersive reading experience for children. By scanning blank spaces or specific illustrations within the book, users can trigger animations or video content related to the storyline, making each page come to life. The story is set in a magical forest where a young girl uses wisdom and magic to help the forest animals solve problems and restore harmony to the land.
2. Target Audience
Children (Ages 5-10): Kids who enjoy stories and interactive experiences, and like to engage with animations, sounds, and simple interactive elements to enhance their understanding of the story.
Parents and Educators: Those looking to foster children's reading interest through fun and interactive methods and to promote their learning and development.
3. Feature Overview
Pattern Recognition to Trigger Animations: Each page's illustrations will trigger corresponding animations or videos when scanned, transforming the static storybook into a dynamic experience that helps children better understand the story.
Video Storytelling: Short videos will narrate each story segment, allowing children to experience the narrative through a combination of animations and text.
Simple Interactive Elements: Each page will contain 1-2 interactive elements (such as buttons or drag-and-drop actions) to trigger animations or transition to the next page, enhancing engagement without making it too complex.
Story Progress Tracking: The app will track the child’s reading progress, allowing them to easily continue where they left off.
Sharing Function (Optional): Parents can share screenshots of the child’s favorite story moments on social media, increasing social interaction.
4. Visual Design Style
Artistic Style: The app will adopt warm, soft colors and a cartoon style, paired with simple and intuitive interface designs. Animations and videos will align with the illustrations in the book to maintain a consistent visual experience. The magical forest will feature whimsical and imaginative elements, such as magical creatures and enchanted trees.
AR Animation Effects: AR technology will be used to render effects like "magic," "healing," and other mystical elements (e.g., light effects when magic is cast, or magical transformations for the animals).
5. User Interface Design
Home Screen:
Displays the storybook cover and a "Start Reading" button. Tapping the button will lead to the first story page.
Reading Screen:
AR Scanning Area: The central area will display the AR camera view. When users scan the designated areas in the book, animations and videos will be triggered.
Control Buttons: There will be pause and continue buttons located at the bottom-right corner for user control.
Progress Indicator: A progress bar will show the user’s current reading progress.
Settings Screen:
Allows volume control and provides instructions for app usage, ensuring a smooth user experience.
Interactive Buttons: Each page will contain 1-2 simple interactive buttons, such as "Help the Deer" or "Cast Magic," which, when tapped, will trigger the corresponding animation or video and move the story forward。
6. Story Structure & Interactive Design
Page 1: The Girl Enters the Magical Forest and Meets the Lost Deer
Interactive Elements:
Button: "Help the Deer" button. Tapping this will trigger an animation of the deer walking toward the girl, and a comforting dialogue will be played.
Auto-transition: After the animation, the app will automatically transition to the next page.
Page 2: The Deer Leads the Girl to an Ancient Tree
Interactive Elements:
Drag-and-Drop: Users will drag fruits from the tree, triggering an animation of the girl collecting them.
Button: "Continue the Adventure" button. Tapping this will transition to the next page.
Page 3: The Girl Uses Magic to Heal a Fox
Interactive Elements:
Button: "Cast Magic" button. Tapping this will trigger an animation of the girl casting a healing spell.
Auto-transition: After the animation, the app will transition to the next page.
Page 4: The Girl Finds the Magical River
Interactive Elements:
Button: "Touch the River" button. Tapping this will trigger an animation of the river sparkling with magical light.
Auto-transition: After the animation, the app will transition to the next page.
Page 5: The Magical Forest is Restored to Harmony
Interactive Elements:
Button: "Celebrate Success" button. Tapping this will trigger an animation of the forest animals gathering in celebration.
Auto-transition: The story ends, and a thank-you message is displayed to the reader.
Visual Reference
REFLECTIONS
Experience
While working on the AR projects, I really
got to see how technology can boost user engagement and make learning a lot
more fun. With the AR Cooking Assistant, it was exciting to create a virtual
companion that not only walks novice cooks through recipes but also offers
encouragement and support. It turns cooking into a more interactive and
social experience. When I was brainstorming the AR Toothbrushing Guide for
Kids, I explored how gamification can be a fantastic educational tool. Fun
animations can really grab kids' attention and teach them the importance of
good dental hygiene. Plus, developing the AR Gallery showed me how AR can
make art more accessible, letting people interact with and appreciate
artwork in their own spaces.
Observations
Throughout this project, I noticed that
user engagement really depends on interactivity, with real-time feedback
being key to enhancing experiences. Companionship emerged as a strong
motivator—just like with the AR Cooking Assistant, where the virtual chef
helps to ease feelings of loneliness in the kitchen. I also saw that not
everyone is on the same level when it comes to tech familiarity. Younger
users tend to adapt quickly to AR applications, while older users might need
simpler interfaces to stay engaged. The AR Gallery's focus on accessibility
really highlighted how technology can help widen art appreciation for
diverse audiences, bridging both geographical and financial gaps.
Findings
Working on these AR applications revealed a
lot of market potential for blending gamification and interactive learning,
which aligns with the rising demand for engaging educational tools. I
learned just how crucial user interface and experience design are for the
success of AR projects—intuitive designs can really boost user satisfaction
and adoption rates. But there are challenges to consider, like high
development and maintenance costs and technical hurdles, which require a
good amount of resources to create a smooth experience. It’s also important
to think about offline capabilities to avoid issues with unstable internet
connections. Lastly, for projects aimed at kids, getting parents involved is
vital to ensure a comprehensive learning experience.
Comments
Post a Comment