Game Design

• Introduction / Overview

The education of children is a very important and unavoidable part of modern life. For children, they don't have enough self-control to learn, so the way of teaching needs to be interesting enough. This application can help teaching children which depends on AR.

• Description of the application

This app is an aid for learning Chinese. When using this app, you need to display the pre-set image in front of the AR camera. A 3D model of the contents of the image will be displayed on top of the image after successful recognition. Compared with the regular textbook content, AR can directly see the 3D model, adding interest to the teaching content. When the image is recognized, a button will pop up. When the button is clicked, the Chinese name and pronunciation of the item will be displayed and played.

At the same time, there are parts that are not shown in this prototype. In the complete application envisioned, this application would be divided into the student side and the teacher side. For students, using a variety of different picture content can be self-taught. For teachers, the app can be used for classroom quizzes. For example, the classroom clicks a button on any content, plays its pronunciation, and then lets students choose. If you select the correct content and click the button, you can get 1 point after matching the teacher's choice. After multiple rounds, you can show the scoreboard of the class. Competitions can also stimulate students' desire to learn.

• Interaction Design

The first is to identify the interaction of the picture. Only when the AR camera recognizes the picture can a series of subsequent activities be carried out. This recognition function is based on the Vuforia engine plug-in. A 3D model is displayed and a button that says "Spell&Pronounce" is displayed. This button uses the Canvas functionality. In addition, when the image is successfully recognized, the spelling of the content bound to the correct pronunciation is also loaded, but is temporarily set to inactive. The above spelling word object is bound through Canvas, which will be set to active when the button is clicked.

Here's a storyboard: Eason is a six-year-old who has just had his first Chinese learning lesson. Eason himself was not interested in this class, but when the teacher introduced this software, he became interested in it. He often learns by himself through this software after class. During a classroom test, the teacher will compete with the software. The teacher clicked a button and made a "Ping Guo" sound. Eason found the Apple image and gave it to the AR camera for recognition, then clicked the button on it. The text for "apple" and the pronunciation of "Ping Guo" popped up in the app, so Eason got 1 point on the score. Eason answered 19 of the 20 questions correctly and finished first in the standings, which made him very happy.

• Technical Development

The app can be used on any windows computer with a built-in or connected camera. In use, you only need to display the set picture in front of the camera so that it can recognize. Once the image has been identified, the image can be rotated to view the 3D model from all angles. The Chinese name and pronunciation of the model can be displayed by clicking the button with the mouse.

• Descriptions of 3D Models

This is a model of an apple, just like in real life.

This is a model of a banana, cartoon style.

• Reference

Dayoo, Aug 18^th 2023, ‘Big city famous garden all things harmonious | more sweet and better preserved? Banana Freedom is just around the corner!’, viewed Sep 29^th, < https://news.dayoo.com/guangzhou/202308/18/139995_54539189.htm>

Lumo-Art 3D, Sep 19^th 2017, ‘FREE Casual Food Pack- Mobile/VR’, viewed Sep 29^th, <https: assetstore.unity.com="" packages="" 3d="" props="" food="" free-casual-food-pack-mobile-vr-85884=""></https:>

Rowntec Assets, Jun 29^th 2017, ‘Survival Kit Lite’, viewed Sep 29^th, < https://assetstore.unity.com/packages/3d/props/tools/survival-kit-lite-92549>

Snow Monkey Resorts, Mar 2^nd 2021, ‘Nagano Apple: One of the best apples in Japan’, viewed Sep 29^th, <https: www.snowmonkeyresorts.com="" zh-hans="" activities="" fruits-of-nagano="" nagano-apples-some-of-the-best-in-japan=""></https:>