基于增强现实技术的智能沙盘教学演示系统

INTELLIGENT SANDBOX FOR TEACHING BASED ON AUGMENTED REALITY TECHNOLOGIES

纪显俐

11749196

硕士

计算机技术

杨双华

2019-05-30

2019-06-28

哈尔滨工业大学

深圳

增强现实技术由虚拟现实技术发展而来，在军事、娱乐、旅游和教育等领域都有较成熟的应用。传统教学活动中，课堂教学的课程形式较为单一，在真实感和形象化方面有所欠缺。增强现实技术与教学活动的结合，可以为学习者创造沉浸式学习环境，有助于提高教学效率和增强学生学习热情，促进学习效果。 在Unity3D平台上，将增强现实技术与地理教学活动相结合，设计并实现一个智能沙盘教学演示系统。该系统具备深度数据处理、投影矩阵变换、地形渲染、流体模拟、物理特性、沿坡添加游戏对象、日照角变化、键盘交互等基本功能。利用红外线深度传感器扫描实体沙盘的地形，将深度数据转换成依据深度渐变的彩色图像，通过投影仪投影到沙盘上。投影的成像随着沙堆深度改变而逐渐呈现大陆架、海岸、陆地、湖泊、河流、山丘、雪山等地貌。学生可以在沙盘上根据意愿堆积出如陡坡、山峰、山脊、山谷和陡崖等常见的地形部位。可以在投影校正、添加实体、季节切换、天气特效、灾害模拟等多个场景下与系统实现互动。该系统和相关地理知识点教学内容切合，学生在互动体验中，学习等高线、地形地势、日照角等知识点内容。本系统的设计与实现给基于增强现实技术的地理教学用具提供一种新的形式和思路。

Augmented reality is evolved from virtual reality and has mature applications in military, entertainment, tourism and education.In the traditional teaching activities, the curriculum of classroom teaching is relatively simple, and there is a lack of realism and visualization.The combination of augmented reality and teaching activities can create an immersive learning environment for students, which can improve teaching efficiency and enhance students' learning enthusiasm and promote learning outcomes.    On the Unity3D platform, augmented reality and geography teaching activities are combined to design and implement an intelligent sandbox teaching demonstration system.The system has basic functions such as deep data processing, projection matrix transformation, terrain rendering, fluid simulation, physical characteristics, adding game objects along the slope, changes in sunshine angle, and keyboard interaction.The infrared depth sensor is used to scan the terrain of the solid sandbox, and the depth data is converted into a color image according to the depth gradient, which is projected onto the sandbox by the projector.The image gradually shows the continental shelf, coast, land, lake, river, hill, snow mountain and other landforms as the depth of the sand changes.Students can pile up common terrain such as steep slopes, mountains, ridges, valleys and cliffs on the sandbox.Students can interact with the system in multiple scenarios such as projection correction, adding entities, seasonal switching, weather effects, and disaster simulation.The system and the related geographic knowledge points are in harmony with each other. Students learn the contour points such as contour lines, topographical terrain, and sunshine angles in the interactive experience.The design and implementation of the system provides a new form and idea for geography teaching tools based on augmented reality.

unity3d 地理教学 增强现实技术 着色器 沙盘

Unity3d geography teaching augmented reality technology shader sand table

中文

联合培养

南方科技大学

纪显俐. 基于增强现实技术的智能沙盘教学演示系统[D]. 深圳. 哈尔滨工业大学,2019.