Augmented Reality App for Android
The goal was to build an ecosystem which allows students in elementary and high schools to benefit from the Augmented Reality experience during the time spent with textbook while they are learning and exploring - in the classroom or at home.
The aspect of the accessibility of the solution was very important here, because the target customer market are elementary and high schools in the Czech Republic. Unfortunately, in such environment are financial resources of both students and schools very limited. Which defines an important requirement. The solution had to be built with such level of effectiveness and compatibility which would allow our client - the Fraus Media publishing to sell the new augmented reality textbooks for the exactly same price as before, in order to make them affordable to the students and schools.
We developed the companion Android mobile app which needs to run on mobile devices students have in their pockets. Because elementary and high schools in Czech Republic can’t afford to support their students with any hardware.
The solution consisted of development of system which allowed our client to enrich textbooks with augmented reality through the mobile application for Android.
Key features of mobile and web apps:
We developed a JavaScript 3D model viewer based on Three.js library which is integrated into a FRED online educational web platform (developed and maintained by our client). Through this application, students can explore 3D models for every textbook online in their web browser.
We developed AR (Augmented Reality) mobile application for Android devices in Unity Engine. This mobile application is a companion app for textbooks. While reading the book, students can use the Android app with the augmented reality content and interact with it.
Highly optimised and carefully curated and reviewed set of 3D models for each textbook. The 3D models used are precise (for education purposes) and highly optimised (we need to show them both in the web browser and on low-end Android devices).
A pipeline which allows compilation and deployment of the 3D models into the mobile application and online to FRED platform of our client.
The first step of User Experience Analysis (UX) and the user interface is the definition of the target group (user target group) and the discovery of primary actors or their personas - it is necessary to find out who the user is application, how he behaves, what his needs are, what he will use the application for, etc.
The next step is the formulation of User Stories, using which we describe what individual users will be able to do in the application - in what way (and why for what purpose) they will interact with it. Subsequently, we prepare a User Interaction Diagram (UID) that assigns individual User Stories to specific application screens or parts of the system.
The most important result of user experience analysis is the Low Fidelity Prototype (LFP).
It exactly describes how the user interface of each application screen should look like, from which components the screen will be composed and how the user will interact with the screen.
The design is a soul of an app and with a clear idea about user experience of the application, we can focus on this next task. Being based on a thoughtful UX, the design defines if the application is accepted or rejected by its target group.
This design was about simplicity. User interface of an application, which is presenting a visual content, had to be simple and at the same time very clear as the application will be used by very young students.
The tricky part in this project was the required level of optimization we had to meet in order to make the Android mobile app and 3D models compatible even with the low-end Android devices - both tablets and phones. Every single 3D model had to undergo a multiple rounds of careful review process where each and every aspect of its factual precision had to be tested. In average, there were 4 iterations of reviews and adjustments per 3D model.
The augmented reality content is mapped on the image from a textbook. The application is developed in Unity. 3D models are stored locally. Due to the lack of memory on target devices, the application only stores the downloaded data from the cloud for the currently used textbook.
Together with our client, we have managed to bring the Android app to Czech students into their schools within a wonderful period of 2 years full of great feedback from students, their teachers and parents.
We are proud that we had a chance to develop mobile application with such important impact on everyday experience of young minds.
Looking for a technology partner to develop an information system or help with digitization? We will be happy to hear more about your project.