Klett AR
Project Overview

In an innovative collaboration with Klett, our development team has crafted a cutting-edge mobile application that is revolutionizing the educational experience for Bulgarian K-12 students. Utilizing advanced Augmented Reality (AR) technology, the application allows students to bring learning to life by scanning their Klett textbooks, resulting in dynamic 3D models that overlay directly onto the textbook pages. Initially rolled out for math and geography textbooks for grades 5 and 6, our app has shown remarkable success and is in the process of expanding to include biology and chemistry content for grades 7 and 8. This gradual and strategic release is designed to optimize user engagement and educational impact.Currently available to all students in Bulgaria, our application has not only enhanced the learning process but also earned our team prestigious accolades, including recognition in Forbes’ 30 Under 30 and multiple European startup awards. With a planned intensive marketing campaign commencing in April, we are poised to elevate the educational experience to new heights, demonstrating our commitment to innovation and excellence in the field of educational technology.
Klett AR CBT
Klett AR CBT
Klett AR CBT
Client Profile

Company Name: Klett BulgariaLocation: Sofia, BulgariaIndustry: Education / PublishingSize: 145 employees
Challenges
  • Revolutionize Education by Digitizing Textbooks: Transform the traditional learning experience by introducing digital elements into existing textbooks.
  • Avoid Reprinting Textbooks: Implement a system that adds digital enhancements without the need for publishers to reprint their textbooks.
  • Manage Extensive Content Delivery: Establish a robust content delivery infrastructure capable of supporting educational materials across all grade levels.
  • Data Collection and Analysis: Implement strategies to gather and analyze user data, helping to identify potential niches and avenues for product expansion.
Solution

In developing our app, we initially utilized Flutter alongside the Unity SDK for the basic framework, with Unity’s AR Foundation handling the Augmented Reality features. However, we decided to remove Flutter from the project due to Unity's introduction of the UI Document system, which provided a more seamless user experience. This allowed us to streamline our development process within a single, cohesive system.

We integrated Firebase for tracking analytics and managing our database, which was crucial for understanding user interactions and improving the app. For the mathematical content, especially non-stereometric math, we incorporated GeoGebra, enhancing our app's educational capabilities. Lastly, we utilized Unity’s Cloud Content Delivery (CCD) for efficiently loading 3D models and image targets on demand, ensuring that our content delivery was both dynamic and responsive to the users' needs. This blend of technologies reflects our commitment to creating an immersive, robust, and educationally enriching application.

Implementation

In January 2023, our development journey for this pioneering software began. Our initial milestone was developing a demo to the Bulgarian Ministry of Education, which received their approval and also generated positive marketing for our client. Buoyed by this success, we progressed to our next goal: developing and releasing a Minimum Viable Product (MVP) to gauge the market's responsiveness to such an innovative educational solution, a first of its kind on this scale. By August 2023, the MVP was successfully completed.

Following the MVP, we shifted our focus to creating a demo version of the application, featuring hardcoded 3D models. This step was crucial for marketing and gaining traction. The demo version was launched in January 2024, marking another significant step forward.

Currently, we are fervently working on the official release of the application. This version will revolutionize content accessibility, allowing on-demand downloading and streaming. This is not just a technological leap but also a strategic move to develop the necessary infrastructure for uploading more content. Moreover, it lays the foundation for expanding the app's reach internationally, an exciting prospect that will take our innovative educational tool to new heights and wider audiences.

Results

The software we have developed stands at the forefront of technological innovation in education. Its state-of-the-art design is not only visually appealing but also highly interactive, providing an engaging user experience. One of its key strengths is the performance efficiency across a wide range of devices, ensuring smooth functionality even on those with lower memory capabilities.

This April marks a significant milestone in our journey, as we initiate the rollout across 30 schools in Bulgaria. This is just the beginning of a larger vision, as we plan to gradually expand the app's reach to encompass all schools utilizing Klett textbooks across the country. This expansion is a testament to our commitment to revolutionize the educational landscape, making advanced learning tools accessible to a broader student population.

Future Plans

Our company is set to initiate the rollout of our cutting-edge app across Bulgaria, marking the first phase of a broader strategy to revolutionize education through technology. Our ambition extends beyond national borders; we aim to leverage the expansive Klett network to bring this innovative tool to students across Europe.

In a significant enhancement to the app's capabilities, we are excited to introduce an AI assistant feature. This assistant, designed to engage students in interactive learning, will offer personalized quizzes and provide explanations for various educational materials upon request. Our decision to base this AI assistant on OpenAI’s GPT model is pivotal, ensuring it is powered by one of the most advanced AI technologies available.

To further augment the AI assistant’s functionality, we will integrate a long-term memory system. This system will utilize vector databases with embeddings derived from textbook materials. Such an approach will not only enhance the AI’s ability to understand and explain complex concepts but also tailor its interactions based on the specific content of each textbook. This level of personalized and interactive learning experience is unprecedented in educational apps, and we are confident it will significantly enrich the learning journey for students.

Conclusion

As we reflect on the journey and achievements of our Klett AR mobile app project, it is evident that we have embarked on a transformative path in the realm of educational technology. Our collaboration with Klett has not only enabled us to break new ground in digitizing textbooks but has also set a new standard in interactive and immersive learning experiences for students across Europe.