AMALT on Track: From Prototype Development to Evaluation and Demonstration

AMALT moves towards a working prototype

The AMALT project – Automated Monitoring and Advice for Optimization of Learning Trajectories – has reached an important stage in its development. We are currently working intensively on Work Package 4, in which the technological components come together in a functioning prototype. At the same time, we are gradually preparing the transition to Work Package 5, which will focus on evaluating, demonstrating and further refining the developed solution.

The progress achieved so far gives us every reason to be positive.

We see opportunities to further strengthen the prototype, broaden the insights it provides and generate additional value for the Netherlands Ministry of Defence. We fully intend to make use of that opportunity.

Supporting adaptive and data-driven learning

AMALT explores how learning and performance data can be used to make learning pathways within the Ministry of Defence more adaptive, effective and responsive to individual needs. In many traditional learning environments, participants follow largely predetermined programmes. However, learners differ in their prior knowledge, experience, learning pace, performance and development needs.

A more adaptive approach can take these differences into account. By continuously monitoring relevant data, it becomes possible to gain a more accurate understanding of a learner’s progress and current level. These insights can subsequently be translated into appropriate advice, interventions or recommendations for the next step in the learning process.

AMALT aims to demonstrate this principle through a working prototype. The prototype is being designed to collect and structure different types of learning and performance data, interpret that information and present relevant insights to different users. Depending on their role, learners, instructors, training developers and managers may each require different information and recommendations.

The objective is not to replace professional judgement. Instead, AMALT is intended to support users by making relevant information more accessible and enabling decisions to be based on a richer and more current understanding of the learner and the learning process.

From requirements and design to a working prototype

The previous work packages established the foundation needed to develop the AMALT prototype. User needs and requirements were explored, relevant data standards and technical possibilities were examined, and the architecture and functional design were developed further.

This preparatory work was essential. A solution such as AMALT requires more than a dashboard or a stand-alone algorithm. It involves an interconnected process in which data is collected, exchanged, interpreted and translated into information that users can understand and apply. Considerations such as interoperability, modularity, data quality, transparency and usability therefore play an important role.

Within Work Package 4, these different elements are now coming together. We are working on the technological development and integration of the prototype’s components. This includes:

• Connecting learning data with information about the learner’s profile and current status.
• Developing the logic through which data can be interpreted.
• Translating the resulting insights into relevant recommendations.

We are also paying close attention to how progress, signals and advice are presented. Even a technically advanced system will only add value if users can understand the information it provides and use it in practice. The user environment must therefore present complex information in a clear, relevant and role-appropriate manner.

A key principle throughout this development is modularity. AMALT should not become a solution that can only be used for one specific course, programme or training context. The prototype must demonstrate an approach that can eventually be adapted, expanded and connected to the broader learning ecosystem of the Ministry of Defence.

A gradual transition to Work Package 5

As the prototype becomes increasingly tangible, the project is gradually moving towards Work Package 5. This work package focuses on evaluating the developed solution and determining whether it meets the needs identified earlier in the project.

The transition from Work Package 4 to Work Package 5 is deliberately gradual. Development and evaluation are not treated as completely separate phases. Instead, we work iteratively: components are developed, tested and improved based on observations and feedback. This allows us to use initial findings immediately and refine the prototype while development is still ongoing.

During Work Package 5, we will assess several aspects of the solution:

• Whether the prototype provides relevant and understandable progress information.
• Whether its recommendations are useful and explainable.
• Whether the solution effectively supports users in making informed decisions.
• Whether the user experience meets the needs of different roles.

• Learners may primarily want to understand their progress and next step.
• Instructors may need signals that indicate where guidance or intervention is required.
• Managers and other stakeholders may need more aggregated information to identify patterns and support decision-making at a broader level.

The evaluation will therefore help us understand not only whether the technology works, but also how it functions within the practical reality of learning and development at the Ministry of Defence.

Presenting the results within the Ministry of Defence

Several internal presentations are planned within the Ministry of Defence in the coming period. These presentations represent an important milestone for the project. They will allow us to share the progress achieved so far, demonstrate the prototype and show how the original AMALT vision has been translated into a concrete technological solution.

The presentations will cover the complete AMALT process: from collecting and structuring learning data to interpreting performance and presenting progress information and recommendations. This will make it possible for stakeholders to see how the different technical and educational elements are connected.

However, these sessions are not only intended to present results. They also provide an opportunity to engage with prospective users, subject-matter experts and other stakeholders. Their questions, observations and feedback will help us validate the choices made and identify opportunities for further improvement.

This dialogue is particularly valuable as we enter the evaluation phase. It will help ensure that the prototype remains connected to operational requirements and that future development focuses on functionality that delivers genuine value.

On track and ready to overdeliver

AMALT is progressing very well. We are comfortably on track and expect to meet the original objectives and deliverables. At the same time, the progress made in Work Package 4 has created room to explore additional possibilities.

Our ambition is therefore not merely to complete what was agreed, but to overdeliver where this creates demonstrable value. This could involve:

• Enriching the progress information.
• Adding relevant signals for guidance.
• Strengthening the role-based presentation of insights.
• Demonstrating broader possibilities for future application.

Overdelivering does not mean adding complexity for its own sake. Any additional development must contribute to the objectives of AMALT and the wider ambitions of the Ministry of Defence. Our focus remains on developing a solution that is usable, explainable, scalable and relevant to practice.

The coming period will be characterised by continued development, careful evaluation and active engagement with stakeholders. With the transition from Work Package 4 to Work Package 5, AMALT is moving another step closer to a tested prototype that demonstrates how data-driven and adaptive learning can be supported in practice.