AMALT on Track: From Prototype Development to Evaluation and Demonstration

AMALT is moving toward a working prototype

The AMALT project— Automated Monitoring and Advice for Optimization of Learning Trajectories —has reached an important stage in its development. We are currently working intensively on Work Package 4, in which the technological components are being integrated into a functioning prototype. At the same time, we are gradually preparing for the transition to Work Package 5, which will focus on evaluating, demonstrating, and further refining the developed solution.

The progress made so far gives us every reason to be optimistic.

We see opportunities to further enhance the prototype, expand the insights it provides, and generate additional value for the Dutch Ministry of Defense. We fully intend to take advantage of that opportunity.

Supporting adaptive and data-driven learning

AMALT explores how learning and performance data can be used to make learning pathways within the Ministry of Defense more adaptive, effective, and responsive to individual needs. In many traditional learning environments, participants follow largely predetermined programs. However, learners differ in their prior knowledge, experience, learning pace, performance, and development needs.

A more adaptive approach can take these differences into account. By continuously monitoring relevant data, it becomes possible to gain a more accurate understanding of a learner’s progress and current level. These insights can then be translated into appropriate advice, interventions, or recommendations for the next step in the learning process.

AMALT aims to demonstrate this principle through a working prototype. The prototype is being designed to collect and organize different types of learning and performance data, interpret that information, and present relevant insights to different users. Depending on their role, learners, instructors, training developers, and managers may each require different information and recommendations.

The objective is not to replace professional judgment. Instead, AMALT is designed to support users by making relevant information more accessible and enabling decisions to be based on a richer and more up-to-date understanding of the learner and the learning process.

From requirements and design to a working prototype

The previous work packages laid the groundwork needed to develop the AMALT prototype. User needs and requirements were identified, relevant data standards and technical possibilities were evaluated, and the architecture and functional design were further developed.

This preparatory work was essential. A solution such as AMALT requires more than just a dashboard or a standalone algorithm. It involves an interconnected process in which data is collected, exchanged, interpreted, and translated into information that users can understand and apply. Factors such as interoperability, modularity, data quality, transparency, and usability therefore play an important role.

Within Work Package 4, these various elements are now coming together. We are working on the technological development and integration of the prototype’s components. This includes:

• Linking learning data with information about the learner’s profile and current status.
• Developing the logic used to interpret data.
• Translating the resulting insights into relevant recommendations.

We are also paying close attention to how progress, notifications, and advice are presented. Even a technically advanced system will only add value if users can understand the information it provides and apply it in practice. The user interface must therefore present complex information in a clear, relevant, and role-appropriate manner.

A key principle throughout this development is modularity. AMALT should not become a solution that can only be used for a single specific course, program, or training context. The prototype must demonstrate an approach that can eventually be adapted, expanded, and integrated into the broader learning ecosystem of the Ministry of Defense.

A gradual transition to Work Package 5

As the prototype becomes increasingly tangible, the project is gradually moving toward Work Package 5. This work package focuses on evaluating the developed solution and determining whether it meets the needs identified earlier in the project.

The transition from Work Package 4 to Work Package 5 is intentionally gradual. Development and evaluation are not treated as completely separate phases. Instead, we work iteratively: components are developed, tested, and improved based on observations and feedback. This allows us to apply initial findings immediately and refine the prototype while development is still underway.

During Work Package 5, we will evaluate several aspects of the solution:

• Whether the prototype provides relevant and understandable progress information.
• Whether its recommendations are useful and explainable.
• Whether the solution effectively helps users make informed decisions.
• Whether the user experience meets the needs of different roles.

• Learners may primarily want to understand their progress and what to do next.
• Instructors may need cues to indicate when guidance or intervention is needed.
• Managers and other stakeholders may need more aggregated information to identify patterns and support decision-making at a broader level.

The evaluation will therefore help us understand not only whether the technology works, but also how it functions within the practical context of learning and development at the Ministry of Defense.

Presenting the results within the Ministry of Defense

Several internal presentations are planned within the Ministry of Defense in the coming period. These presentations represent an important milestone for the project. They will allow us to share the progress made so far, demonstrate the prototype, and show how the original AMALT vision has been translated into a concrete technological solution.

The presentations will cover the entire AMALT process: from collecting and organizing learning data to interpreting performance and presenting progress reports and recommendations. This will enable stakeholders to see how the various technical and educational elements are interconnected.

However, these sessions are not intended solely to present results. They also provide an opportunity to engage with prospective users, subject-matter experts, and other stakeholders. Their questions, observations, and feedback will help us validate the decisions we have made and identify opportunities for further improvement.

This dialogue is particularly valuable as we enter the evaluation phase. It will help ensure that the prototype remains aligned with operational requirements and that future development focuses on functionality that delivers genuine value.

On track and ready to exceed expectations

AMALT is progressing very well. We are well on track and expect to meet the original objectives and deliverables. At the same time, the progress made in Work Package 4 has opened up opportunities to explore additional possibilities.

Our ambition is therefore not merely to fulfill what was agreed upon, but to exceed expectations where this creates demonstrable value. This could involve:

• Enhancing the progress information.
• Adding relevant signals to provide guidance.
• Strengthening the role-based presentation of insights.
• Demonstrating broader possibilities for future applications.

Delivering more than expected does not mean adding complexity for its own sake. Any additional development must contribute to AMALT’s objectives and the broader ambitions of the Ministry of Defense. Our focus remains on developing a solution that is usable, explainable, scalable, and relevant to real-world practice.

The coming period will be marked by continued development, careful evaluation, and active engagement with stakeholders. With the transition from Work Package 4 to Work Package 5, AMALT is taking another step toward a tested prototype that demonstrates how data-driven and adaptive learning can be supported in practice.