You will be provided with a reference and some statements. Please determine whether each statement is 'supported', 'unsupported', or 'unknown' with respect to the reference. Please note:
First, assess whether the reference contains any valid content. If the reference contains no valid information, such as a 'page not found' message, then all statements should be considered 'unknown'.
If the reference is valid, for a given statement: if the facts or data it contains can be found entirely or partially within the reference, it is considered 'supported' (data accepts rounding); if all facts and data in the statement cannot be found in the reference, it is considered 'unsupported'.

You should return the result in a JSON list format, where each item in the list contains the statement's index and the judgment result, for example:
[
    {
        "idx": 1,
        "result": "supported"
    },
    {
        "idx": 2,
        "result": "unsupported"
    }
]

Below are the reference and statements:
<reference>
Intelligent educational decision-making system driven by multimodal data fusion and knowledge graphs - PMC

This paper presents an intelligent educational decision-making framework that integrates multimodal data fusion with structured knowledge graph reasoning to enhance personalized learning experiences. To address challenges associated with ...

Skip to main content

An official website of the United States government

Here's how you know

Here's how you know

Official websites use .gov

A

.gov
website belongs to an official
government organization in the United States.

Secure .gov websites use HTTPS

A
lock
(

) or
https://
means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.

Search

Log in

Dashboard

Publications

Account settings

Log out

Search…

Search NCBI

Primary site navigation

Search

Logged in as:

Dashboard

Publications

Account settings

Log in

Search PMC Full-Text Archive

Search in PMC

Journal List

User Guide

PERMALINK

Copy

As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with,
the contents by NLM or the National Institutes of Health.

Learn more:

PMC Disclaimer

|

PMC Copyright Notice

Sci Rep
. 2026 Feb 23;16:9610. doi:
10.1038/s41598-025-33066-8

Search in PMC

Search in PubMed

View in NLM Catalog

Add to search

Intelligent educational decision-making system driven by multimodal data fusion and knowledge graphs

Yingzhi Wang

Yingzhi Wang

1
Chongqing Business Vocational College, Employment Guidance Teaching and Research Office, Chongqing, China

Find articles by
Yingzhi Wang

1,
✉

Author information

Article notes

Copyright and License information

1
Chongqing Business Vocational College, Employment Guidance Teaching and Research Office, Chongqing, China

✉
Corresponding author.

Received 2025 Jul 24; Accepted 2025 Dec 16; Collection date 2026.

© The Author(s) 2026

Open Access
This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit
http://creativecommons.org/licenses/by-nc-nd/4.0/
.

PMC Copyright notice

PMCID: PMC13009515 PMID:
41730924

Abstract

This paper presents an intelligent educational decision-making framework that integrates multimodal data fusion with structured knowledge graph reasoning to enhance personalized learning experiences. To address challenges associated with heterogeneous data integration and interpretability, we propose the Cognizant Instructional Field Network (CIFNet), a hybrid neural-symbolic architecture. CIFNet combines symbolic representations of learner states with deep contextual embeddings, supporting dynamic and interpretable decision-making processes in educational environments. It jointly models epistemic progression, pedagogical intents, and instructional dependencies while accounting for uncertainty and sparse feedback. Building on CIFNet, we introduce the Pedagogical Inference Controller (PIC), a meta-cognitive strategic layer designed to refine instructional actions through strategic utility estimation, regret-aware adaptation, uncertainty-weighted exploration, and curriculum alignment. By simulating counterfactual instructional outcomes and prioritizing the reduction of knowledge gaps, PIC aims to promote pedagogically coherent and learner-centered interventions. Experimental evaluations across multiple educational datasets indicate that the proposed framework achieves promising improvements over traditional baselines and several recent deep learning models in predictive accuracy and learning-related metrics. While the results demonstrate the potential of combining symbolic reasoning with neural representation learning for more transparent and adaptive educational decision-making, further studies–particularly in real classroom environments–are needed to fully assess the system’s broader applicability and long-term impact.

Keywords:
Multimodal data fusion, Knowledge graph integration, Educational decision-making, Adaptive instructional systems, Intelligent tutoring systems, Data-driven education, Artificial intelligence in education
Subject terms:
Mathematics and computing; Science, technology and society
Introduction

In recent years, the increasing complexity and diversity of educational environments have necessitated the development of intelligent systems capable of supporting decision-making processes in a personalized and adaptive manner
1
. The emergence of multimodal data–including text, images, audio, physiological signals, and behavioral logs–provides a rich foundation for deeply understanding learners’ cognitive and emotional states
2
. However, effectively leveraging such heterogeneous data poses significant challenges in integration and interpretation
3
. Not only is it essential to capture and fuse multimodal signals to construct comprehensive learner profiles, but it is also critical to represent domain knowledge explicitly to support explainable and pedagogically sound decisions. Consequently, combining multimodal data fusion techniques with knowledge graph-based reasoning frameworks has garnered increasing attention
4
. This approach not only facilitates a more holistic understanding of learning processes but also enables data-driven yet interpretable educational interventions. Such a system has the potential to enhance the precision of recommendations, improve student engagement, and optimize learning outcomes in diverse educational settings
5
.

Early efforts to build intelligent educational systems primarily focused on encoding expert knowledge and predefined rules to guide personalized instruction. These systems offered strong interpretability by directly mapping learning theories and instructional principles into decision-making logic
6
. However, their reliance on manually curated structures limited their flexibility when faced with incomplete, ambiguous, or dynamically evolving learner data
7
. Particularly in multimodal contexts, these systems struggled to seamlessly integrate information across varied sources such as textual inputs, physiological signals, and visual cues, resulting in fragmented learner profiles and reduced responsiveness to individual needs
8
.

To better adapt to increasingly diverse and noisy educational data, subsequent approaches shifted toward leveraging large-scale observational records and interaction traces to model learning behaviors
9
. By mining patterns from real-world educational activities, systems could offer more dynamic and scalable personalization without exhaustive manual intervention
10
. Despite these improvements, the strategies employed for integrating multimodal signals often remained superficial, treating different modalities independently and missing the deeper interdependencies critical for fully understanding learner states
11
. The lack of structured contextual reasoning limited the capacity of these systems to align their decisions with pedagogical objectives in a transparent and interpretable manner
12
.

Building upon these developments, the latest generation of educational decision-making systems employs advanced architectures capable of jointly modeling complex, multimodal information flows
13
. Recent breakthroughs in representation learning have enabled end-to-end frameworks that automatically extract, fuse, and reason over diverse data types, significantly enhancing the depth and coherence of learner modeling
14
. At the same time, the incorporation of knowledge graphs into these architectures brings structured semantic understanding into the learning process, allowing systems to ground predictions and recommendations within pedagogically meaningful frameworks
15
. While these hybrid systems show great promise for delivering intelligent, context-sensitive educational interventions, they also introduce new challenges related to data requirements, computational overhead, and the ongoing maintenance of dynamic knowledge representations
16
.

Based on the limitations of symbolic rigidity, shallow data integration, and low interpretability in previous approaches, we propose a novel intelligent educational decision-making system that synergistically combines multimodal data fusion and knowledge graph-based reasoning. Our approach is designed to holistically capture learners’ cognitive and emotional states, dynamically adapt to various educational contexts, and deliver explainable interventions grounded in domain knowledge. By integrating advanced deep learning techniques with structured semantic representations, our system can not only process heterogeneous data efficiently but also maintain transparency and consistency in its recommendations. Our framework employs a multimodal fusion module that encodes and aligns features from textual, visual, and behavioral inputs, which are then mapped onto a dynamically evolving knowledge graph. This enables the system to reason about learning patterns, identify conceptual gaps, and propose personalized strategies based on both statistical trends and pedagogical logic. The modular design of our system allows for scalability and transferability across different subjects and learning environments. Through this integration, we aim to address the gaps in prior models and realize a more effective, interpretable, and context-aware decision-making paradigm in education.

A detailed overview of our contributions is provided below:

We propose a new hybrid architecture that combines multimodal feature fusion with dynamic knowledge graph reasoning, enhancing both accuracy and interpretability.

Our method supports high adaptability and generalizability across multiple educational scenarios, demonstrating robust performance in both online and offline learning environments.

Experimental results show a significant improvement in learner state detection accuracy and recommendation quality, outperforming traditional and standalone deep learning baselines.

To facilitate better understanding, Table
1
summarizes the key acronyms and terms used throughout the paper. These definitions aim to provide readers with a quick reference and to ensure clarity, especially for those who may not be familiar with domain-specific terminologies.

Table 1.

Terminology and Acronyms Used in This Paper.

Acronym

Meaning and description

DKT

Deep Knowledge Tracing – A model for predicting student responses over time

DKVN

Dynamic Key-Value Memory Network – A memory-augmented model for knowledge tracing

SAINT

Separated Self-Attentive Neural Knowledge Tracing – Transformer-based model for student modeling

NLP

Natural Language Processing – Field focused on machine understanding of human language

MAE

Mean Absolute Error – A metric for evaluating prediction accuracy

RMSE

Root Mean Square Error – Standard deviation of prediction errors

MAPE

Mean Absolute Percentage Error – Measures accuracy as percentage error

Coefficient of Determination – Indicates goodness of fit in regression models

SOTA

State Of The Art – The best-performing models or techniques at present

CIFNet

Cognizant Instructional Field Network – Proposed hybrid neural-symbolic decision system

PIC

Pedagogical Inference Controller – Meta-cognitive layer that refines decision strategies

EduKG

Educational Knowledge Graph – Structured graph representation of educational concepts

Open in a new tab
Related work

Our work draws inspiration from several strands of research, including multimodal data fusion, educational knowledge graphs, and AI-based instructional decision systems. In this section, we provide a comparative overview and highlight the distinct contributions of our approach. In multimodal learning, recent research has explored early fusion, late fusion, and attention-based methods to integrate heterogeneous inputs such as audio, video, and behavioral data. For example, hierarchical attention models and multimodal transformers have been used to weigh different modalities based on context. However, most of these models focus primarily on performance, with limited attention to explainability or pedagogical relevance. In contrast, our model incorporates symbolic attention mechanisms and aligns fused representations with domain knowledge to enhance interpretability. Knowledge graphs have also gained traction in educational settings. Systems like EduKG or intelligent tutoring frameworks utilize structured semantic graphs to represent curriculum content, prerequisites, and learner profiles. While these systems support traceable inferences, they often rely on static, rule-based reasoning engines that lack adaptability to real-time learner signals. Our approach enhances this paradigm by embedding dynamic knowledge graph constraints directly into the decision-making process via neural-symbolic integration. In terms of decision-making models, classical machine learning and deep learning methods–such as DKT, DeepFM, and SAINT–have been employed for knowledge tracing and response prediction. While effective, these models typically lack transparency and struggle to align decisions with curriculum logic. Hybrid models that combine rule-based reasoning with neural predictors have emerged, yet few explicitly incorporate regret-awareness, epistemic uncertainty, or curriculum alignment. Our proposed PIC module addresses this gap by embedding pedagogical strategies into the inference pipeline, yielding more coherent and learner-centric decisions. Overall, our work differentiates itself by tightly integrating multimodal learning, symbolic curriculum modeling, and strategic decision control into a unified framework. This integration enables robust performance while supporting transparent, adaptive, and pedagogically valid instructional decisions.

Multimodal data fusion techniques

The use of multimodal data fusion in educational systems has become increasingly critical for enabling intelligent decision-making processes. This direction integrates diverse data types such as textual logs, audio-visual content, biometric feedback, and behavioral patterns to build a holistic understanding of learners’ experiences
17
. Various fusion strategies have emerged, including early fusion, where raw features from multiple modalities are combined at the input level, and late fusion, which integrates decisions or intermediate representations from unimodal models
18
. More advanced methods leverage deep learning architectures, particularly multimodal transformers and attention mechanisms, to capture inter-modal dependencies and improve semantic alignment. One notable approach in this space involves hierarchical attention networks that dynamically weigh different modalities depending on context, thus supporting more nuanced educational inferences
19
. Another avenue explores graph-based fusion, where modalities are represented as nodes and their interactions modeled via graph neural networks (GNNs), facilitating structured and interpretable fusion
20
. Cross-modal representation learning techniques, such as contrastive learning and modality-invariant embeddings, are gaining traction for improving generalization and transferability in diverse educational scenarios
21
. Despite these advancements, challenges remain in handling modality imbalance, noise interference, and maintaining real-time processing efficiency. Our method aims to address these gaps by introducing a symbolic-neural hybrid mechanism that tightly integrates semantic structure during fusion.
Educational knowledge graph applications

Knowledge graphs have been increasingly adopted in the educational domain to support structured representations of curriculum content, learning objectives, student profiles, and pedagogical resources
22
. These graphs facilitate semantic reasoning and contextual awareness, enabling systems to infer prerequisite relationships, recommend personalized learning materials, and trace knowledge progression over time. Through ontologies and linked data principles, educational knowledge graphs (EduKGs) model pedagogical structures across different levels and disciplines
23
. By mapping student interactions onto graph structures, systems can provide real-time diagnostic feedback, identify conceptual gaps, and recommend remedial paths
24
. Recent advances include dynamic graphs that evolve with student learning trajectories, supported by reinforcement learning and continual learning mechanisms
25
. Integrating external knowledge sources such as Wikipedia and academic repositories further enriches the reasoning capabilities of EduKGs
26
. However, current approaches often rely on manually constructed or static graphs, limiting their adaptability. In contrast, our framework leverages dynamic graph-based reasoning integrated with neural representations to support adaptive instructional decision-making.
AI-based educational decision models

Artificial intelligence models have increasingly been used in educational contexts to predict outcomes, optimize teaching strategies, and personalize learning paths. These include classical methods such as decision trees and support vector machines, as well as deep learning techniques like convolutional and recurrent neural networks
27
. Reinforcement learning (RL) approaches have recently become popular in intelligent tutoring systems, enabling agents to adaptively refine instructional strategies through feedback. Explainable AI (XAI) techniques, such as SHAP values, attention visualization, and rule extraction, have improved the interpretability of these decision models, thus fostering collaboration between humans and AI
28
. Temporal and sequential models like transformers and temporal convolutional networks have further enhanced the modeling of complex learner behavior in longitudinal settings
29
. Some recent works have attempted to combine multimodal data with knowledge graphs to provide more context-aware and accurate predictions
30
. However, few of these models offer a unified architecture that simultaneously supports pedagogical alignment, interpretability, and adaptive feedback. Our proposed framework addresses this need by integrating symbolic decision logic, multimodal fusion, and real-time policy optimization within a cohesive model.
Method

Overview

To address the challenges of multimodal data integration, learner state modeling, and pedagogically grounded decision-making, we propose a novel hybrid architecture that combines neural representation learning with symbolic reasoning. Our approach consists of two main components: the Cognizant Instructional Field Network (CIFNet) and the Pedagogical Inference Controller (PIC). Together, they enable dynamic, interpretable, and learner-centered instructional policies in educational systems. CIFNet serves as the core neural-symbolic model. It transforms heterogeneous learner inputs–such as behavioral logs, text, and physiological signals–into compact symbolic-attentive embeddings. This is achieved through a multi-level feature extraction pipeline that combines deep attention mechanisms with symbolic abstractions. CIFNet models the evolution of learner states by integrating contextual information, domain constraints, and temporal dynamics. Its architecture ensures the encoding of both high-level semantic features and structured representations of learner knowledge. On top of CIFNet, we introduce the Pedagogical Inference Controller (PIC), a strategic meta-layer that further refines instructional decisions. PIC incorporates regret-aware adaptation, uncertainty-guided exploration, and curriculum-driven alignment. These components ensure that the system not only maximizes instructional utility but also maintains ethical and pedagogical coherence. For example, regret-aware adaptation dynamically adjusts policies based on historical decision regret, while curriculum alignment ensures that instructional trajectories follow prerequisite knowledge paths defined in a symbolic curriculum graph. Our model is optimized through a unified loss that combines standard task performance with penalties for logical constraint violations, uncertainty risk, and alignment deviation. The overall system offers interpretability via symbolic traceability, adaptability through deep contextual embeddings, and pedagogical soundness through domain-informed decision logic. This hybrid design bridges the gap between scalable deep learning and human-understandable educational reasoning, providing a flexible and transparent framework for intelligent educational decision-making.

Educational decision-making is a complex, context-sensitive process that integrates data interpretation, domain-specific knowledge, and the modeling of learner variability to yield actionable instructional strategies. In this section, we introduce our methodological framework aimed at addressing the core challenges involved in modeling educational decisions. This framework is designed to operate under conditions of uncertainty, structured environments, and heterogeneous agent behaviors, with the goal of advancing automated support systems in educational settings.

Our method decomposes the educational decision-making problem into a structured sequence of computational submodules, each designed to capture a specific aspect of the decision process. Section “Preliminaries” formalizes the educational decision-making problem using a symbolic framework that captures the semantics of instructional states, learner dynamics, and feedback signals. Unlike previous approaches that rely primarily on statistical pattern recognition or task-specific rules, we build a compositional abstraction layer that allows for interpretability and symbolic manipulation. This layer enables us to define decision points, goals, constraints, and utilities in a mathematically coherent and computationally tractable manner. Section "Cognizant Instructional Field Network (CIFNet)" presents our proposed model, Cognizant Instructional Field Network (CIFNet), which introduces a neural-symbolic hybrid system capable of learning compact representations of educational contexts and mapping them to corresponding decision actions. The CIFNet is designed to handle partial observability and hierarchical task structures, leveraging structured latent variables and attention-based message passing to reconcile multiple levels of abstraction. We introduce a novel encoding-decoding procedure that embeds formal state descriptions into a learnable vector space while preserving interpretability through symbolic regularization. Section "Pedagogical Inference Controller (PIC)" introduces the Pedagogical Inference Controller (PIC), a domain-embedded decision strategy layer responsible for translating the model outputs into pedagogically coherent actions. The strategy layer incorporates domain expertise through a differentiable policy engine that weighs alternatives not only by empirical utility but also by curriculum alignment, learner history, and ethical constraints. PIC also includes a regret-based inference module that iteratively revises past decisions based on subsequent learner responses, enabling dynamic adaptation and minimizing the long-term cost of suboptimal feedback. These components form a unified computational pipeline that supports the modeling, learning, and execution of educational decisions in a data-efficient and cognitively plausible manner. By grounding our method in a rigorous symbolic foundation while extending it with modern neural function approximators, we aim to bridge the gap between explainable educational theory and scalable, adaptive systems. This methodology differs from conventional AI-based tutoring systems that often hard-code decision logic or depend on large-scale labeled data. Instead, we emphasize modularity, symbolic expressivity, and context sensitivity, all of which are essential for supporting nuanced decision-making in real-world learning environments. Our approach can accommodate both individual tutoring and classroom-level interventions, supporting personalization at scale.
Preliminaries

To rigorously analyze the problem of educational decision-making, we begin by constructing a formal, symbolic framework that encapsulates the essential components of the instructional environment. We define an educational decision process as a structured sequence of interactions between an intelligent agent and a learner, embedded in a task space governed by pedagogical goals and constraints. This subsection introduces the key mathematical abstractions and operators used throughout the remainder of this paper, establishing the theoretical foundation for principled policy design in instructional settings.

We denote the learning environment as a tuple:

1

where:
is the set of instructional states representing learner knowledge, cognitive context, and engagement dynamics,
is the set of pedagogical actions available to the decision agent,
is the set of latent learner traits influencing behavior and receptivity to instruction,
is the state transition kernel defining stochastic evolution of the learner state,
is the pedagogical reward function quantifying learning gains and instructional efficiency,
is a set of logical constraints encoding domain knowledge, ethical standards, and curriculum structure.

We assume the agent observes a partial projection of the learner state, denoted
, derived from:

2

where
is an observation function that maps the full state and latent learner attributes
at time
t
into a compressed, observable form. This assumption reflects practical limitations in educational environments, where full internal states of learners are typically not accessible to instructional agents.

To reason about the hidden learner characteristics, we model
as a distribution over a latent space:

3

where
is the accumulated interaction history up to time
, capturing both observed learner behavior and agent interventions, and
are learnable parameters of the learner model. This probabilistic modeling framework allows the agent to infer unobserved cognitive traits, such as motivation, knowledge gaps, or engagement levels.

Each pedagogical decision
is selected based on a policy
, where:

4

with
denoting policy parameters subject to optimization via reinforcement learning or imitation learning techniques. The policy governs how the agent adapts its instructional strategies in response to observed learner signals.

The pedagogical reward is structured to capture both immediate utility and long-term educational outcomes. We define the expected return:

5

where
is a temporal discount factor controlling the trade-off between short-term gains and long-term educational success.

To model skill mastery dynamics, we define a set of skills
and represent the learner’s knowledge state as a binary vector:

6

Here, each component of
reflects mastery over an individual skill, facilitating fine-grained tracking of learner progress across a curriculum.

We assume skill transition follows a probabilistic knowledge tracing mechanism:

7

where
are skill-specific parameters encoding sensitivities to instructional interventions, and
is a learnable feature encoder extracting relevant state-action information. The sigmoid activation
models the inherent uncertainty in learning processes, capturing non-deterministic skill acquisition.

To reason symbolically over instructional constraints, we introduce a logic-based specification of curriculum dependencies using propositional logic:

8

where each logical rule
expresses a prerequisite-postcondition relationship between skill sets. Logical reasoning over
enables principled constraint enforcement during policy optimization.

We translate these hard constraints into soft penalties via regularized penalty functions:

9

where
denotes the importance weight assigned to constraint
, and
is an indicator function that activates when the constraint is violated. This approach facilitates differentiable optimization while still encouraging curriculum coherence.

The overall decision objective is then expressed as a constrained optimization:

10

where
accounts for epistemic uncertainty in learner modeling:

11

penalizing deviations from a uniform prior
in the absence of confident evidence about the learner’s latent traits. This promotes cautious decision-making under uncertainty.

To further encourage instructional diversity and avoid pedagogical myopia, we include an entropy regularization term:

12

maximizing action entropy to preserve exploration and foster richer learner experiences.

We conclude this subsection by defining a compositional symbolic operator
that maps a learner model and interaction sequence to an admissible policy class:

13

where
denotes the subset of policies satisfying accumulated empirical observations, logical constraints, and risk-aware selection criteria. This symbolic filtration ensures that instructional decisions remain grounded in both data-driven evidence and pedagogical rationality.
Cognizant Instructional Field Network (CIFNet)

To operationalize the formal educational decision structure introduced previously, we propose a novel model called the Cognizant Instructional Field Network (CIFNet). This architecture integrates symbolic representations of pedagogical logic with high-capacity neural function approximators to enable dynamic, interpretable, and personalized decision-making within instructional settings (As shown in Fig.
1
). The CIFNet is defined over the educational decision space
.

Fig. 1.

Open in a new tab

Schematic diagram of the Cognizant Instructional Field Network (CIFNet). The CIFNet architecture consists of three key modules: Symbolic-Attentive State Encoding to capture structured learner representations, Context-Constrained Policy Generation to produce grammar-compliant pedagogical decisions, and Constraint-Guided Knowledge Updating to optimize learner trajectories while adhering to educational constraints. The integration of symbolic reasoning and neural computation enables CIFNet to achieve dynamic, interpretable, and personalized instructional guidance.

Symbolic-Attentive State Encoding

At each time step
t
, CIFNet encodes the learner’s observed state
into a symbolic-attentive embedding, designed to capture both propositional abstractions and dynamic attention over latent cognitive factors. The propositional feature extractor
maps
into a symbolic latent space, yielding a compact representation of critical learner properties. Simultaneously, an attention mechanism modulates a weighted combination of latent factors
, reflecting varying focus depending on the learner’s internal context
. The initial embedding is computed as:

14

where
denotes the key vector associated with latent dimension
k
, and
represents concatenation. To enhance the symbolic abstraction, the feature extractor
is structured hierarchically, producing multi-level feature sets that better capture nuanced relational patterns:

15

where
and
are multilayer perceptrons and
is a non-linear activation function such as ReLU. To compute the dynamic attention scores over latent dimensions, CIFNet leverages a soft-attention mechanism guided by the learner context vector
, updating the normalized attention weights
as:

16

where
is a learned scoring function measuring compatibility between the learner context and each latent factor. The final symbolic-attentive representation
then modulates the learner state evolution, feeding into the higher-level inference modules. To regulate the magnitude of attention-based adjustments and promote stability during learning, CIFNet introduces a residual smoothing mechanism over the attended embedding:

17

where
is a smoothing coefficient that balances historical and current symbolic-attentive information. This construction enables CIFNet to maintain coherent, interpretable latent dynamics across time while flexibly adjusting to the evolving learner state.

Context-Constrained Policy Generation

In the context-constrained policy generation framework, the symbolic embedding
serves as an abstract representation of the agent’s state, which must be mapped into a distribution over possible pedagogical actions (As shown in Fig.
2
). This mapping must respect both the structure of the learned policy network and the constraints imposed by the domain-specific grammar
. To achieve this, we first project the embedding through a hidden transformation layer followed by a non-linear activation function
, typically chosen as ReLU or tanh to introduce representational flexibility:

18

where
and
are trainable parameters that allow the model to adaptively reshape the symbolic input space. The transformed feature vector
is subsequently mapped into a preliminary logits vector
through another linear transformation:

19

where
and
are again trainable matrices and biases, respectively. To produce a stochastic action policy that is both differentiable and expressive, we apply a softmax operation over the logits to obtain a distribution
:

20

However, not all actions are permissible due to the context-sensitive rules encoded in
. Thus, we introduce a masking operation using the indicator function
, ensuring that the policy only assigns probability mass to actions that are reachable under the grammar constraints. The final constrained policy
is thus obtained by element-wise multiplication of the unconstrained policy and the reachability mask, followed by normalization:

21

This formulation tightly integrates the learned network output with symbolic prior knowledge, ensuring that the resulting behavior is both pedagogically appropriate and logically coherent within the constraints of the domain.

Fig. 2.

Open in a new tab

Schematic diagram of the Context-Constrained Policy Generation. This figure illustrates this module where input feature maps are aggregated via max and average pooling, then transformed through a multi-layer perceptron (MLP) to extract compact representations. These outputs are fused and passed through a Slice Uncertainty mechanism to generate an attention map, guiding the policy’s focus. In parallel, the symbolic embedding of the agent’s state is projected and transformed to produce a softmax-based preliminary action policy, which is subsequently masked and normalized according to domain-specific grammar constraints, ensuring pedagogically coherent and logically valid action distributions.

Constraint-Guided Knowledge Updating

Learner knowledge mastery is dynamically updated through a trajectory-based optimization framework that adheres to pedagogical constraints, aiming to guide learning towards desired educational outcomes. To explicitly guide the updating of knowledge mastery states
, a logical consistency loss is introduced:

22

where
denotes the importance weight of constraint
, ensuring that critical instructional goals are prioritized. To encourage smooth evolution of learner knowledge across trajectories, a temporal consistency loss is added:

23

where
models the expected state transition induced by action
. In order to preserve sufficient policy exploration, entropy regularization is adopted, controlled by
, leading to the final augmented learning objective:

24

where
and
are regularization coefficients for logic consistency and temporal smoothness, respectively. Through this multi-component optimization, the learner’s evolving knowledge representation is tightly regulated to follow both the environmental rewards and the instructional design constraints, achieving adaptive yet pedagogically sound progression during the learning process.
Pedagogical Inference Controller (PIC)

While the Cognizant Instructional Field Network (CIFNet) provides a structural foundation for state estimation and policy generation, it requires a principled strategy mechanism to navigate uncertainties, adapt to dynamic learner profiles, and ensure pedagogical fidelity. We introduce the Pedagogical Inference Controller (PIC), a strategic layer that augments CIFNet with meta-cognitive planning, regret-aware adaptation, and curriculum-aligned reasoning (As shown in Fig.
3
).

Fig. 3.

Open in a new tab

Schematic diagram of the Pedagogical Inference Controller (PIC). The PIC architecture integrates regret-aware adaptation, uncertainty-guided exploration, and curriculum-driven alignment into a Vision Transformer (ViT)-based processing pipeline. Input representations are first embedded and passed through sequential ViT-SN modules, with intermediate outputs dynamically modulated via feature fusion blocks that incorporate strategic feedback from specialized modules. Regret-Aware Adaptation refines representations by minimizing instructional regret, Uncertainty-Guided Exploration adjusts entropy based on epistemic uncertainty to balance exploration and exploitation, and Curriculum-Driven Alignment ensures policy updates remain coherent with a symbolic curriculum graph. This structured interaction enables robust, adaptive, and pedagogically faithful inference across multiple downstream tasks.

Regret-Aware Adaptation

PIC incorporates a regret-based adjustment mechanism to iteratively refine the policy parameters
at each decision point
t
, aiming to minimize instructional regret and improve long-term adaptation. The instantaneous regret
quantifies the gap between the best possible adjusted utility
over the action set
and the utility achieved by the selected action
:

25

This regret value drives a corrective update to the policy parameters via gradient descent, following:

26

where
is the learning rate controlling the step size of adaptation. The adjusted utility
itself is computed by modulating the predicted utility
with a dynamic confidence factor
, reflecting the model’s estimated reliability over action
a
at time
t
:

27

The confidence factor
is updated adaptively based on observed prediction errors, encouraging cautious exploration in uncertain regions of the action space. To further stabilize adaptation and avoid oscillatory updates caused by high-variance regret signals, PIC employs an exponentially decayed regret aggregation mechanism:

28

where
represents the smoothed regret estimate and
is the smoothing coefficient. This formulation allows the model to modulate its parameter updates with respect to both recent and historical regret information, enhancing robustness against noisy feedback. The overall regret-aware adaptation strategy within PIC thus ensures that instructional improvements are driven by minimizing action-based regret over time, dynamically adjusting the policy in response to the evolving learner and task environment.

Uncertainty-Guided Exploration

To effectively balance exploration and exploitation during policy optimization, the PIC framework introduces uncertainty-guided modulation of action stochasticity through entropy scaling (As shown in Fig.
4
). The model adjusts the entropy of the policy
dynamically based on the epistemic uncertainty of the environment, encouraging more exploratory behavior when the agent is uncertain. The core objective function for exploration is defined as:

29

where
denotes the Shannon entropy of the policy distribution at time
t
, promoting diversified action selection, and
is a dynamic scaling factor dependent on the current epistemic uncertainty. The uncertainty itself is quantified via the variance of an auxiliary prediction loss
sampled from a predictive distribution
:

30

where
is a hyperparameter controlling the sensitivity of exploration to uncertainty. In practice,
may be derived from Bayesian neural network ensembles or stochastic variational inference methods, providing an estimate of how confident the model is regarding its own predictions. To regularize the behavior of
and avoid excessive exploration or premature convergence, an upper clipping is often applied:

31

where
is a predefined maximum value ensuring stability during training. To prevent abrupt changes in exploration dynamics, a smoothed update rule for
can be employed:

32

where
controls the smoothing factor, effectively creating a moving average of the uncertainty signal. Through this adaptive entropy modulation, the agent prioritizes uncertain regions of the environment, gradually transitioning toward exploitation as certainty increases and learning progresses.

Fig. 4.

Open in a new tab

Schematic diagram of the Uncertainty-Guided Exploration. The strategy encourages exploration when the agent is less confident by dynamically modulating policy entropy based on epistemic uncertainty. As depicted, a concatenation and 1
1 convolution precede the RepBlock module (repeated NX times), followed by element-wise addition and flattening for fusion, ensuring adaptive exploration and stable learning through smoothed entropy scaling. Inside the module, the concatenated features are first compressed via 1
1 convolutions to reduce computational cost while preserving essential information. The RepBlock further refines the features, promoting effective representation learning before fusion.

Curriculum-Driven Alignment

PIC (Pedagogically-Informed Control) enforces instructional fidelity by introducing a curriculum-driven alignment mechanism that ensures learning trajectories adhere to the designed educational sequence. The policy is encouraged to align with a curriculum-induced reference policy derived from a symbolic curriculum graph
. This approach tightly couples reinforcement learning with structured pedagogical guidance, mitigating the risk of learners diverging into suboptimal or incoherent educational paths. The primary curriculum alignment loss is defined as:

33

where
denotes the curriculum policy,
is the learner policy, and
represents the current augmented state at time
t
. Here, the Kullback-Leibler (KL) divergence measures how closely the learner’s action distribution matches the curriculum-prescribed distribution, effectively penalizing deviations from the intended pedagogical pathway.

To construct
from the symbolic curriculum graph, a mapping function
is defined such that:

34

where
dynamically interprets the symbolic graph
to generate an action distribution that is coherent with the learner’s current mastery state
. This mapping ensures that action recommendations at each stage are not arbitrary but are instead grounded in the pre-designed curricular logic, considering both prerequisite knowledge and permissible progression paths.

To prevent excessive deviation from optimal behavior while following the curriculum, a mixed objective combining task rewards and alignment penalties is employed:

35

where
balances task performance with curriculum adherence. The reinforcement term ensures that the agent continues to maximize environmental rewards, while the alignment term enforces structured progression according to instructional design principles.

To enable gradual flexibility in alignment over training, an annealed weighting strategy for
is introduced:

36

where
is the initial alignment weight and
controls the decay rate over training steps
t
. This annealing mechanism ensures that early learning phases are tightly controlled by the curriculum (to prevent premature policy drift), while later phases allow for more learner-driven exploration and optimization as mastery improves.

Final Summary

Compared to existing educational decision-making models, our proposed approach introduces several key innovations. First, while many prior works rely solely on neural networks for prediction or learner modeling, our framework integrates symbolic reasoning through knowledge graph constraints, enabling pedagogically interpretable and rule-compliant decisions. Second, we incorporate a multi-layered meta-cognitive controller (PIC) that enhances instructional decisions via regret-aware adaptation and uncertainty-guided exploration–components largely absent from traditional knowledge tracing or response prediction systems.

Third, unlike static or manually curated curriculum mechanisms, our model introduces curriculum-driven alignment using symbolic curriculum graphs, ensuring that learning paths remain coherent with pedagogical dependencies. This tightly couples instructional logic with deep learning, allowing for better generalization and transparency across domains. Finally, the unified integration of multimodal data fusion, symbolic attention, and strategic planning in a single end-to-end pipeline represents a significant departure from siloed models that treat these elements independently. Through these innovations, our approach addresses long-standing limitations in interpretability, adaptability, and pedagogical alignment found in previous state-of-the-art systems.
Experimental setup

Dataset

EdNet Dataset
31
is one of the largest open educational datasets consisting of real-world interaction logs collected from Santa, an AI-based education service. The dataset includes over 131 million interaction records from more than 780, 000 students. It covers extensive learning behavior information such as student responses, timestamps, content identifiers, and problem-solving histories. This dataset is suitable for knowledge tracing and student modeling due to its scale and granularity. Its diverse and large-scale nature provides a valuable resource for developing and evaluating deep learning-based education models. The data is anonymized and structured, making it accessible for researchers in both academia and industry. PISA Dataset
32
is a large-scale international assessment organized by the OECD to evaluate education systems worldwide by testing the skills and knowledge of 15-year-old students. The dataset includes student performance in reading, mathematics, and science across multiple countries, as well as background information collected through student, teacher, and school questionnaires. It captures contextual variables such as socioeconomic status, school climate, and learning strategies, which can be used to analyze the relationship between educational outcomes and background factors. The dataset is structured in a tabular form and is widely used in educational policy and learning analytics research. MOOCdb Dataset
33
is a standardized data schema designed to represent data from massive open online courses (MOOCs). It consolidates learning behavior across platforms such as edX and Coursera and includes various types of learner interactions including video watching, problem attempts, forum participation, and course navigation. The schema enables data sharing and comparative analysis across courses and institutions. MOOCdb provides both raw and processed formats and has been instrumental in enabling reproducible research in online learning. The design supports queries at multiple levels of granularity which facilitates personalized learning analytics and learner modeling. DREAM Dataset
34
is a multiple-choice reading comprehension dataset collected from English language exams designed for Chinese students. It contains more than 10, 000 questions derived from 6, 000 dialogues covering diverse topics and scenarios. Each question is associated with three candidate answers, and most questions require reasoning beyond simple sentence matching. DREAM focuses on multi-turn dialogue understanding and commonsense reasoning, making it suitable for evaluating machine comprehension models. The conversations are relatively short but rich in contextual dependencies. This dataset serves as a benchmark for dialog-based natural language understanding and has been widely adopted in recent NLP studies.
Experimental details

We adopt a unified experimental framework to ensure consistency and reproducibility across all datasets. For all experiments, we implement our models using PyTorch 1.13 and train them on NVIDIA A100 GPUs with 80GB memory. Each model is optimized using the Adam optimizer with an initial learning rate of 1e-3. The learning rate follows a cosine annealing schedule with warm-up over the first 10% of total epochs. We set the batch size to 128 for all datasets and train each model for 100 epochs. Early stopping is applied based on validation performance with a patience of 10 epochs. All input features are normalized to zero mean and unit variance. Categorical variables are encoded using learnable embeddings initialized with Xavier initialization. Our model is built upon a multi-layer transformer architecture with 4 layers, each consisting of multi-head self-attention and feedforward sublayers. Each attention layer has 8 heads with a model dimension of 512 and hidden dimension of 1024. Layer normalization and dropout with a rate of 0.1 are applied after each sublayer. For datasets with temporal sequences such as EdNet, we incorporate positional encodings and apply masking to preserve causal structure. For static datasets like PISA, we disable positional encoding and use a single classification token prepended to each input. For downstream tasks, we consider both classification and regression settings. In EdNet and MOOCdb, we formulate the task as next-response prediction and compute accuracy, AUC, and F1-score. In PISA, we use regression for performance estimation and classification for stratified performance banding. For DREAM, we follow the multiple-choice QA evaluation protocol using exact match accuracy as the primary metric. For all datasets, we split the data into 70% training, 15% validation, and 15% testing. The splits are stratified based on student or user identifiers to avoid leakage. To ensure robustness, we run each experiment with five random seeds and report the average and standard deviation. We also conduct hyperparameter tuning using a grid search over key variables including learning rate {1e-2, 1e-3, 1e-4}, number of layers {2, 4, 6}, and dropout rate {0.1, 0.3, 0.5}. The final settings are selected based on the best validation performance across datasets. We use TensorBoard for logging training statistics and evaluate the models every 5 epochs. All code, logs, and model checkpoints are saved and versioned to facilitate future replication. For baseline models, we re-implement widely adopted architectures including DKT, DKVMN, SAINT, and DeepFM with the same preprocessing and experimental protocol. For fairness, we ensure that all models receive identical input formats and evaluation splits. Our experimental setup emphasizes rigorous control and transparent evaluation, reflecting best practices in educational and NLP benchmarking.
Comparison with SOTA methods

In this section, we present a comprehensive comparison between our proposed method and several state-of-the-art (SOTA) baselines across four representative educational datasets: EdNet, PISA, MOOCdb, and DREAM. Tables
2
and
3
summarize the results in terms of MAE, RMSE, MAPE, and
for time series prediction tasks. Across all datasets and metrics, our method consistently achieves modest but statistically significant improvements over strong baselines, including Transformer, Informer, LSTM, GRU, TCN, and DeepAR. For instance, in the EdNet dataset, our model reduces RMSE from 6.98 (Informer) to 6.32–a reduction of approximately 0.66. In the PISA dataset, the RMSE improvement is from 6.37 to 6.10 (a reduction of 0.27). Similarly, in the MOOCdb and DREAM datasets, the observed RMSE gains range between 0.28 and 0.45. While these absolute improvements may appear modest in numeric terms, they are statistically robust (as indicated by the low standard deviations) and practically meaningful, particularly in educational settings where even small gains in prediction accuracy can influence early intervention, personalized instruction, and learner support decisions. To error-based metrics, our model also improves MAPE and
across datasets. For example, in DREAM, our method achieves an
of 0.831 compared to 0.811 from the strongest baseline, suggesting better explanation of variance in learner responses. The improvements in MAPE (e.g., 10.85% vs. 12.30% in MOOCdb) reflect more reliable percentage-level forecasting. We also note that the consistency of these improvements across datasets with different modalities and temporal characteristics–ranging from structured assessments (PISA) to interaction logs (EdNet) and dialogue understanding (DREAM)–underscores the generalization capability of our architecture. The gains may not be large in isolation, but their accumulation across various learning contexts suggests robustness and versatility of the proposed system.

Table 2.

A comparative analysis of our approach and state-of-the-art methods on the EdNet and PISA datasets for time series prediction.

Model

EdNet dataset

PISA dataset

MAE

RMSE

MAPE

MAE

RMSE

MAPE

Transformer
35

5.62±0.13

7.11±0.21

13.25±0.42

0.842±0.02

4.93±0.10

6.54±0.20

11.87±0.31

0.815±0.03

Informer
36

5.37±0.12

6.98±0.18

12.76±0.45

0.851±0.02

4.75±0.11

6.37±0.17

12.03±0.28

0.821±0.02

LSTM
37

6.05±0.15

7.39±0.22

14.12±0.40

0.823±0.03

5.18±0.13

6.92±0.19

13.10±0.35

0.791±0.03

GRU
38

5.82±0.14

7.04±0.19

13.48±0.38

0.835±0.02

5.03±0.12

6.66±0.18

12.41±0.29

0.802±0.02

TCN
39

5.49±0.13

6.85±0.20

13.01±0.43

0.847±0.01

4.82±0.10

6.44±0.17

11.72±0.26

0.828±0.02

DeepAR
40

5.76±0.11

7.23±0.21

13.63±0.41

0.832±0.02

5.10±0.14

6.79±0.20

12.88±0.30

0.797±0.03

Ours

4.89
±
0.10

6.32
±
0.16

11.15
±
0.35

0.869
±
0.01

4.35
±
0.09

6.10
±
0.15

10.41
±
0.27

0.843
±
0.02

Open in a new tab
Table 3.

Evaluating the performance of our model against SOTA techniques on the MOOCdb and DREAM datasets for time series prediction.

Model

MOOCdb dataset

DREAM dataset

MAE

RMSE

MAPE

MAE

RMSE

MAPE

Transformer
35

4.91±0.10

6.47±0.19

12.02±0.33

0.818±0.02

5.22±0.14

6.93±0.21

13.10±0.35

0.803±0.02

Informer
36

4.76±0.12

6.30±0.18

11.78±0.29

0.829±0.01

5.07±0.13

6.79±0.20

12.75±0.32

0.811±0.03

LSTM
37

5.13±0.14

6.88±0.22

13.65±0.41

0.795±0.03

5.39±0.15

7.15±0.23

13.98±0.36

0.782±0.03

GRU
38

5.01±0.13

6.66±0.20

13.12±0.37

0.804±0.02

5.28±0.12

7.02±0.19

12.91±0.30

0.790±0.02

TCN
39

4.84±0.11

6.35±0.17

12.30±0.34

0.826±0.02

5.11±0.13

6.81±0.18

12.45±0.29

0.816±0.01

DeepAR
40

5.09±0.12

6.74±0.21

13.45±0.39

0.799±0.02

5.35±0.14

7.11±0.22

13.31±0.33

0.788±0.03

Ours

4.43
±
0.09

6.02
±
0.16

10.85
±
0.31

0.842
±
0.01

4.91
±
0.11

6.58
±
0.17

11.24
±
0.27

0.831
±
0.02

Open in a new tab
Beyond the numerical performance metrics, it is important to interpret the results in light of each dataset’s educational context. In the case of the PISA dataset, which is designed to evaluate students’ academic abilities across domains, a reduction in MAE or RMSE–although numerically small–can enhance the accuracy of performance band classification and student stratification. This supports more informed decision-making in large-scale assessment settings, such as identifying students who need targeted interventions or allocating resources based on projected proficiency levels. For the EdNet and MOOCdb datasets, which focus on fine-grained learning activity logs, improvements in next-response prediction accuracy can translate into better recommendations in intelligent tutoring systems. Even modest gains can improve the system’s ability to personalize content, recommend review materials, or detect early signs of disengagement, which are critical to maintaining long-term learner motivation and success. In the DREAM dataset, where the task involves understanding dialogue-based questions, enhanced MAPE and
scores suggest better modeling of students’ reasoning in multi-turn interactions. This is especially relevant for assessing comprehension in language-rich educational environments, where nuanced understanding of dialogue is essential for accurate evaluation of critical thinking and inference skills. By connecting these outcomes to the specific pedagogical roles of each dataset, we aim to illustrate how the proposed system contributes not only to statistical improvement, but also to practical educational decision-making in diverse learning scenarios.
Ablation study

To evaluate the contribution of each individual component in our proposed architecture, we conduct an extensive ablation study across all four datasets: EdNet, PISA, MOOCdb, and DREAM. The results are reported in Tables
4
and
5
, where we systematically remove key modules–denoted as Symbolic-Attentive State Encoding, Regret-Aware Adaptation and Curriculum-Driven Alignment–and compare the performance with the full model. These components are integral to capturing the temporal dynamics, adaptive relevance of features, and cross-level interactions respectively.

Table 4.

Results of the ablation study conducted on our approach across the EdNet and PISA datasets.

Model

EdNet dataset

PISA dataset

MAE

RMSE

MAPE

MAE

RMSE

MAPE

w./o. Symbolic-Attentive State Encoding

5.23±0.11

6.67±0.18

12.05±0.34

0.851±0.02

4.61±0.10

6.33±0.16

10.94±0.28

0.831±0.02

w./o. Regret-Aware Adaptation

5.01±0.13

6.58±0.17

11.92±0.30

0.857±0.01

4.54±0.09

6.28±0.17

11.12±0.29

0.835±0.01

w./o. Curriculum-Driven Alignment

5.18±0.10

6.74±0.19

12.31±0.36

0.845±0.03

4.69±0.11

6.41±0.18

11.56±0.27

0.824±0.03

Ours

4.89
±
0.10

6.32
±
0.16

11.15
±
0.35

0.869
±
0.01

4.35
±
0.09

6.10
±
0.15

10.41
±
0.27

0.843
±
0.02

Open in a new tab
Table 5.

Performance results from ablation studies conducted on our model across the MOOCdb and DREAM datasets.

Model

MOOCdb dataset

DREAM dataset

MAE

RMSE

MAPE

MAE

RMSE

MAPE

w./o. Symbolic-Attentive State Encoding

4.67±0.12

6.28±0.17

11.52±0.36

0.831±0.02

5.13±0.13

6.73±0.19

11.87±0.29

0.820±0.02

w./o. Regret-Aware Adaptation

4.58±0.10

6.22±0.18

11.28±0.30

0.837±0.01

5.06±0.11

6.67±0.20

11.59±0.31

0.826±0.01

w./o. Curriculum-Driven Alignment

4.71±0.11

6.34±0.16

11.73±0.34

0.828±0.03

5.20±0.12

6.80±0.22

12.02±0.28

0.815±0.02

Ours

4.43
±
0.09

6.02
±
0.16

10.85
±
0.31

0.842
±
0.01

4.91
±
0.11

6.58
±
0.17

11.24
±
0.27

0.831
±
0.02

Open in a new tab
On the EdNet dataset, removing Symbolic-Attentive State Encoding causes MAE to rise from 4.89 to 5.23 and RMSE from 6.32 to 6.67, indicating the crucial role of temporal attention in capturing student behavior over time. Curriculum-Driven Alignment, when ablated, also shows a noticeable degradation, with
dropping to 0.845, suggesting that hierarchical memory aids in tracking long-term knowledge evolution. Interestingly, removing Regret-Aware Adaptation results in slightly less degradation than Symbolic-Attentive State Encoding or Curriculum-Driven Alignment, but still causes non-trivial increases in MAPE and RMSE. This aligns with our hypothesis that temporal and memory modeling are more sensitive in educational sequential data, where session order and cumulative learning history matter greatly. Similar trends are observed on the PISA dataset, where our full model achieves 4.35 MAE and 0.843
, while ablated variants lag behind. Removing Symbolic-Attentive State Encoding and Curriculum-Driven Alignment especially impairs model capacity to explain variance in performance, with
values dropping to 0.831 and 0.824, respectively. These results empirically validate the architectural contribution of each module under real-world educational data constraints. The ablation effects are similarly pronounced on MOOCdb and DREAM, with the full model maintaining the lowest errors and highest explained variance. For instance, in the DREAM dataset, w./o. Symbolic-Attentive State Encoding yields MAE of 5.13 and
of 0.820, compared to 4.91 and 0.831 from the full model. The degradation is even more notable in MAPE, where the absence of Curriculum-Driven Alignment causes a rise from 11.24 to 12.02, confirming that multi-level memory contributes to nuanced understanding of multi-turn dialogues. Among the three components, the temporal attention mechanism consistently emerges as the most critical across datasets. This is expected, as all four tasks involve temporally or sequentially structured data, whether in the form of student interaction logs, survey timelines, or conversational sequences. In contrast, the Regret-Aware Adaptation plays a more supportive role, offering incremental gains by selectively highlighting important context variables based on content semantics. Nevertheless, its removal still negatively impacts MAPE and generalization across test folds, underlining its utility in handling heterogeneous input distributions.

Taken together, the ablation studies conclusively demonstrate that each architectural component–temporal self-attention, dynamic feature gating, and hierarchical memory–is indispensable to the performance of our model. The drop in predictive accuracy and
when any component is removed shows that the overall architecture benefits from the synergy of its modules. Moreover, the consistency of these results across different data modalities (logs, exams, forums, dialogues) underscores the flexibility and robustness of our design. The ability of our model to integrate deep temporal representation with feature-level adaptation and memory-based reasoning accounts for its superiority over baseline architectures, and these contributions are quantitatively backed by our ablation framework.

To assess the real-world effectiveness of our proposed system, we conducted a controlled classroom experiment involving 60 high school students (30 in the control group using a traditional LMS, and 30 in the experimental group using our intelligent decision-making system). As shown in Table
6
, both groups had comparable pre-test scores (p = 0.74), indicating similar prior knowledge. However, after using the system over a two-week period, the experimental group achieved significantly higher post-test scores (77.5 vs. 68.9, p = 0.003), reflecting a 12.5% improvement in learning outcomes. The experimental group showed a 22.1% higher knowledge mastery rate and reduced average study duration per session by 13.3%, suggesting more efficient learning. A satisfaction survey revealed a high acceptance rate (mean score 4.42/5), demonstrating that students found the system useful and engaging. These results provide initial empirical evidence that our approach not only enhances academic performance but also contributes to learning efficiency and user satisfaction in real educational settings.

Table 6.

Evaluation of System Impact in Real Learning Scenarios (N=60).

Metric

Control group

Experimental group

Improvement (%)

p-value

Pre-Test Score (Mean ± SD)

62.3 ± 8.1

61.8 ± 7.9

–

0.74

Post-Test Score (Mean ± SD)

68.9 ± 9.3

77.5 ± 8.7

12.5%

0.003

Knowledge Mastery Rate (%)

64.2

78.4

22.1%

0.007

Avg. Study Duration (min/session)

41.2

35.7

–13.3%

0.016

System Satisfaction Score (/5)

–

4.42 ± 0.38

–

–

Open in a new tab
Conclusions and future work

This study presents an educational decision-making framework that integrates multimodal data fusion with knowledge graph-based reasoning to support more personalized learning experiences. The framework is designed to help address challenges associated with understanding learner behaviors in complex and heterogeneous environments. By incorporating diverse learner data–including visual cues, auditory signals, physiological metrics, and behavioral interactions–the proposed system constructs richer representations of cognitive, emotional, and behavioral states. Knowledge graphs complement these representations by organizing pedagogical content and enabling inference over prerequisite relationships, conceptual dependencies, and potential learning trajectories. Together, these components offer a structured mechanism for generating contextually informed and pedagogically relevant instructional recommendations.

Empirical results across several educational datasets provide encouraging evidence that the proposed approach can improve predictive performance and support more adaptive learning pathways. However, these findings, while promising, should be interpreted as preliminary. Additional studies–especially those involving real classroom deployments and longer-term observations–are required to fully evaluate the framework’s impact on learner engagement, knowledge retention, and educational outcomes in authentic learning environments.

Several limitations also highlight opportunities for future work. The interpretation of multimodal data remains sensitive to noise and environmental variability, particularly in large-scale or real-world settings. Additional research on sensor calibration, redundancy mechanisms, and robust multimodal filtering techniques may help improve reliability. Furthermore, although knowledge graphs provide interpretable structure, their construction and maintenance are resource-intensive, and static representations may not adapt well to evolving curricula. Future work could investigate semi-automated or data-driven techniques for dynamic graph expansion, continual ontology learning, and curriculum mining. Addressing these challenges will be essential for assessing the scalability, adaptability, and long-term educational value of intelligent decision-making systems in practical learning ecosystems.

Beyond these challenges, another important limitation lies in the scalability of our framework to large-scale, heterogeneous real-world deployments. While our experiments span diverse datasets, they are still conducted in controlled settings with curated data. In practical educational environments, the system would need to handle highly variable learner behaviors, inconsistent sensor quality, differences in curriculum structures across regions, and real-time decision-making under limited computation budgets. These factors could significantly affect the system’s robustness and performance. Maintaining dynamic and accurate knowledge graphs across diverse educational domains remains a non-trivial challenge, particularly when curricula evolve rapidly or differ substantially across institutions. Further work is required to assess the system’s adaptability to such conditions and to explore strategies–such as distributed inference, incremental knowledge graph updates, or transfer learning–for improving scalability and operational resilience in complex learning ecosystems.
Acknowledgements

This is a short text to acknowledge the contributions of specific colleagues, institutions, or agencies that aided the efforts of the authors.
Author contributions

Conceptualization, YW; methodology, YW; software, YW; validation, YW; formal analysis, YW; investigation, YW; data curation, YW; writing–original draft preparation, YW; writing–review and editing, YW; visualization, YW; supervision, YW; funding acquisition, YW; All authors have read and agreed to the published version of the manuscript.
Funding

Details of all funding sources should be provided, including grant numbers if applicable. Please ensure to add all necessary funding information, as after publication this is no longer possible.
Data availability

The datasets generated and/or analysed during the current study are available in the Directory-Layout
https://sandbox.zenodo.org/records/298210?
.
Declarations

Competing interests

The authors declare no competing interests.
Footnotes

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

1.
Zhou, H. et al. Informer: Beyond efficient transformer for long sequence time-series forecasting.
AAAI Conf. Artif. Intell.
35
(1), 11106–11115 (2020).
[
Google Scholar
]

2.
Angelopoulos, A. N., Candès, E. & Tibshirani, R. Conformal pid control for time series prediction.
Neural Inf. Process. Syst.
(2023).

3.
Shen, L. & Kwok, J. Non-autoregressive conditional diffusion models for time series prediction.
Int. Conf. Mach. Learn.
(2023).

4.
Wen, X. & Li, W. Time series prediction based on lstm-attention-lstm model.
IEEE Access.
11
, 48322–48331 (2023).
[
Google Scholar
]

5.
Ren, L., Jia, Z., Laili, Y. & Huang, D. W. Deep learning for time-series prediction in iiot: Progress, challenges, and prospects.
IEEE Trans. Neural Networks Learn. Syst.
35
, 15072–15091 (2023).
[
DOI
] [
PubMed
] [
Google Scholar
]

6.
Li, Y., Wu, K. & Liu, J. Self-paced arima for robust time series prediction.
Knowledge-Based Syst.
269
, 110489 (2023).
[
Google Scholar
]

7.
Yin, L. et al. U-net-lstm: Time series-enhanced lake boundary prediction model.
Land
12
, 569 (2023).
[
Google Scholar
]

8.
Yu, C. et al. Dsformer: A double sampling transformer for multivariate time series long-term prediction. in
Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
3062–3072. 10.1145/3583780.3614851 (Association for Computing Machinery, 2023).

9.
Durairaj, D. M. & Mohan, B. G. K. A convolutional neural network based approach to financial time series prediction.
Neural Comput. Applic
.
34
(24), 13319–13337 (2022).
[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

10.
Zheng, W. & Hu, J. Multivariate time series prediction based on temporal change information learning method.
IEEE Trans. Neural Networks Learn. Syst.
33
(8), 7034–7048 (2022).
[
DOI
] [
PubMed
] [
Google Scholar
]

11.
Chandra, R., Goyal, S. & Gupta, R. Evaluation of deep learning models for multi-step ahead time series prediction.
IEEE Access
9
(2021).

12.
Fan, J., Zhang, K., Yipan, H., Zhu, Y. & Chen, B. Parallel spatio-temporal attention-based tcn for multivariate time series prediction.
Neural Comput. Applic
.
35
, 13109–13118 (2021).
[
Google Scholar
]

13.
Hou, M. et al. Multi-granularity residual learning with confidence estimation for time series prediction. in
Proceedings of the ACM Web Conference 2022
. 112–121 (Association for Computing Machinery, New York, 2022).

14.
Lindemann, B., Müller, T., Vietz, H., Jazdi, N. & Weyrich, M. A survey on long short-term memory networks for time series prediction.
Procedia CIRP
.
99
, 650–655 (2021).
[
Google Scholar
]

15.
Dudukcu, H. V., Taskiran, M., Taskiran, Z. G. C. & Yıldırım, T. Temporal convolutional networks with rnn approach for chaotic time series prediction.
Appl. Soft Comput.
133
, 109945 (2022).
[
Google Scholar
]

16.
Amalou, I., Mouhni, N. & Abdali, A. Multivariate time series prediction by rnn architectures for energy consumption forecasting.
Energy Rep.
8
, 1084–1091 (2022).
[
Google Scholar
]

17.
Xiao, Y. et al. A dual-stage attention-based conv-lstm network for spatio-temporal correlation and multivariate time series prediction.
Int. J. Intell. Syst.

36
(3). 10.1002/int.22370 (2021).

18.
Wang, J., Peng, Z., Wang, X., Li, C. & Wu, J. Deep fuzzy cognitive maps for interpretable multivariate time series prediction.
IEEE Trans. Fuzzy Syst.
29
(9), 2647–2660 (2021).
[
Google Scholar
]

19.
Xu, M., Han, M., Chen, C. L. P. & Qiu, T. Recurrent broad learning systems for time series prediction.
IEEE Trans. Cybern
.
50
(4), 1405–1417 (2020).

[
DOI
] [
PubMed
] [
Google Scholar
]

20.
Zheng, W. & Chen, G. An accurate gru-based power time-series prediction approach with selective state updating and stochastic optimization.
IEEE Trans. Cybern
.
52
(2), 13902–13914 (2021).
[
DOI
] [
PubMed
] [
Google Scholar
]

21.
Moskolaï, W., Abdou, W., Dipanda, A. & Kolyang. Application of deep learning architectures for satellite image time series prediction: A review.
Remote Sens.
13
(23), 4822 (2021).
[
Google Scholar
]

22.
Karevan, Z. & Suykens, J. Transductive lstm for time-series prediction: An application to weather forecasting.
Neural Netw.
125
, 1–9 (2020).

[
DOI
] [
PubMed
] [
Google Scholar
]

23.
Wang, S. et al. Timemixer: Decomposable multiscale mixing for time series forecasting.
Int. Conf. Learn. Represent.
(2024).

24.
Wang, J., Jiang, W., Li, Z. & Lu, Y. A new multi-scale sliding window lstm framework (mssw-lstm): A case study for gnss time-series prediction.
Remote Sens.
13
(16), 3328 (2021).
[
Google Scholar
]

25.
Altan, A. & Karasu, S. Crude oil time series prediction model based on lstm network with chaotic henry gas solubility optimization.
Energy
242
, 122964 (2021).
[
Google Scholar
]

26.
Wen, J., Yang, J., Jiang, B., Song, H. & Wang, H. Big data driven marine environment information forecasting: A time series prediction network.
IEEE Trans. Fuzzy Syst.
29
(8), 4–18 (2021).
[
Google Scholar
]

27.
Morid, M., Sheng, O. R. & Dunbar, J. A. Time series prediction using deep learning methods in healthcare.
ACM Trans. Manag Inf. Syst.
14
(1), 1–29 (2021).
[
Google Scholar
]

28.
Widiputra, H., Mailangkay, A. & Gautama, E. Multivariate cnn-lstm model for multiple parallel financial time-series prediction.
Complexity
10.1155/2021/9903518 (2021).

29.
Yang, M. & Wang, J. Adaptability of financial time series prediction based on BiLSTM.
Int. Conf. Inf. Technol. Quant. Manag.

15
(1) (2021).

30.
Ruan, L., Bai, Y., Li, S., He, S. & Xiao, L. Workload time series prediction in storage systems: a deep learning based approach.
Clust Comput.
26
(1), 25–35 (2021).
[
Google Scholar
]

31.
Li, Z. et al. Lbkt: a lstm bert-based knowledge tracing model for long-sequence data. In
International Conference on Intelligent Tutoring Systems
. Lecture Notes in Computer Science, Vol. 14799. 174–184 (Springer, 2024).

32.
Haw, J. Y. & King, R. B. Understanding filipino students’ achievement in pisa: The roles of personal characteristics, proximal processes, and social contexts.
Soc. Psychol. Educ.
26
, 1089–1126 (2023).
[
Google Scholar
]

33.
Lohse, J. J., McManus, C. A. & Joyner, D. A. Surveying the mooc data set universe. In
2019 IEEE Learning With MOOCS (LWMOOCS)
, 159–164 (IEEE, 2019).

34.
Singh, M., Sharma, G., Hoque, X. & Dhall, A. Dreams: Diverse reactions of engagement and attention mind states dataset. in
International Conference on Pattern Recognition
, 163–179 (Springer, 2024).

35.
Fu, Y., Liu, J. & Shi, J. Tsca-net: Transformer based spatial-channel attention segmentation network for medical images.
Comput. Biol. Medicine
170
, 107938 (2024).
[
DOI
] [
PubMed
] [
Google Scholar
]

36.
Cui, Y. et al. Informer model with season-aware block for efficient long-term power time series forecasting.
Comput. Electr. Eng.
119
, 109492 (2024).
[
Google Scholar
]

37.
Waqas, M. & Humphries, U. W. A critical review of RNN and LSTM variants in hydrological time series predictions.
MethodsX
13
, 102946 (2024).

[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

38.
Zhao, F., Gao, W., Lu, J., Jiang, H. & Shi, J. Real-time concentration detection of al dust using gru-based kalman filtering approach.
Process. Saf. Environ. Prot.
189
, 154–163 (2024).
[
Google Scholar
]

39.
Xue, H. et al. Prediction of gas drainage changes from nitrogen replacement: A study of a tcn deep learning model with integrated attention mechanism.
Fuel
357
, 129797 (2024).
[
Google Scholar
]

40.
Schaduangrat, N., Anuwongcharoen, N., Charoenkwan, P. & Shoombuatong, W. Deepar: a novel deep learning-based hybrid framework for the interpretable prediction of androgen receptor antagonists.
J. Cheminformatics
15
, 50 (2023).
[
DOI
] [
PMC free article
] [
PubMed
] [
Google Scholar
]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets generated and/or analysed during the current study are available in the Directory-Layout
https://sandbox.zenodo.org/records/298210?
.

Articles from Scientific Reports are provided here courtesy of
Nature Publishing Group

ACTIONS

View on publisher site

PDF (2.4 MB)

Cite

Collections

Permalink

PERMALINK

Copy

RESOURCES

Similar articles

Cited by other articles

Links to NCBI Databases

Cite

Copy

Download .nbib

.nbib

Format:

AMA

APA

MLA

NLM

Add to Collections

Create a new collection

Add to an existing collection

Name your collection

*

Choose a collection

Unable to load your collection due to an error

Please try again

Add

Cancel

Follow NCBI

NCBI on X (formerly known as Twitter)

NCBI on Facebook

NCBI on LinkedIn

NCBI on GitHub

NCBI RSS feed

Connect with NLM

NLM on X (formerly known as Twitter)

NLM on Facebook

NLM on YouTube

National Library of Medicine

8600 Rockville Pike
Bethesda, MD 20894

Web Policies

FOIA

HHS Vulnerability Disclosure

Help

Accessibility

Careers

NLM

NIH

HHS

USA.gov

Back to Top
</reference>

<statements>
1. Learner model fuses skill level (knowledge tracing—BKT/DKT/SAKT—over motor knowledge components and action-quality scores), learning style/preferences (logs), physical condition (load, fatigue, HRV, readiness), and cognitive/affective state (engagement, cognitive load). Neuro-symbolic designs improve interpretability.
</statements>

Begin the assessment now. Output only the JSON list, without any conversational text or explanations.