LIU Guoliang, GAO Yuexian, SHANG Jianhang, et al. Research on Aircraft Maintenance Knowledge Graph Construction Technology Based on Multi-Head Attention and Full-Token Masking[J]. Aeronautical Manufacturing Technology, 2026, 69(7).
LIU Guoliang, GAO Yuexian, SHANG Jianhang, et al. Research on Aircraft Maintenance Knowledge Graph Construction Technology Based on Multi-Head Attention and Full-Token Masking[J]. Aeronautical Manufacturing Technology, 2026, 69(7). DOI: 10.16080/j.issn1671-833x.25010072.
针对飞机维修手册中存在的专业术语繁多、短文本泛化能力弱、中英文混杂及数据规模庞大等问题,本文提出一种融合多头注意力机制与整词约束策略的知识抽取与知识图谱构建方法。首先,设计CoBiTex-FTM (Contextual bidirectional text encoder with full-token masking)模型进行命名实体识别,通过多头注意力机制强化上下文建模能力,并引入基于词边界识别的整词约束算法以解决中英文混合识别问题。其次,构建BiHAM-FTM(Bidirectional LSTM multi-head attention with full-token masking)关系抽取模型完成“实体– 关系– 实体”三元组提取。最后,基于Neo4j 平台开发飞机维修知识图谱系统,实现维修数据的有效存储与可视化呈现。为验证方法有效性,构建飞机维修知识抽取数据集并进行对比与消融试验。结果表明,CoBiTex-FTM 模型F1 值达95.16%,BiHAM-FTM 模型F1 值达90.74%,验证了该方法在复杂专业领域知识抽取中的适应性,尤其在中英文混杂和短文本场景下展现出更高准确性。
Abstract
To address the challenges posed by professional terminology
short texts
large data volumes
and mixed Chinese–English content in aircraft maintenance manuals
this paper proposes a knowledge extraction and knowledge graph construction method based on multi-head attention and full-token masking. First
we design the CoBiTex-FTM (Contextual bidirectional text encoder with full-token masking) model for named entity recognition
which enhances contextual modeling through multi-head attention and ensures label consistency via a whole-word constraint algorithm tailored for mixed-language scenarios. Second
we construct the BiHAM-FTM (Bidirectional LSTM multi-head attention with full-token masking) model to extract “entity–relation–entity” triples. Finally
an aircraft maintenance knowledge graph system is implemented using Neo4j for structured storage and visual representation of maintenance knowledge. To validate the approach
we build a domain-specific dataset and conduct comparative and ablation experiments. Experimental results show that CoBiTex-FTM achieves an F1 score of 95.16%