基于RoBERTa-BiGRU-CRF的交通事故处置流程文本信息抽取

陈娇娜, 张静, 靳引利, 王鹏

交通运输研究 ›› 2024, Vol. 10 ›› Issue (3) : 20-28.

交通运输研究 ›› 2024, Vol. 10 ›› Issue (3) : 20-28. DOI: 10.16503/j.cnki.2095-9931.2024.03.003
理论与方法

基于RoBERTa-BiGRU-CRF的交通事故处置流程文本信息抽取

作者信息 +

Text Information Extraction of Traffic Accident Disposal Process Based on RoBERTa-BiGRU-CRF

  • CHEN Jiaona 1 ,  
  • ZHANG Jing 1 ,  
  • JIN Yinli 2 ,  
  • WANG Peng 1
Author information +
文章历史 +

摘要

为改善现有交通事故应急信息识别中处置流程抽取不足的问题,以提高应急处置知识抽取的准确率,针对交通事故文本信息自然语言描述的复杂性,提出了一种基于预训练模型和混合深度学习网络的交通事故处置流程抽取方法。首先,从事故属性、处置机构、处置措施、处置效果和任务预判5个方面定义交通事故处置流程实体,并采用BIO标注实体类型。然后,将RoBERTa预训练模型生成的词向量作为输入,采用BiGRU模型进行特征提取,通过CRF模型进行条件约束来获得最终实体类型,并对RoBERTa-BiGRU-CRF组合模型的交通事故处置流程抽取结果进行时序融合,利用图数据库对抽取结果进行知识存储和可视化展示。最后,以陕西省高速公路交通事故文本信息为样本数据集,分别比较了不同预训练模型和深度学习网络的模型性能,利用消融实验论证了RoBERTa-BiGRU-CRF模型的有效性,并通过某起交通事故进行了实例验证。结果显示,RoBERTa-BiGRU-CRF组合模型的抽取效果最佳,F1值为99.77%。研究表明,所提方法能有效从文本信息中抽取交通事故应急处置流程关键要素,实现了应急处置流程抽取结果的可视化呈现,可为应急处置决策提供参考。

Abstract

To address the existing issue of insufficient extraction in recognizing traffic accident emergency information and improve the accuracy of emergency processing knowledge extraction, a method for extracting the traffic accident process based on pre-training model and hybrid deep learning networks was proposed aiming at the complexity of natural language description of traffic accident text information. Firstly, the disposal process entities of traffic accidents were defined from five aspects such as accident characteristic, disposal agency, disposal measures, disposal effects, and task prediction, and these entity types were marked using BIO notation. Then, the word vectors generated by the RoBERTa pre-trained model were used as input, the BiGRU model was used for feature extraction, and the CRF model was used for conditional constraints to obtain the final entity type. Furthermore, time-series fusion was used to the traffic accident handling process extraction results obtained from RoBERTa-BiGRU-CRF combined model, and the extracted results were stored and visualized using a graph database. Finally, using the text information of highway traffic accidents in Shaanxi Province as a sample data set, the performance of different pre-trained models and deep learning networks were compared, the effectiveness of the RoBERTa-BiGRU-CRF model was demonstrated through ablation experiments and validated through an example of one traffic accident. The results demonstrated that the RoBERTa-BiGRU-CRF combined model yielded superior extraction results with the F1 value of 99.77%. Research has shown that the proposed method can effectively extract key elements of the emergency response process for traffic accidents from textual information, achieve visual presentation of the results of emergency response process extraction, and provide reference for emergency response decision-making.

关键词

交通安全 / 交通事故 / 实体抽取 / 预训练模型 / 深度学习 / 时序融合

Key words

traffic safety / traffic accident / entity extraction / pre-trained model / deep learning / time-series fusion

引用本文

导出引用
陈娇娜, 张静, 靳引利, . 基于RoBERTa-BiGRU-CRF的交通事故处置流程文本信息抽取[J]. 交通运输研究. 2024, 10(3): 20-28 https://doi.org/10.16503/j.cnki.2095-9931.2024.03.003
CHEN Jiaona, ZHANG Jing, JIN Yinli, et al. Text Information Extraction of Traffic Accident Disposal Process Based on RoBERTa-BiGRU-CRF[J]. Transport Research. 2024, 10(3): 20-28 https://doi.org/10.16503/j.cnki.2095-9931.2024.03.003
中图分类号: U495   

参考文献

[1]
代建华, 彭若瑶, 许路, 等. 基于深度神经网络的信息抽取研究综述[J]. 西南师范大学学报(自然科学版), 2022, 47(4):1-11.
[2]
陈娇娜, 靳引利, 陶伟俊, 等. 基于文本信息的高速公路事故持续时间中介效应研究[J]. 中国安全科学学报, 2023, 33(4):155-162.
[3]
梁建军, 雷咸锐, 吴斌, 等. 基于规则模式的瓦斯爆炸事故信息抽取技术[J]. 煤矿安全, 2023, 54(2):239-245.
[4]
张萌, 陈佳惠, 孙然然, 等. 基于规则的城市轨道交通安全事件信息抽取及其知识元表示[J]. 科学技术与工程, 2021, 21(15):6435-6440.
[5]
LI J, SUN A, HAN J, et al. A survey on deep learning for named entity recognition[J]. IEEE Transactions on Knowledge and Data Engineering, 2020, 34 (1): 50-70.
[6]
王颖洁, 张程烨, 白凤波, 等. 中文命名实体识别研究综述[J]. 计算机科学与探索, 2023, 17(2):324-341.
[7]
孙安亮, 时宏伟, 王金策. 基于字符与单词嵌入的航空安全命名实体识别[J]. 计算机技术与发展, 2022, 32(9):148-153.
[8]
WANG X, LIU J. A novel feature integration and entity boundary detection for named entity recognition in cybersecurity[J]. Knowledge-Based Systems, 2023, 260: 1-14.
[9]
宋敦江, 杨霖, 钟少波. 基于BERT的灾害三元组信息抽取优化研究[J]. 中国安全科学学报, 2022, 32(2):115-120.
[10]
刘婷, 张社荣, 王超, 等. 水利施工事故文本智能分析的BERT-BiLSTM混合模型[J]. 水力发电学报, 2022, 41(7):1-12.
[11]
张鹏翔. 多维字符特征表示的铁路设备事故信息抽取方法[J]. 中国安全科学学报, 2022, 32(6):109-114.
[12]
王明达, 张榜, 吴志生, 等. 基于强化学习的城镇燃气事故信息抽取方法[J]. 中国安全生产科学技术, 2023, 19(3):39-45.
[13]
刘斐, 文中, 吴艺. 基于BERT-BILSTM-CRF模型的电力行业事故文本智能分析[J]. 中国安全生产科学技术, 2023, 19(1):209-215.
[14]
JI K, LI Z, CHEN J, et al. Freeway accident duration prediction based on social network information[J]. Neural Network World Journal, 2022, 32(2): 93-112.
[15]
CHEN J, TAO W. Traffic accident duration prediction using text mining and ensemble learning on expressways[J]. Scientific Reports, 2022, 12(1): 21478.
[16]
樊海玮, 秦佳杰, 孙欢, 等. 基于BERT与BiGRU-CRF的交通事故文本信息提取模型[J]. 计算机与现代化, 2022(5):10-15.
[17]
李昀轩, 李萌, 陆建, 等. 基于多任务迁移学习的交通警情信息自动处理方法[J]. 中国公路学报, 2022, 35(9):1-12.
[18]
ZHANG L, ZHANG M, TANG J, et al. Analysis of traffic accident based on knowledge graph[J]. Journal of Advanced Transportation, 2022(9): 1-16.

基金

国家自然青年科学基金项目(52002315)
国家重点研发计划项目(2019YFB1600700)

Accesses

Citation

Detail

段落导航
相关文章

/