CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 12506 > Article
Open Access Paper
28 December 2022 Numerical reasoning based on transformer
Xu Wei
Author Affiliations +
Proceedings Volume 12506, Third International Conference on Computer Science and Communication Technology (ICCSCT 2022); 1250620 (2022) https://doi.org/10.1117/12.2661770
Event: International Conference on Computer Science and Communication Technology (ICCSCT 2022), 2022, Beijing, China
Abstract
Numerical reasoning is a complex subtask in machine reading comprehension, which requires the model to complete discrete operations such as statistics and calculation in the process of reasoning answers. As far as we know, the best solution for numerical reasoning adopts GNN structure. However, the graph structure is often generated by hand-designed rules and it will cost extra computation resource. To tackle these problems, we propose a Transformer-based numerical reasoning solution which transforms the hand-designed graph structure into learnable parameters. Extensive experimental results show that compared to those GNN-based methods, our method can carry out numerical reasoning more efficiently only at the cost of a little decrease on answer quality.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Xu Wei "Numerical reasoning based on transformer", Proc. SPIE 12506, Third International Conference on Computer Science and Communication Technology (ICCSCT 2022), 1250620 (28 December 2022); https://doi.org/10.1117/12.2661770
PROCEEDINGS
 8 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Computer programming
Transformers
Data modeling
Neural networks
Statistical modeling
Convolution
Dielectrophoresis
RELATED CONTENT
Stock text topic recognition based on Stu-BERT
Proceedings of SPIE (June 15 2022)
Toxic detection based on RoBERTa and TF-IDF
Proceedings of SPIE (November 10 2022)
Representation research based on sketch images
Proceedings of SPIE (October 20 2022)
Two way machine translation model of notices to navigation based...
Proceedings of SPIE (April 14 2022)
Research on text classification model based on ERNIE2.0-DICNN
Proceedings of SPIE (November 22 2022)
A review of self-encoding language models for bidirectional representation
Proceedings of SPIE (October 05 2021)
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top