Open Access Paper
28 December 2022 Numerical reasoning based on transformer
Author Affiliations +
Proceedings Volume 12506, Third International Conference on Computer Science and Communication Technology (ICCSCT 2022); 1250620 (2022) https://doi.org/10.1117/12.2661770
Event: International Conference on Computer Science and Communication Technology (ICCSCT 2022), 2022, Beijing, China
Abstract
Numerical reasoning is a complex subtask in machine reading comprehension, which requires the model to complete discrete operations such as statistics and calculation in the process of reasoning answers. As far as we know, the best solution for numerical reasoning adopts GNN structure. However, the graph structure is often generated by hand-designed rules and it will cost extra computation resource. To tackle these problems, we propose a Transformer-based numerical reasoning solution which transforms the hand-designed graph structure into learnable parameters. Extensive experimental results show that compared to those GNN-based methods, our method can carry out numerical reasoning more efficiently only at the cost of a little decrease on answer quality.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Xu Wei "Numerical reasoning based on transformer", Proc. SPIE 12506, Third International Conference on Computer Science and Communication Technology (ICCSCT 2022), 1250620 (28 December 2022); https://doi.org/10.1117/12.2661770
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Computer programming

Transformers

Data modeling

Neural networks

Statistical modeling

Convolution

Dielectrophoresis

RELATED CONTENT

Stock text topic recognition based on Stu-BERT
Proceedings of SPIE (June 15 2022)
Toxic detection based on RoBERTa and TF-IDF
Proceedings of SPIE (November 10 2022)
Representation research based on sketch images
Proceedings of SPIE (October 20 2022)
Research on text classification model based on ERNIE2.0-DICNN
Proceedings of SPIE (November 22 2022)

Back to Top