HyperAIHyperAI

Command Palette

Search for a command to run...

Multiway Attention Networks for Modeling Sentence Pairs

Ming Zhou Furu Wei Chuanqi Tan Weifeng Lv Wenhui Wang

Abstract

Modeling sentence pairs plays the vital role forjudging the relationship between two sentences,such as paraphrase identification, natural languageinference, and answer sentence selection. Previouswork achieves very promising results using neuralnetworks with attention mechanism. In this paper,we propose the multiway attention networks whichemploy multiple attention functions to match sentence pairs under the matching-aggregation framework. Specifically, we design four attention functions to match words in corresponding sentences.Then, we aggregate the matching information fromeach function, and combine the information fromall functions to obtain the final representation. Experimental results demonstrate that the proposedmultiway attention networks improve the result onthe Quora Question Pairs, SNLI, MultiNLI, and answer sentence selection task on the SQuAD dataset.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp