Conversational Web Navigation On Weblinx
评估指标
Element (IoU)
Intent Match
Overall score
Text (F1)
评测结果
各个模型在此基准测试上的表现结果
比较表格
| 模型名称 | Element (IoU) | Intent Match | Overall score | Text (F1) |
|---|---|---|---|---|
| weblinx-real-world-website-navigation-with | 8.62 | 42.77 | 8.51 | 3.45 |
| weblinx-real-world-website-navigation-with | 20.54 | 83.32 | 23.73 | 25.85 |
| weblinx-real-world-website-navigation-with | 8.28 | 81.80 | 16.88 | 25.21 |
| weblinx-real-world-website-navigation-with | 16.50 | 79.89 | 20.94 | 23.16 |
| weblinx-real-world-website-navigation-with | 15.70 | 80.07 | 19.97 | 22.30 |
| weblinx-real-world-website-navigation-with | 22.82 | 81.91 | 25.21 | 26.60 |
| weblinx-real-world-website-navigation-with | 18.64 | 77.56 | 21.22 | 22.39 |
| weblinx-real-world-website-navigation-with | 13.39 | 75.87 | 15.13 | 13.58 |
| weblinx-real-world-website-navigation-with | 15.36 | 80.02 | 17.27 | 14.05 |
| weblinx-real-world-website-navigation-with | 12.05 | 74.25 | 12.63 | 7.67 |
| weblinx-real-world-website-navigation-with | 6.20 | 79.71 | 12.51 | 16.40 |
| weblinx-real-world-website-navigation-with | 22.60 | 84.00 | 25.02 | 27.17 |
| weblinx-real-world-website-navigation-with | 10.85 | 41.66 | 10.72 | 6.75 |
| weblinx-real-world-website-navigation-with | 14.86 | 79.69 | 14.99 | 9.21 |
| weblinx-real-world-website-navigation-with | 20.31 | 81.14 | 23.77 | 25.75 |
| weblinx-real-world-website-navigation-with | 10.91 | 42.36 | 10.45 | 6.21 |
| weblinx-real-world-website-navigation-with | 22.26 | 82.64 | 24.57 | 26.50 |