HyperAI超神经

首页资讯论文教程数据集百科 SOTA LLM 模型天梯 GPU 天梯顶会

中文

HyperAI超神经

Semantic Parsing On Spider

评估指标

Accuracy

评测结果

各个模型在此基准测试上的表现结果

模型名称	Accuracy	Paper Title	Repository
code-davinci-002 175B (LEVER)	81.9	LEVER: Learning to Verify Language-to-Code Generation with Execution	-
T5-3B + PICARD	71.9	PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models	-
RATSQL + BERT	65.6	RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers	-
RESDSQL-3B + NatSQL	84.1	RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL	-
Exact Set Matching	19.7	Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task	-
Graphix-3B + PICARD	74.0	Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing	-
SADGA + GAP	70.1	SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL	-
RASAT+PICARD	75.5	RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL	-
RATSQL + GAP	69.7	Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training	-
RATSQL + Grammar-Augmented Pre-Training	69.6	GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing	-

0 of 10 row(s) selected.

Semantic Parsing On Spider | SOTA | HyperAI超神经