QA over KG

QA over KG

List of Logical Forms:

• Lambda calculus
• Lambda DCS
• SPARQL

Notes:

• Hybrid: Use both structured and unstructured data
• ATM: Amazon Mechanical Turk
• Single: single-hop/simple question
• Multi: multi-hop/complex/compositional question
• Inter_Q: intermediary question
• Triple: A triple format. In Freebase, each element is an URL to Freebase. In Wikidata, each element is an id.

Year	Dataset	#hops	Size	Source	Web/Paper	Query	Data Infor	Note	Created by
2020	KQA Pro	multi	120,000		paper
2019	LC-QuAD 2.0	multi	30,000	DBpedia + Wikidata	paper	SPARQL	Question + Query + template		crowdsourcing
2019	FreebaseQA	single			paper
2018	ComplexWebQuestions	multi	34,689	WebQuestionsSP	web, paper	SPARQL	Question + Query + Ans	Hybrid	ATM
2018	CSQA	multi	1.6M		web, paper
2017	MetaQA	multi	~400,000	WikiMovies	paper				templates
2017	LC-QuAD	multi	5,000	DBpedia	paper	SPARQL	Question + Query + Inter_Q		crowdsourcing
2017	SimpleQuestionsWikidata	single	49,202	Wikidata	paper		Question + Triple		manual
2017	ComplexQuestions	multi	150	Freebase	paper			Use for testing	human annotators
2016	WikiMovies	single			paper			Hybrid
2016	WEBQUESTIONSSP	single	4,737	Freebase	paper	SPARQL	Question + Query + URL		manual
2015	SimpleQuestions	single	108,442	Freebase	paper		Question + Triple		human annotators
2015	QALD-5	single	468	DBpedia	paper	SPARQL	Question + Query + Ans	Multilingual, Hybrid	manual
2013	WEBQUESTIONS	single	5,810	Freebase	paper	list of descriptions	Question + query + URL	query is text	ATM
2013	FREE917	single	917	Freebase	paper	Lambda calculus	Question + Query		2 native speakers