Must-read papers on commonsense knowledge and others resources and tutorials
Better viewed on website:
https://adapt-sjtu.github.io/commonsense-papers/
We aim to select the most representative and innovative papers in the research field of commonsense knowledge, and provide taxonomy/classification as well as statistics of these papers to give a quick overview of the field and help focused reading.
We've also added (influential) citation numbers according to Semantic Scholar, AltMetric Badge (paper influence in social media) and Dimensions Badge (paper citations) for papers that can be linked to an arxiv id/DOI. Highly influential papers should now be easier to identify, though we still encourage readers to read other papers that might have been overlooked. Due to rendering limitation, the badges are only visible on our website.
Contributed by ADAPTers (major efforts by Zhiling Zhang(@blmoistawinde), Siyu Ren, Hongru Huang, Zelin Zhou, Yanzhu Guo)
Our list may not be complete. We will keep adding papers and improving it. Contributions are welcomed!
Total papers in this repo:
Research Keywords
Non-stopping words in title, indicating the hot topics in this field.
| count | |
|---|---|
| reasoning | 13 |
| graph | 8 |
| question | 6 |
| challenge | 5 |
| common | 5 |
| sense | 5 |
| model | 5 |
| pre | 4 |
| text | 4 |
| story | 4 |
Researchers
Most active researchers in this field
| count | |
|---|---|
| Yejin Choi | 14 |
| Chandra Bhagavatula | 7 |
| Antoine Bosselut | 7 |
| Bill Yuchen Lin | 6 |
| Ronan Le Bras | 5 |
| Yangqiu Song | 5 |
| Hongming Zhang | 4 |
| Hannah Rashkin | 4 |
| Kenny Q. Zhu | 4 |
| Xiang Ren | 4 |
| Maarten Sap | 4 |
| Dan Roth | 4 |
| Vered Shwartz | 3 |
| Chaitanya Malaviya | 3 |
| Wangchunshu Zhou | 2 |
Venues
| count | |
|---|---|
| ACL | 10 |
| EMNLP | 9 |
| arxiv | 8 |
| AAAI | 6 |
| AKBC | 3 |
Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches arxiv 2019 paper (Citations: 27, 2 influential)
Shane Storks, Qiaozi Gao, Joyce Y. Chai
T6: Commonsense Reasoning for Natural Language Processing. ACL 2020. slides and video
Antoine Bosselut, Dan Roth, Maarten Sap, Vered Shwartz, Yejin Choi
CYC: Toward programs with common sense Communications of the ACM 1990 data homepage
Commonsense Causal Reasoning between Short Texts (CausalNet) KR 2016 paper homepage code (Citations: 35, 9 influential)
Zhiyi Luo, Yuchen Sha, Kenny Q. Zhu, Seung-won Hwang, Zhongyuan Wang
ConceptNet 5.5: an open multilingual graph of general knowledge AAAI 2017. paper homepage repo embedding(ConceptNet Numberbatch) repo (Citations: 653, 159 influential)
Robyn Speer, Joshua Chin, Catherine Havasi
ATOMIC: An Atlas of Machine Commonsense for If-Then Reasoning AAAI 2019. paper homepage (Citations: 170, 41 influential)
Maarten Sap, Ronan LeBras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A. Smith, Yejin Choi
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction ACL 2019 paper homepage code (Citations: 136, 27 influential)
Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, Yejin Choi
ASER: A Large-scale Eventuality Knowledge Graph. WWW 2020 paper homepage code (Citations: 17, 3 influential)
Hongming Zhang, Xin Liu, Haojie Pan, Yangqiu Song, Cane Wing-Ki Leung
Commonsense Properties from Query Logs and Question Answering Forums (quasimodo) CIKM 2019 paper homepage code (Citations: 13, 1 influential)
Julien Romero, Simon Razniewski, Koninika Pal, Jeff Z. Pan, Archit Sakhadeo, Gerhard Weikum
TransOMCS: From Linguistic Graphs to Commonsense Knowledge IJCAI 2020 paper homepage code (Citations: 10, 2 influential)
Hongming Zhang, Daniel Khashabi, Yangqiu Song, Dan Roth
Paragraph-Level Commonsense Transformers with Recurrent Memory (PARA-COMeT) arxiv 2020 paper (Citations: 0)
Saadia Gabriel, Chandra Bhagavatula, Vered Shwartz, Ronan Le Bras, Maxwell Forbes, Yejin Choi
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs arxiv 2020 paper (Citations: 2)
Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, Yejin Choi
CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning EMNLP 2020 Findings paper homepage (Citations: 13, 3 influential)
Bill Yuchen Lin, Wangchunshu Zhou, Ming Shen, Pei Zhou, Chandra Bhagavatula, Yejin Choi, Xiang Ren
WordNet: A Lexical Database for English Communications of the ACM Vol. 38, No. 11: 39-41. 1995. homepage
George A. Miller
Toward an Architecture for Never-Ending Language Learning (NELL) AAAI 2010 paper homepage
Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka Jr., and Tom M. Mitchell
Probase: a probabilistic taxonomy for text understanding SIGMOD 2012 paper homepage
Wentao Wu, Hongsong Li, Haixun Wang, Kenny Q. Zhu
DBpedia – A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia. Semantic Web 2012 paper homepage
Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N. Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick van Kleef, Sören Auer, Christian Bizer
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories (Story Cloze Test) NAACL 2016 paper homepage (Citations: 204, 47 influential)
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen
Modeling Naive Psychology of Characters in Simple Commonsense Stories ACL 2018 paper homepage (Citations: 33, 7 influential)
Hannah Rashkin, Antoine Bosselut, Maarten Sap, Kevin Knight, Yejin Choi
SemEval-2018 Task 11: Machine Comprehension Using Commonsense Knowledge SemEval 2018 paper (Citations: 86, 14 influential)
Simon Ostermann, Michael Roth, Ashutosh Modi, Stefan Thater, Manfred Pinkal
Reasoning about Actions and State Changes by Injecting Commonsense Knowledge (ProPara) EMNLP 2018 paper code (Citations: 42, 7 influential)
Niket Tandon, Bhavana Dalvi Mishra, Joel Grus, Wen-tau Yih, Antoine Bosselut, Peter Clark
CommonSenseqa: A question answering challenge targeting commonsense knowledge NAACL 2019 paper homepage code (Citations: 161, 53 influential)
Alon Talmor, Jonathan Herzig, Nicholas Lourie, Jonathan Berant
From Recognition to Cognition: Visual Commonsense Reasoning CVPR 2019 paper code homepage (Citations: 160, 35 influential)
Rowan Zellers, Yonatan Bisk, Ali Farhadi, Yejin Choi
oLMpics -- On what Language Model Pre-training Captures TACL 2019 paper code homepage (Citations: 61, 7 influential)
Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant
ABDUCTIVE COMMONSENSE REASONING (ART) ICLR 2020 paper homepage (Citations: 64, 7 influential)
Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Scott Wen-tau Yih, Yejin Choi
PIQA: Reasoning about Physical Commonsense in Natural Language AAAI 2020 paper homepage (Citations: 47, 6 influential)
Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, Yejin Choi
On the Role of Conceptualization in Commonsense Knowledge Graph Construction arxiv 2020 paper code (Citations: 2)
Mutian He, Yangqiu Song, Kun Xu, Dong Yu
Reasoning about Goals, Steps, and Temporal Ordering with WikiHow EMNLP 2020 paper code (Citations: 0)
Qing Lyu, Li Zhang, Chris Callison-Burch
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models EMNLP 2020 paper homepage (Citations: 4)
Bill Yuchen Lin, Seyeon Lee, Rahul Khanna and Xiang Ren
A Review of Winograd Schema Challenge Datasets and Approaches arxiv 2020 paper (Citations: 2)
Vid Kocijan, Thomas Lukasiewicz, Ernest Davis, Gary Marcus, Leora Morgenstern
Integrating External Event Knowledge for Script Learning COLING 2020 paper (Citations: 0)
Shangwen Lv, Fuqing Zhu, Songlin Hu
Enriching Large-Scale Eventuality Knowledge Graph with Entailment Relations AKBC 2020 paper code (Citations: 2)
Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng, Lifeng Shang
Reporting Bias and Knowledge Acquisition AKBC 2013 paper
Jonathan Gordon, Benjamin Van Durme
Do Neural Language Representations Learn Physical Commonsense? CogSci 2019 paper code (Citations: 21, 1 influential)
Maxwell Forbes, Ari Holtzman, Yejin Choi
How Reasonable are Common-Sense Reasoning Tasks: A Case-Study on the Winograd Schema Challenge and SWAG EMNLP 2019 paper (Citations: 17, 5 influential)
Paul Trichelair, Ali Emami, Adam Trischler, Kaheer Suleman, Jackie Chi Kit Cheung
Joint Reasoning for Multi-Faceted Commonsense Knowledge AKBC 2020 paper homepage (Citations: 6)
Yohan Chalier, Simon Razniewski, Gerhard Weikum
Does BERT Solve Commonsense Task via Commonsense Knowledge? arxiv 2020 paper (Citations: 3)
Leyang Cui, Sijie Cheng, Yu Wu, Yue Zhang
WinoWhy: A Deep Diagnosis of Essential Commonsense Knowledge for Answering Winograd Schema Challenge ACL 2020 paper code (Citations: 2)
Hongming Zhang, Xinran Zhao, Yangqiu Song
Automatic Extraction of Commonsense LocatedNear Knowledge ACL 2018 paper code (Citations: 1)
Frank F. Xu, Bill Yuchen Lin, Kenny Q. Zhu
Commonsense Knowledge Mining from Pretrained Models EMNLP 2019 paper (Citations: 50, 6 influential)
Joe Davison, Joshua Feldman, Alexander Rush
Language Models as Knowledge Bases? EMNLP 2019 paper code (Citations: 214, 37 influential)
Fabio Petroni, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H. Miller, Sebastian Riedel
Commonsense Knowledge Base Completion with Structural and Semantic Context AAAI 2020 paper code (Citations: 14, 3 influential)
Chaitanya Malaviya, Chandra Bhagavatula, Antoine Bosselut, Yejin Choi
Temporal Common Sense Acquisition with Minimal Supervision ACL 2020 paper (Citations: 11)
Ben Zhou, Qiang Ning, Daniel Khashabi, Dan Roth
Learning Physical Common Sense as Knowledge Graph Completion via BERT Data Augmentation and Constrained Tucker Factorization EMNLP 2020 paper (Citations: 0)
Zhenjie Zhao, Evangelos Papalexakis, Xiaojuan Ma
Neural natural language inference models enhanced with external knowledge ACL 2018 paper code (Citations: 115, 21 influential)
Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Diana Inkpen, Si Wei
Incorporating Structured Commonsense Knowledge in Story Completion AAAI 2019 paper (Citations: 17, 4 influential)
Jiaao Chen, Jianshu Chen, Zhou Yu
Contrastive Self-Supervised Learning for Commonsense Reasoning ACL 2020 paper code (Citations: 5)
Tassilo Klein, Moin Nabi
Do Language Embeddings Capture Scales? EMNLP Findings 2020 paper code (Citations: 0)
Xikun Zhang, Deepak Ramachandran, Ian Tenney, Yanai Elazar, Dan Roth
Differentiable Open-Ended Commonsense Reasoning arxiv 2020 paper (Citations: 1)
Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren, William W. Cohen
Pre-training Text-to-Text Transformers for Concept-centric Common Sense arxiv 2020 paper code (Citations: 2)
Wangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren
Enhanced Story Representation by ConceptNet for Predicting Story Endings CIKM 2020 paper code
Shanshan Huang, Kenny Q. Zhu, Qianzi Liao, Libin Shen and Yinggong Zhao
Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension ACL 2019 paper code (Citations: 37, 8 influential)
An Yang, Quan Wang, Jing Liu, Kai Liu, Yajuan Lyu, Hua Wu, Qiaoqiao She, Sujian Li
Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge Awareness ACL 2020 paper code (Citations: 7, 1 influential)
Sixing Wu, Ying Li, Dawei Zhang, Yang Zhou, Zhonghai Wu
Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph EMNLP 2020 paper (Citations: 2)
Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei, Xiaoyan Zhu, Minlie Huang
Dynamic Knowledge Graph Construction for Zero-shot Commonsense Question Answering arxiv 2019 paper (Citations: 1)
Antoine Bosselut, Yejin Choi
Adversarial Training for Commonsense Inference ACL 2020 RepL4NLP workshop paper (Citations: 3, 1 influential)
Lis Pereira, Xiaodong Liu, Fei Cheng, Masayuki Asahara, Ichiro Kobayashi
Unsupervised Commonsense Question Answering with Self-Talk EMNLP 2020 paper code (Citations: 22, 1 influential)
Vered Shwartz, Peter West, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering EMNLP 2020 paper code (Citations: 9, 2 influential)
Yanlin Feng, Xinyue Chen, Bill Yuchen Lin, Peifeng Wang, Jun Yan, Xiang Ren
Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation AAAI 2021 paper (Citations: 0)
Ning Bian, Xianpei Han, Bo Chen, Le Sun
Enabling Robots to Understand Incomplete Natural Language Instructions Using Commonsense Reasoning ICRA 2020 paper (Citations: 10)
Haonan Chen; Hao Tan; Alan Kuntz; Mohit Bansal; Ron Alterovitz
Visual Commonsense R-CNN CVPR 2020 paper code (Citations: 14, 3 influential)
Tan Wang, Jianqiang Huang, Hanwang Zhang, Qianru Sun