[
  {
    "path": "README.md",
    "content": "# [Awesome deep logic](https://github.com/ccclyu/awesome-deeplogic) [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome)\n\nMust-Read Papers or Resources on how to integrate symbolic logic into deep neural nets.\n\n### Survey and Open Challenges\n\n1. **From Machine Learning to Machine Reasoning** *Leon Bottou* Arxiv 2011 [[pdf](https://arxiv.org/abs/1102.1808)]\n\n1. **From Statistical Relational to Neuro-Symbolic Artificial Intelligence** *Luc De Raedt , Sebastijan Dumanˇci ́c , Robin Manhaeve and Giuseppe Marra* Arxiv 2020 [[pdf](https://arxiv.org/pdf/2003.08316.pdf)]\n\n1. **Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspective** *Luis C. Lamb et,al.* Arxiv 2020 [[pdf](https://arxiv.org/pdf/2003.00330.pdf)]\n\n1. **Relational inductive biases, deep learning and graph networks**  *Peter W. Battaglia et,al.* Arxiv 2018 [[pdf](https://arxiv.org/pdf/1806.01261.pdf)]\n\n\n### Tutorials\n\n1. **Neuro-Symbolic Methods For Language And Vision** AAAI 2022 [[link](https://sites.google.com/allenai.org/nsmlv-tutorial-aaai-22)]\n\n\n### Logic as Knowledge Regularization\n1. **Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic** *Xufeng Zhao, Mengdi Li, Wenhao Lu, Cornelius Weber, Jae Hee Lee, Kun Chu, Stefan Wermter.* COLING 2024 [[pdf](https://arxiv.org/abs/2309.13339)] [[code](https://github.com/xf-zhao/LoT)]\n\n1. **Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference.** *Yichao Zhou, Yu Yan, Rujun Han, J. Harry Caufield,Kai-Wei Chang, Yizhou Sun, Peipei Ping and Wei Wang.* AAAI 2021 [[pdf](https://arxiv.org/pdf/2012.08790.pdf)] [[code](https://github.com/yuyanislearning/CTRL-PG)]\n\n1. **Integrating Deep Learning with Logic Fusion for Information Extraction.** *Wenya Wang, Sinno Jialin Pan*. AAAI 2020 [[pdf](https://arxiv.org/pdf/1912.03041.pdf)] [[code](https://github.com/happywwy/RuleFusionForIE)] \n\n1. **Logic-guided Data Augmentation and Reguralization for Consistent Question Answering.** *[Akari Asai](https://akariasai.github.io/), Hannaneh Hajishirzi*. ACL 2020 [[pdf](https://arxiv.org/pdf/2004.10157.pdf)] [[code](https://github.com/AkariAsai/logic_guided_qa)]\n\n1. **Structured Tuning for Semantic Role Labeling.** *[Tao Li](https://www.cs.utah.edu/~tli/), Parth Anand Jawale, Martha Palmer, Vivek Srikumar* ACL 2020 [[pdf](https://arxiv.org/pdf/2005.00496.pdf)] [[code](https://github.com/utahnlp/structured_tuning_srl)]\n\n1. **Leveraging Declarative Knowledge in Text and First-Order Logic for Fine-Grained Propaganda Detection.** *Ruize Wang, Duyu Tang, et,al* EMNLP 2020 [[pdf](https://arxiv.org/pdf/2004.14201.pdf)]\n\n1. **Joint Constrained Learning for Event-Event Relation Extraction** *Haoyu Wang, Muhao Chen, Hongming Zhang, Dan Roth* EMNLP 2020 [[pdf](https://arxiv.org/pdf/2010.06727.pdf)]\n\n1. **A Logic-Driven Framework for Consistency of Neural Models.** *Tao Li, Vivek Gupta, Maitrey Mehta, Vivek Srikumar* EMNLP-IJCNLP 2019 [[pdf](https://www.aclweb.org/anthology/D19-1405/)] [[code](https://github.com/utahnlp/consistency)]\n\n1. **Adversarially regularising neural NLI models to integrate logical background knowledge.** *Pasquale Minervini, Sebastian Riedel*. CoNLL 2018 [[pdf](https://www.aclweb.org/anthology/K18-1007.pdf)] [[code](https://github.com/uclnlp/adversarial-nli)]\n\n1. **Lifted Rule Injection for Relation Embeddings.** *Thomas Demeester, Tim Rocktäschel, Sebastian Riedel* EMNLP 2016 [[pdf](https://www.aclweb.org/anthology/D16-1146.pdf)] \n\n### Logic as Weak Supervision\n\n1. **Neuro-symbolic Natural Logic with Introspective Revision for Natural Language Inference** *Yufei Feng, Xiaoyu Yang, Xiaodan Zhu, Michael Greenspan* TACL 2022 [[pdf](https://arxiv.org/pdf/2203.04857.pdf)]\n\n1. **LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking** *Hang Jiang et,al* ACL 2021 [[pdf](https://aclanthology.org/2021.acl-long.64.pdf)]  \n\n1. **Weakly Supervised Named Entity Tagging with Learnable Logical Rules.**  *Jiacheng Li, Haibo Ding, Jingbo Shang, Julian McAuley, Zhe Feng* ACL-IJCNLP 2021 [[pdf](https://aclanthology.org/2021.acl-long.352.pdf)] [[code](https://github.com/JiachengLi1995/TALLOR)] \n\n\n### Incorporate Logic into NN Module\n\n1. **Learning Language Representations with Logical Inductive Bias.** *Jianshu Chen* ICLR 2023 [pdf](https://openreview.net/pdf?id=rGeZuBRahju)]\n\n1. **Modeling Content and Context with Deep Relational Learning** *Maria Leonor Pacheco and Dan Goldwasser* TACL 2021 [[pdf]](https://www.aclweb.org/anthology/2021.tacl-1.7.pdf) [[code]](https://gitlab.com/purdueNlp/DRaiL/)\n\n1. **Logical Neural Networks** *Ryan Riegel et,al (IBM Research)* Arxiv 2020 [[pdf](https://arxiv.org/pdf/2006.13155.pdf)]\n\n\n### Explainability and Understanding\n\n1. **LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models**, *Mihir Parmar et,al* ACL 2024  [[pdf](https://aclanthology.org/2024.acl-long.739.pdf)]\n\n1. **Transformers Implement First-Order Logic with Majority Quantifiers** *William Merrill, Ashish Sabharwal* Arxiv 2022 [[pdf](https://arxiv.org/abs/2210.02671)]\n\n1. **What Can Neural Networks Reson About?**  *Keyulu Xu, Jingling Li et,al* ICLR 2020 [[pdf](https://arxiv.org/pdf/1905.13211.pdf)] [[code](https://github.com/NNReasoning/What-Can-Neural-Networks-Reason-About)]\n\n1. **Relational Reasoning and Generalization using Non-symbolic Neural Networks** Arxiv 2020 [[pdf](https://arxiv.org/pdf/2006.07968.pdf)]\n\n\n### Related Application\n\n1. **Complex Query Answering With Neural Link Predictors** *Erik Arakelyan, Daniel Daza, Pasquale Minervini & Michael Cochez* ICLR 2021 [[pdf](https://openreview.net/pdf?id=Mos9F9kDwkz)] [[code](https://github.com/uclnlp/cqd)]\n\n1. **Faithfully Explainable Recommendation via Neural Logic Reasoning** *Yaxin Zhu, Yikun Xian, Zuohui Fu, Gerard de Melo, Yongfeng Zhang* NAACL [[pdf](https://www.aclweb.org/anthology/2021.naacl-main.245.pdf)] [[code](https://github.com/orcax/LOGER)]\n\n1. **Correlating neural and symbolic representations of language.** *Grzegorz Chrupała, Afra Alishahi.* ACL 2019 [[pdf](https://www.aclweb.org/anthology/P19-1283.pdf)][[code](https://github.com/gchrupala/ursa)]\n\n1. **Representing Meaning with a Combination of Logical and Distributional Models.** *I. Beltagy, Stephen Roller, Pengxiang Cheng, Katrin Erk, Raymond J. Mooney.* Computational Linguistics 2016 [[pdf](https://www.aclweb.org/anthology/J16-4007.pdf)] [[code](https://github.com/ibeltagy/rrr)]\n"
  }
]