cmu-l3/ntptutorial-II

Neural theorem proving tutorial, version II

39

stars

20

commits

Jupyter Notebook

primary language

Apr 26, 2024

updated

README

Neural theorem proving tutorial II

Neural theorem proving combines neural language models with formal proof assistants.
This tutorial introduces two research threads in neural theorem proving via interactive Jupyter notebooks.

This is an updated version of https://github.com/wellecks/ntptutorial.

[slides]

Part I : Next-step suggestion

Builds a neural next-step suggestion tool, introducing concepts and past work in neural theorem proving along the way.

Notebooks:

TopicNotebook
0. Intronotebook
1. Datanotebook
2. Learningnotebook
3. Proof Searchnotebook
4. Evaluationnotebook
5. Contextnotebook
6. LLMLean toolnotebook

All notebooks are in (partI_nextstep/notebooks).

Artifacts:

NameHuggingface
Data: mathlib extractionsl3lab/ntp-mathlib
Data: instructions (state-tactic)l3lab/ntp-mathlib-instruct-st
Data: instructions (+context)l3lab/ntp-mathlib-instruct-ctx
Model: state-tacticl3lab/ntp-mathlib-st-deepseek-coder-1.3b
Model: +contextl3lab/ntp-mathlib-context-deepseek-coder-1.3b

Setup:

Please follow the setup instructions in partI_nextstep/README.md.

Part II : Language cascades

Chain together language models to guide formal proof search with informal proofs.

Notebooks:

TopicNotebook
1. Language model cascadesnotebook
2. Draft, Sketch, Provenotebook

All notebooks are in (partII_dsp/notebooks).

Setup:

Please follow the setup instructions in partII_dsp/README.md.


History

This is an updated version of A tutorial on neural theorem proving (https://github.com/wellecks/ntptutorial).
Please see the repository for more details.

Citation

Until there is an associated preprint, please cite this repository:

@misc{ntptutorial,
  author = {Sean Welleck},
  title = {Neural theorem proving tutorial II},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/cmu-l3/ntptutorial-II}},
}

Contributors

wellecks

16 commits

cmu-l3

2 commits

pitmonticone

1 commits

Seasawher

1 commits

cmu-l3/ntptutorial-II

Neural theorem proving tutorial, version II

39

stars

20

commits

Jupyter Notebook

primary language

Apr 26, 2024

updated

README

Neural theorem proving tutorial II

Neural theorem proving combines neural language models with formal proof assistants.
This tutorial introduces two research threads in neural theorem proving via interactive Jupyter notebooks.

This is an updated version of https://github.com/wellecks/ntptutorial.

[slides]

Part I : Next-step suggestion

Builds a neural next-step suggestion tool, introducing concepts and past work in neural theorem proving along the way.

Notebooks:

TopicNotebook
0. Intronotebook
1. Datanotebook
2. Learningnotebook
3. Proof Searchnotebook
4. Evaluationnotebook
5. Contextnotebook
6. LLMLean toolnotebook

All notebooks are in (partI_nextstep/notebooks).

Artifacts:

NameHuggingface
Data: mathlib extractionsl3lab/ntp-mathlib
Data: instructions (state-tactic)l3lab/ntp-mathlib-instruct-st
Data: instructions (+context)l3lab/ntp-mathlib-instruct-ctx
Model: state-tacticl3lab/ntp-mathlib-st-deepseek-coder-1.3b
Model: +contextl3lab/ntp-mathlib-context-deepseek-coder-1.3b

Setup:

Please follow the setup instructions in partI_nextstep/README.md.

Part II : Language cascades

Chain together language models to guide formal proof search with informal proofs.

Notebooks:

TopicNotebook
1. Language model cascadesnotebook
2. Draft, Sketch, Provenotebook

All notebooks are in (partII_dsp/notebooks).

Setup:

Please follow the setup instructions in partII_dsp/README.md.


History

This is an updated version of A tutorial on neural theorem proving (https://github.com/wellecks/ntptutorial).
Please see the repository for more details.

Citation

Until there is an associated preprint, please cite this repository:

@misc{ntptutorial,
  author = {Sean Welleck},
  title = {Neural theorem proving tutorial II},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/cmu-l3/ntptutorial-II}},
}

Contributors

wellecks

16 commits

cmu-l3

2 commits

pitmonticone

1 commits

Seasawher

1 commits

Languages

Jupyter Notebook

44.3%

Lean

27.7%

Python

26.7%

Shell

1.3%