Philosophers GPT

A project that combines web scraping of philosophical texts with large language models to create an AI system that can engage in philosophical discussions in the style of historical philosophers.

Features

• Web scraping of Stanford Encyclopedia of Philosophy articles
• Custom prompt tokenization strategies for context-aware Q&A
• Fine-tuning capabilities for philosophical dialogue
• Support for various LLM architectures and deployment options

Components

• webscraper.py: Scrapes philosophical articles from Stanford Encyclopedia of Philosophy
• context_qa2.py: Custom tokenization strategies for context-aware question answering
• encoder.py: Various utilities for model tokenization and inference

Setup

TBD