This Streamlit app lets users upload a photo (vacation, birthday, random snapshot) and generates a creative short story or poem inspired by the image using microsoft/kosmos-2 (multimodal AI model). The app then creates an audio narration of the generated text with an AI voice using coqui/xtts-v2 text-to-speech model. Users can listen to the narration and download both the story and audio.
| Model Name | Description | Source |
|---|---|---|
| microsoft/kosmos-2 | Multimodal (image + text) model to generate creative text from images | Hugging Face Transformers |
| coqui/xtts-v2 | AI text-to-speech (TTS) model with natural voice | Coqui TTS |
streamlittransformersPillowsoundfilenumpyTTS (Coqui TTS Python package)git clone https://github.com/Harsha-Reddy21/Story-Lens.git
cd Story-Lens
python3 -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate
pip install -r requirements.txt
streamlit run app.py
2 commits
Python
100.0%
This Streamlit app lets users upload a photo (vacation, birthday, random snapshot) and generates a creative short story or poem inspired by the image using microsoft/kosmos-2 (multimodal AI model). The app then creates an audio narration of the generated text with an AI voice using coqui/xtts-v2 text-to-speech model. Users can listen to the narration and download both the story and audio.
| Model Name | Description | Source |
|---|---|---|
| microsoft/kosmos-2 | Multimodal (image + text) model to generate creative text from images | Hugging Face Transformers |
| coqui/xtts-v2 | AI text-to-speech (TTS) model with natural voice | Coqui TTS |
streamlittransformersPillowsoundfilenumpyTTS (Coqui TTS Python package)git clone https://github.com/Harsha-Reddy21/Story-Lens.git
cd Story-Lens
python3 -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate
pip install -r requirements.txt
streamlit run app.py
2 commits
Python
100.0%