1gabriella/the-interior-of-the-amygdala

C#

0

25 commits

updated Jun 10, 2025

See the code

README

The Interior of the Amygdala

A Virtual Reality experience built in Unity, showcasing interactive environments, AI-driven chatbots, emotion detection, audio-reactive visuals, and a mini-map system.


πŸ“‘ Table of Contents


🌟 Features

  • Built with Unity XR Interaction Toolkit
  • AI-driven chatbot UI (FlipPhoneChatXR)
  • Real-time speech transcription (SpeechRecognitionTest)
  • Emotion detection via Hugging Face (EmotionDetectionAPI)
  • Audio-reactive FFT visuals & guitar simulation (SimpleMusicVA)
  • Interactive draggable environment & 2D mini-map (MinimapSystem)

🎯 Prerequisites

  • Unity: 2021.3 LTS or newer
  • **Android SDK (for Oculus Quest builds)
  • Unity Packages (via Package Manager):
    • XR Interaction Toolkit
    • Oculus XR Plugin
    • Input System
    • TextMeshPro
    • Unity UI

πŸ› οΈ Project Setup

  1. Clone the repository
    git clone https://github.com/1gabriella/VR-Nostalgia-Final.git
    cd VR-Nostalgia-Final
    

git lfs install git lfs pull

Open in Unity

  1. Add project to Unity Hub
    • In Unity Hub: Add β†’ select the project folder

πŸ”‘ Hugging Face Integration

  1. Get an API Token

    • Sign in at huggingface.co β†’ Settings β†’ Access Tokens β†’ New Token (grant read access)
  2. Assign your token

    • In the Inspector, paste your token into the apiKey fields for:
      • FlipPhoneChatXR
      • SpeechRecognitionTest Screenshot 2025-04-21 at 01 55 00
  3. Model Endpoints

    • Chat: microsoft/DialoGPT-medium
    • ASR: facebook/wav2vec2-base-960h
    • Emotion: 1bbypluto/Nostalgic_finetuned

πŸš€ Usage

In-Editor Testing

  • Press Play in the Unity Editor.
  • Note: player to movearound requires a connected VR headset.

Building for a VR Headset (Oculus Quest 3S)

  1. Switch build target

    • File β†’ Build Settings β†’ select Android β†’ Switch Platform
    • Add your current scene under Scenes In Build
  2. Player Settings

    • Minimum API Level: Android 7.0 or higher
    • XR Plug-in Management: ensure Oculus is checked Screenshot 2025-04-20 at 14 51 29
  3. Build & Run

    • Connect your Quest via USB
    • Click Build and Run β†’ Unity will deploy the APK to your headset
    • First build may take a while
  4. Test on Quest

    • Launch the app under Unknown Sources in meta quest
    • note you will need the meta quest app and have developer settings enabled

1gabriella/the-interior-of-the-amygdala

C#

0

25 commits

updated Jun 10, 2025

See the code

README

The Interior of the Amygdala

A Virtual Reality experience built in Unity, showcasing interactive environments, AI-driven chatbots, emotion detection, audio-reactive visuals, and a mini-map system.


πŸ“‘ Table of Contents


🌟 Features

  • Built with Unity XR Interaction Toolkit
  • AI-driven chatbot UI (FlipPhoneChatXR)
  • Real-time speech transcription (SpeechRecognitionTest)
  • Emotion detection via Hugging Face (EmotionDetectionAPI)
  • Audio-reactive FFT visuals & guitar simulation (SimpleMusicVA)
  • Interactive draggable environment & 2D mini-map (MinimapSystem)

🎯 Prerequisites

  • Unity: 2021.3 LTS or newer
  • **Android SDK (for Oculus Quest builds)
  • Unity Packages (via Package Manager):
    • XR Interaction Toolkit
    • Oculus XR Plugin
    • Input System
    • TextMeshPro
    • Unity UI

πŸ› οΈ Project Setup

  1. Clone the repository
    git clone https://github.com/1gabriella/VR-Nostalgia-Final.git
    cd VR-Nostalgia-Final
    

git lfs install git lfs pull

Open in Unity

  1. Add project to Unity Hub
    • In Unity Hub: Add β†’ select the project folder

πŸ”‘ Hugging Face Integration

  1. Get an API Token

    • Sign in at huggingface.co β†’ Settings β†’ Access Tokens β†’ New Token (grant read access)
  2. Assign your token

    • In the Inspector, paste your token into the apiKey fields for:
      • FlipPhoneChatXR
      • SpeechRecognitionTest Screenshot 2025-04-21 at 01 55 00
  3. Model Endpoints

    • Chat: microsoft/DialoGPT-medium
    • ASR: facebook/wav2vec2-base-960h
    • Emotion: 1bbypluto/Nostalgic_finetuned

πŸš€ Usage

In-Editor Testing

  • Press Play in the Unity Editor.
  • Note: player to movearound requires a connected VR headset.

Building for a VR Headset (Oculus Quest 3S)

  1. Switch build target

    • File β†’ Build Settings β†’ select Android β†’ Switch Platform
    • Add your current scene under Scenes In Build
  2. Player Settings

    • Minimum API Level: Android 7.0 or higher
    • XR Plug-in Management: ensure Oculus is checked Screenshot 2025-04-20 at 14 51 29
  3. Build & Run

    • Connect your Quest via USB
    • Click Build and Run β†’ Unity will deploy the APK to your headset
    • First build may take a while
  4. Test on Quest

    • Launch the app under Unknown Sources in meta quest
    • note you will need the meta quest app and have developer settings enabled