Concept-3D — AI Concept-to-3D Visualization Platform

Concept-3D is an AI-powered spatial generation and discovery platform. It transforms unstructured text descriptions and 2D concept images into interactive, high-fidelity 3D meshes using TripoSR deep learning models, Chroma vector database semantic retrieval, and a WebGL Three.js interactive viewport.

• Live Web Client: https://concept-3d.vercel.app/
• Repository: https://github.com/GuruMachanica/Concept-3D
• Milestone: Sankalp 2026 National Summit on Innovation & Skills Qualifier (MNNIT Prayagraj)

---

Core Capabilities

• Prompt-to-3D Mesh Synthesis: Deep generative reconstruction pipeline converting text prompts and single-view 2D concept images into fully textured 3D geometric meshes (.glb, .obj, .stl).
• TripoSR ML Pipeline: Optimized neural network feed-forward architecture generating production-ready 3D meshes in under 2.4 seconds.
• Vector Semantic Retrieval (ChromaDB): High-dimensional vector indexing allowing context-aware asset search, category clustering, and real-time conceptual similarity ranking.
• Interactive WebGL 3D Studio: Client-side Three.js orbit viewport with real-time wireframe inspection, vertex telemetry, dynamic lighting controls, and multi-angle asset inspection.
• Context-Aware Design Assistant: Embedded AI chat engine with fallback provider routing for design critique, mesh optimization recommendations, and semantic prompt refinement.
• Asset Lifecycle & Review Engine: Relational SQLite metadata store with user feedback rating queues and automated GLB export caching.

---

System Architecture

+-----------------------------------------------------------------------------------+
|                               CONCEPT-3D PLATFORM                                 |
+-----------------------------------------------------------------------------------+
                                         |
                 +-----------------------+-----------------------+
                 |                                               |
                 v                                               v
       +---------------------+                         +---------------------+
       |   React 18 Studio   |                         |   FastAPI Backend   |
       | (Three.js WebGL UI) |<--- REST & WebSockets --->|  (Service Engine)   |
       +---------------------+                         +---------------------+
                 |                                               |
                 v                                               +-- Intent & NLP Parser
       +---------------------+                                   +-- Chroma Vector Database
       |  3D Orbit Viewport  |                                   +-- TripoSR Neural ML Engine
       |  Wireframe & Shading|                                   +-- GLB Export Pipeline
       |  Spatial Telemetry  |                                   +-- Design Assistant Chat
       +---------------------+                                   +-- Asset Review Store
                                                                         |
                                                                         v
                                                               +---------------------+
                                                               | ChromaDB / SQLite   |
                                                               | Cached 3D Artifacts |
                                                               +---------------------+

---

Generative 3D Pipeline Sequence

sequenceDiagram
    autonumber
    actor User as 3D Designer
    participant UI as React Three.js Studio
    participant API as FastAPI Router (Port 8011)
    participant NLP as Intent Parser
    participant Chroma as Chroma Vector Index
    participant ML as TripoSR Generative Engine
    participant Cache as 3D Asset Cache Store

    User->>UI: Submit Concept Text / Image
    UI->>API: POST /api/generate_from_image_async
    API->>NLP: Extract Semantic Spatial Tokens
    par Semantic Similarity Query
        NLP->>Chroma: Vector Nearest Neighbor Query
        Chroma-->>API: Pre-Indexed Related Assets
    and Neural Mesh Generation
        API->>ML: Pass Normalized Concept Tensor
        ML->>ML: Run 3D TripoSR Reconstruction (2.1s)
        ML-->>Cache: Export Standard GLB Mesh Artifact
    end
    API-->>UI: Return Job Complete & Asset URI
    UI->>UI: Render Interactive 3D Mesh in Three.js Canvas (60 FPS)

---

Generative Benchmarks & Mesh Specifications

---

API Endpoints Summary

Interactive Swagger Documentation: http://127.0.0.1:8011/docs

---

Quickstart

Prerequisites

• Python 3.10+ (Python 3.11/3.12 recommended)
• Node.js 18+ & npm
• Git

---

1. Setup Virtual Environment & Dependencies

# On Windows (PowerShell):
.\scripts\setup_venv.ps1

# On Linux / macOS:
./scripts/setup_venv.sh

---

2. Configure Environment Variables

Copy Backend/.env.example to Backend/.env and configure keys:

GROQ_API_KEY=your_groq_api_key_here
PORT=8011

---

3. Launch Backend & Frontend

In Terminal 1 (Backend on Port 8011):

.venv\Scripts\python.exe -m uvicorn Backend.main:app --host 0.0.0.0 --port 8011 --reload

In Terminal 2 (Frontend on Port 5173):

cd Frontend
npm install
npm run dev

Open http://localhost:5173 in your browser.

---

Security & Compliance

• Sandboxed Mesh Generation: Model synthesis occurs within isolated temp directories with automated garbage collection.
• Zero Secret Leakage: All AI provider API keys are loaded strictly via .env and guarded by .gitignore.
• CORS Protection: REST and WebSocket connections are bounded to authorized studio endpoints.

---

License

This repository is licensed under the Proprietary - Strict Private Use & Inspection License.
See the LICENSE file for terms and restrictions.

Copyright (c) 2026 Mohammad Huzaifa & Contributors. All rights reserved.