InsightfulWeb Overview

Description

InsightfulWeb Overview is a Chrome extension that leverages web scraping and Language Model (LLM) technology to provide users with a comprehensive overview of any website. Gain valuable insights into the content, structure, and key information on the web pages you visit.

Features

• Web Scraping: Extract relevant data from the website, including text, images, and metadata.
• Language Model Integration: Utilize advanced language models to analyze and summarize webpage content.
• Customizable Overview: Tailor the overview to focus on specific elements like keywords, sentiments, or important sections.
• User-Friendly Interface: Access the website overview through an intuitive and seamlessly integrated Chrome extension interface.

Technologies Used

• Web Scraping: BeautifulSoup, Scrapy, or your preferred web scraping tool.
• Language Model: Utilize OpenAI's GPT-3 or other LLM libraries.
• Frontend: HTML, CSS, TypeScript, ReactJS and Chrome Extension APIs.
• Backend: Node.js, Express, and MongoDB.

Installation

1. Clone the repository:

   git clone https://github.com/Rufidatul726/spl3
   

2. Change into the project directory:

   cd your-project
   

3. Install dependencies for the frontend:

   cd frontend
   npm install
   

4. Install dependencies for the backend:

   cd ../backend
   npm install
   

Usage

1. Start the backend server:

   cd backend
   npm start
   

2. Start the frontend development server:

    cd ../frontend
    npm run build
   

3. Open your browser and navigate to chrome://extensions/ to load the extension.

4. Enable developer mode and click on "Load unpacked" to select the frontend/dist directory.

5. Navigate to a website and click on the InsightfulWeb Overview extension icon to receive a detailed overview of the website.

6. Receive a detailed overview of the website, including key information extracted through web scraping and language model analysis.

Contributing

Contributions to enhance or expand the functionality of InsightfulWeb Overview are welcome! Follow the guidelines in the Contribution Guide to get started.

License

This project is licensed under the MIT License. Feel free to use, modify, and share the extension.