Skip to content

Tim-M-83/Scraperstack_Web_Scraping_App

Repository files navigation

🚀 Scraperstack Web Scraping App

macOS Installation Guide

Option 1: Using the DMG Installer

  1. Download the .dmg file from GitHub Releases
  2. Double-click to mount the disk image
  3. Drag Scraperstack.app to your Applications folder
  4. When opening for the first time:
    • Right-click the app and select "Open"
    • Or go to System Settings > Privacy & Security > Click "Open Anyway"

Option 2: Manual Quarantine Removal (if Option 1 fails)

  1. Open Terminal
  2. Run this command (replace with your username):
xattr -cr /Applications/Scraperstack.app
  1. Try opening the app again

Option 3: Completely Disable Gatekeeper (not recommended)

sudo spctl --master-disable

Windows Installation Guide

  1. Download the .exe installer from GitHub Releases
  2. Run the installer
  3. If Windows Defender shows a warning:
    • Click "More info"
    • Then click "Run anyway"

Original Description:

A powerful Electron.js application that leverages OpenAI's GPT models to analyze competitor websites and provide actionable SEO insights.

📖 Overview

The AI Website Competition Analyzer helps digital marketers and SEO professionals:

  • Scrape and analyze competitor website content
  • Generate AI-powered optimization suggestions
  • Create ready-to-use SEO assets
  • Compare website performance metrics
  • Export findings for easy implementation

Built with Electron.js for cross-platform compatibility and OpenAI's API for advanced AI analysis.

✨ Key Features

🔍 Website Analysis

  • HTML Structure Analysis - Breakdown of page architecture
  • Content Evaluation - Quality assessment of text content
  • SEO Scoring - 0-100 rating with improvement areas

🤖 AI-Powered Tools

  • Metadata Generator - Title tags & meta descriptions
  • Social Media Captions - Platform-optimized posts
  • FAQ Schema Creator - JSON-LD ready for implementation
  • Multilingual Support - Generate content in multiple languages

⚡ Productivity Features

  • One-click Copy - Copy any result to clipboard
  • File Export - Save analysis as TXT or JSON
  • GPT Model Toggle - Switch between GPT-3.5 and GPT-4
  • API Key Management - Securely store credentials

🖼️ Screenshots

Dashboard Main dashboard with scraping controls

Analysis Results AI-generated website analysis results

Settings API key management and preferences

🛠️ Installation

  1. Prerequisites:

    • Node.js v16+
    • npm/yarn
    • OpenAI API key
  2. Install dependencies:

npm install
  1. Run development server:
npm start

📂 File Structure

.
├── assets/               # Application assets
├── src/
│   ├── main.js           # Main process
│   ├── preload.js        # Preload scripts
│   ├── renderer.js       # Renderer process
│   ├── index.html        # Main window
│   └── style.css         # Application styles
├── package.json          # Project configuration
└── README.md             # This file

🧑‍💻 How to Use

  1. Enter Website URL:

    • Paste the competitor URL in the input field
    • Select scraping options (JS rendering, proxies etc.)
  2. Analyze Results:

    • View raw HTML content
    • Click any AI tool button to generate insights
  3. Export Findings:

    • Use copy buttons for quick sharing
    • Save complete analysis as files

⚙️ Settings Configuration

Access settings via the navigation menu to:

🏗️ Building for Production

macOS

npm run build:mac

Windows

npm run build:win

Built executables will be in the dist/ folder.

🛠️ Technology Stack

  • Frontend: Electron.js, HTML5, CSS3
  • AI Services: OpenAI API (GPT-3.5, GPT-4)
  • Scraping: Scrapestack API
  • Build Tools: Electron Builder, npm scripts

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

📬 Contact

For support or feature requests:


💡 Tip: For best results, use GPT-4 when available as it provides more detailed analysis.

About

Real-time, Scalable Proxy & Web Scraping REST API

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors