Skip to content

prekabreki/FetchForge

Repository files navigation

FetchForge

Requires an NVIDIA GPU with NVENC. The H.265 transcode uses hardware hevc_nvenc and has no CPU-encode fallback — without an NVIDIA card the transcode path cannot run (download + audio-extract still work). macOS has no NVIDIA GPUs, so the transcode is Windows/Linux only.

FetchForge is a localhost web app that downloads YouTube videos and playlists and transcodes them to H.265/HEVC using NVIDIA NVENC hardware encoding. Single videos, full playlists with pipeline mode, and local-file conversion. Smart auto-analysis picks CQ, maxrate, and preset from the source.

Install & launch

With pip (recommended):

pip install fetchforge
fetchforge

The browser opens automatically at http://localhost:8765. On Windows, if an NVENC-capable ffmpeg isn't already present, FetchForge downloads one on first run. On Linux, install ffmpeg from your package manager first (sudo dnf install ffmpeg / sudo apt install ffmpeg) and make sure the NVIDIA driver is loaded. macOS has no NVIDIA GPU, so the H.265 transcode can't run there, but download and audio-extract still work and just need ffmpeg (brew install ffmpeg).

Output files land in the current directory — run fetchforge from wherever you want downloads/ to appear.

From source (clone):

git clone https://github.com/prekabreki/fetchforge
cd fetchforge
./launch.sh        # Windows: launch.bat

The Update yt-dlp button adapts to how yt-dlp was installed: it runs pip install -U "yt-dlp[default]" when yt-dlp lives in the app's own environment (the normal pip/venv install), self-updates the bundled yt-dlp.exe on Windows, and otherwise points you at your system package manager. FetchForge itself updates with pip install -U fetchforge.

Stack

  • Backendfetchforge/server.py (FastAPI + uvicorn, fully async)
  • Frontendfetchforge/index.html (single file, vanilla JS + SSE, no build step)
  • CLI entry pointfetchforge/cli.py, exposed as the fetchforge console script (also runnable as python -m fetchforge)
  • Downloaderyt-dlp[default], a regular dependency (pulled in by pip, not bundled)
  • Encoder — ffmpeg + hevc_nvenc (NVENC); auto-downloaded to a per-user cache on Windows, expected on PATH on Linux
  • Packagingpyproject.toml; pip install fetchforge for the package, pip install -e . for an editable clone
  • Launcherslaunch.bat (Windows) / launch.sh (Linux/macOS) for the clone workflow: create/reuse a venv, pip install -e ., open the browser, run python -m fetchforge

What's NOT in the repo (gitignored)

These are restored locally — they're either rebuildable, regenerable, or sensitive.

Path Why ignored
_internal/ Optional manual ffmpeg override for a source clone on Windows — pip installs auto-provision ffmpeg into %LOCALAPPDATA%\FetchForge\ffmpeg instead
yt-dlp.exe Optional manual override; the normal path gets yt-dlp as a pip dependency, updated via pip install -U, not a dropped binary
cookies.txt YouTube auth cookies (sensitive — never commit)
history.json Last 50 downloaded URLs (per-machine state)
logs/ Runtime logs
downloads/ Output MP4s

cookies.txt, history.json, logs/, and downloads/ are runtime state and live under the current working directory you launch fetchforge from. _internal/ and yt-dlp.exe are the two exceptions: they're optional manual overrides FetchForge looks for next to the installed package itself, not the cwd — the normal pip install path never needs them.

First-run setup on a new machine

  1. pip install fetchforge.
  2. Run fetchforge. On Windows it downloads an NVENC-capable ffmpeg build automatically the first time it's needed. On Linux, install ffmpeg from your package manager first and confirm the NVIDIA driver is loaded — FetchForge won't fetch a build for you there.
  3. (Optional) Upload a cookies.txt via the Authentication card if you need age-restricted, private, or members-only content — see Cookies below for how to get one.

Working from a clone instead: run ./launch.sh (or launch.bat on Windows) — it sets up a .venv, installs the package in editable mode, and starts the server the same way.

Cookies

Public videos need no cookies. Cookies are only necessary for age-restricted, private, or members-only videos, which require a logged-in YouTube session.

The Authentication card (#01) gives you three ways to load them:

  • Attempt to fetch cookies — one click; FetchForge reads cookies straight from your installed browsers (Brave, Chrome, Chromium, Edge, Vivaldi, Opera, Firefox) and all their profiles, picks the one with the most YouTube cookies, and loads it. If more than one profile has cookies, it lists them so you can switch. Best-effort — a locked keyring or missing browser is reported, not fatal.
  • Load cookies.txt — upload a Netscape-format file exported by a browser extension (Get cookies.txt LOCALLY for Chrome/Edge, cookies.txt for Firefox: log in to YouTube, open the extension on a youtube.com tab, export).
  • Paste cookies — paste the Netscape text directly; it's masked, never displayed, and saved server-side.

A Clear cookies button removes them for a cookie-free run. If YouTube rotates your cookies mid-download (a common failure — see below), FetchForge notices, drops them automatically for the rest of that run, and warns you, so one stale jar doesn't sink a whole playlist.

The cookie file grants access to your YouTube account, so treat it as a secret: it's gitignored and stays on your machine — don't share or commit it.

Cookie rotation: cookies exported (or read) from a running browser can be invalidated by YouTube as a security measure, and stale cookies are worse than none. For durable auth, log in via a fresh private window and close it before loading, and re-fetch if downloads start failing.

Features

  • Sequential or pipelined playlist processing — pipeline mode runs download and encode concurrently with a maxsize=1 queue (downloader stays at most one video ahead of the encoder)
  • Per-video playlist selection — a resolved playlist shows a checklist (all checked by default) with select all / none / invert, so you can grab just the parts you want
  • Robust playlist formats — playlists take the highest-available stream per video (handles mixed 720p/1080p lists), and one video that can't be fetched is skipped so the rest of the playlist still completes
  • Smart pre-download skip — checks for existing <title>_h265.mp4 before downloading, skips if ≥85% of expected size
  • Two encode tunesuhq (Smart Auto, archival quality) and hq (NLE-friendly, ~4–6× speed, capped at source bitrate)
  • HDR / 10-bit passthrough — auto-detected; outputs yuv420p10le + main10
  • Wake-lock during jobs — ref-counted; Windows SetThreadExecutionState re-asserted every 30s, Linux holds a systemd-inhibit process
  • Post-job shutdown — UI countdown with cancel button; shutdown /s /t 0 (Windows) / systemctl poweroff (Linux) if not cancelled
  • Local conversion mode — point at files or folders, batch-encode without downloading

Repository conventions

  • Issue tracking: GitHub Issues. Run python tools/issue-ready.py for available work (open issues, dependencies satisfied), or gh issue list.
  • Personal-use only — no auth, no multi-user, no cloud deploy.
  • Per-user runtime state is gitignored (see table above) and preserved locally, never pushed.

See CLAUDE.md for full architecture: endpoint table, SSE event types, encode parameter logic, and the Python <3.12 f-string gotcha that bit this codebase.

About

Local web app to download YouTube videos and transcode them to H.265/HEVC with NVIDIA NVENC.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages