When the server owner stops a stream, Plex cuts the connection and repeats the termination in every timeline reply to the client until it reports a stop. The player now reads those replies (also when playback stalls or fails), stops mpv, shows the owner's message and acknowledges it; a termination on a session's first reply is left over from an earlier stream and is cleared instead of cancelling the new one. Each title also starts unpaused, as mpv keeps pause across files. The dashboard's bandwidth graph refreshes every second. Plex's real-time samples are bytes per second with idle seconds omitted, so they are laid on a gap-free per-second axis (they were divided by six before). Upscaling: Balanced is now the strongest shader chain, light nlmeans, FSRCNNX 16, KrigBilateral and debanding. Measured against 1080p references shrunk to 480p it beat FSRCNNX 8, two network passes, RAVU and SSimSuperRes. The denoiser is AN3223's light profile with luma strength at 60%, which keeps texture the default profile smoothed away. Quality is now NVIDIA RTX Video Super Resolution through mpv's d3d11vpp filter, sized to the window and re-applied when it changes; it is offered only on Windows with an NVIDIA RTX GPU (app_info now lists the adapters), runs Balanced for HDR or at native size, and drops a tier if the driver refuses. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
5.9 KiB
Architecture
Kaleido Desktop is a Tauri 2 application: a Rust core hosts the system web view (WebView2 on Windows, WKWebView on macOS, WebKitGTK on Linux), which runs the React/TypeScript interface. Video is decoded and rendered by libmpv and composed beneath the transparent web view, so the player's controls are ordinary interface elements drawn over the video — the same arrangement Plex HTPC and Jellyfin Media Player use.
src/ Shared interface (all platforms)
app/ Session, router, settings, queries, actions, shell, updater
plex/ Plex client: account (plex.tv), library API, admin, playback, parsing
player/ Playback controller (store.ts), mpv bridge, player overlay
downloads/ Download catalog and actions
screens/ Home, Movies/TV (Discover/Library/Categories), title pages,
search, people, downloads, settings, dialogs
ui/ Design system: primitives, menus/dialogs/toasts, cards, hero
styles/ Tokens and styles (base, ui, app, screens, player)
platform/native.ts The only module that talks to the host (Tauri or browser)
src-tauri/ Shared Rust core
src/mpv.rs Dynamically loaded libmpv binding (node ↔ JSON)
src/player.rs One long-lived mpv instance, event stream to the interface
src/downloads.rs Resumable downloads with a JSON catalog
src/system.rs Credentials (OS keychain), paths, disk space, file saving
src/platform/ Everything OS-specific (see below)
tauri.conf.json Shared configuration (+ tauri.<os>.conf.json overrides)
vendor/mpv/<os>/ libmpv per platform (fetched by scripts, ignored by git)
scripts/ build, libmpv fetch, update-feed generation
updates/latest.json Signed update feed for every platform
Platform boundary
src-tauri/src/platform/mod.rs selects one of windows.rs, macos.rs or linux.rs.
Each exposes the same items:
| Item | Windows implementation |
|---|---|
VideoSurface |
mpv renders with d3d11-output-mode=composition; its swapchain (display-swapchain) is set as the content of a DirectComposition visual targeted at the window with topmost = false, i.e. behind the web view's child windows. For the miniplayer the visual is offset and mpv's composition size shrunk to a corner rectangle (player_rect). |
MPV_LIBRARIES |
libmpv-2.dll |
hold_awake |
SetThreadExecutionState while video plays |
macOS and Linux currently provide stubs for VideoSurface (browsing, downloads,
settings and updates work; playback reports that it is unavailable). To add playback
there, render through mpv's render API into a layer beneath the web view and implement
the same methods (set_rect places the video in part of the window for the miniplayer). Per-OS bundling (libmpv, targets, dependencies) lives in
tauri.macos.conf.json and tauri.linux.conf.json. Credentials use the platform's
keychain through the keyring crate with per-OS features in Cargo.toml.
On Windows the main window is created transparent and the page background turns
transparent only while video is visible (html.video-active), so browsing is opaque.
Interface
- State: zustand stores for the session (
app/session.ts), navigation history (app/router.ts, with scroll and per-screen state restored on Back), preferences (app/settings.ts, persisted) and the player (player/store.ts). Server data goes through TanStack Query; every key starts with the server's machine identifier. - Plex HTTP goes through the host's native HTTP client (
@tauri-apps/plugin-http), avoiding CORS and local-network restrictions. Artwork uses Plex's photo transcoder, sized for the display's pixel ratio (PNG for transparent clear logos). - Library sync: the section list is polled every 20 seconds; a change refreshes browsing caches.
- Playback (
player/store.ts): Original quality plays the part URL directly (multi part titles are joined with an mpv EDL); other qualities request Plex HLS with timestamps kept absolute. If direct play fails, playback retries through Plex once. Plex streams are matched to mpv tracks by stream index; external subtitles are added on demand. Timeline reports every 10 seconds (and when playback stalls) make the session appear in Plex; a reply carrying a termination (the server owner stopped the stream) stops playback and shows their message. The title is marked watched at the configured percentage. The player's back arrow (or Esc) shrinks playback into a miniplayer: the video is drawn in a corner rectangle and the interface stays visible around it, with a matching hole masked out of the page (html.player-mini). - Upscaling (
player/enhance.ts): Performance and Balanced set mpv's scalers and debanding and load shaders bundled fromsrc-tauri/shaders/(FSRCNNX 16, nlmeans, KrigBilateral, AMD CAS); each shader'sWHENcondition decides whether it runs for the current video and size. Quality is NVIDIA RTX Video Super Resolution through mpv'sd3d11vppfilter (scaling-mode=nvidia, labelled@kaleido-vsr), sized to the window and re-applied when that changes; it is offered only on Windows with an NVIDIA RTX GPU (app_infolists the adapters), runs Balanced for HDR or at native size, and the driver's own setting picks its quality level. The chosen tier and the running one are tracked separately: shader or RTX Video errors in mpv's log, missing network passes invo-passes, or RTX Video output that isn't enlarged drop to the tier below. Compiled shaders are cached in the app cache folder (gpu-shader-cache-dir), so a slow first Direct3D compile happens once per shader set, mpv version and GPU driver. - Updates:
app/updater.tschecks the signed feed on start; installs need the user's confirmation and then relaunch.