Mihawk 90aaa75abe WebUI: a parallel transfer engine (batches, upload sessions, ranges, six lanes) ...

Measured first: one libmicrohttpd thread with 64 KiB a connection held uploads to
13 MB/s, and four connections to 15.3, on a link where FTP reached 25 / 30.5 MB/s.
PS5-Suite's design was reviewed (persistent connection pool, small files per
connection, large files as pwrite ranges, big socket buffers) and an engine built
from scratch on the WebUI's HTTP (src/webui_transfer.{h,cpp}, docs/WEBUI.md):

- a pool of four server threads, 512 KiB a connection, 4 MiB socket buffers, writes
  in 1 MiB blocks; non-transfer routes under one lock as on the single thread;
- PUT /api/upload/batch: many small files in one request (a framed stream), each
  renamed into place when whole, existing names skipped and named unless replace;
- upload sessions (/api/upload/session, /part, /commit): a large file's ranges in
  any order on any number of connections, committed once covered;
- Range downloads (206); every upload still atomic, never over an existing name;
- the page plans batches, sessions and single uploads onto six lanes.

Evidence: evidence/webui-transfer-engine (base PS5 13.40, PC on Wi-Fi 6). Uploads
26.0 MB/s on one connection and 29.9 MB/s for one file in six parts (FTP: 25 /
30.5); 400 x 32 KiB at 215 files/s (FTP 105). The page against the console: 605
files in 20.1 s, all equal by FTP readback, duplicates refused, a cancelled 200 MiB
file left nothing. ThreadSanitizer under a mixed parallel load: no report.
Command: build/tmp/transfer/bench.py; node tests/webui_transfer_browser.cjs;
tools/verify.sh: all five PASS.

2026-10-07 08:23:21 -04:00

..

analyze-gpu-profile.py

Keep development logs while buffering GPU timing off the frame loop

2026-09-19 11:30:05 -04:00

apply-port-patches.py

Remaps: saved to and loaded from config/remaps, per game and per core

2026-10-07 07:41:51 -04:00

apply-runtime-probes.py

video_vulkan: frames run - 644 frames and 643 menu draws in one unattended run

2026-09-19 02:41:52 -04:00

build-a5200.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-azahar.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-beetle-ngp.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-beetle-pce.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-beetle-pcfx.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-beetle-psx.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-beetle-saturn.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-beetle-vb.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-beetle-wswan.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-curl.sh

Run EmulationStation (ES-DE 3.5.0) on the PS5 beside RetroArch

2026-10-04 16:31:50 -04:00

build-desmume.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-dolphin.sh

A core's dev build withdraws its stamp

2026-09-25 09:24:54 -04:00

build-dosbox-pure.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-esde.sh

Run EmulationStation (ES-DE 3.5.0) on the PS5 beside RetroArch

2026-10-04 16:31:50 -04:00

build-fbneo.sh

Rebuild in seconds: stamp the cores, cache compiles, write only changes

2026-09-23 19:36:17 -04:00

build-fceumm.sh

Rebuild in seconds: stamp the cores, cache compiles, write only changes

2026-09-23 19:36:17 -04:00

build-ffmpeg-esde.sh

ES-DE's videos play: FFmpeg with asetnsamples (issue 27)

2026-10-06 23:40:55 -04:00

build-ffmpeg.sh

RPCS3: the core builds, loads, installs the firmware and runs a PS3 program

2026-09-28 21:30:19 -04:00

build-flycast.sh

Flycast: Dreamcast, NAOMI, NAOMI 2 and Atomiswave, the sixteenth core

2026-10-06 21:16:01 -04:00

build-freetype.sh

Cross-build EmulationStation's libraries for the PS5

2026-10-04 15:17:20 -04:00

build-frontend.sh

WebUI: its own daemon, up across every frontend; downloads read in blocks

2026-10-07 07:41:51 -04:00

build-genesis-plus-gx.sh

Rebuild in seconds: stamp the cores, cache compiles, write only changes

2026-09-23 19:36:17 -04:00

build-handy.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-harfbuzz.sh

Cross-build EmulationStation's libraries for the PS5

2026-10-04 15:17:20 -04:00

build-icu.sh

Cross-build EmulationStation's libraries for the PS5

2026-10-04 15:17:20 -04:00

build-libiconv.sh

RPCS3: the core builds, loads, installs the firmware and runs a PS3 program

2026-09-28 21:30:19 -04:00

build-libwebp.sh

Run EmulationStation (ES-DE 3.5.0) on the PS5 beside RetroArch

2026-10-04 16:31:50 -04:00

build-lrps2.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-mame.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-mesa-util.sh

Link the Vulkan driver into the title, and resolve the 24 symbols that stopped it

2026-09-18 22:50:12 -04:00

build-mgba.sh

Rebuild in seconds: stamp the cores, cache compiles, write only changes

2026-09-23 19:36:17 -04:00

build-mupen64plus.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-neocd.sh

Four cores: 3DO, Commodore Amiga, Neo Geo CD and ScummVM

2026-10-06 23:09:36 -04:00

build-opera.sh

Four cores: 3DO, Commodore Amiga, Neo Geo CD and ScummVM

2026-10-06 23:09:36 -04:00

build-picker.sh

WebUI: its own daemon, up across every frontend; downloads read in blocks

2026-10-07 07:41:51 -04:00

build-picodrive.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-pokemini.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-ppsspp.sh

A core's dev build withdraws its stamp

2026-09-25 09:24:54 -04:00

build-prosystem.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-puae.sh

Four cores: 3DO, Commodore Amiga, Neo Geo CD and ScummVM

2026-10-06 23:09:36 -04:00

build-pugixml.sh

Cross-build EmulationStation's libraries for the PS5

2026-10-04 15:17:20 -04:00

build-retroarch.sh

Fix XMB large-list allocation failures and preserve normal logging

2026-09-19 20:25:47 -04:00

build-scummvm.sh

Four cores: 3DO, Commodore Amiga, Neo Geo CD and ScummVM

2026-10-06 23:09:36 -04:00

build-snes9x.sh

Rebuild in seconds: stamp the cores, cache compiles, write only changes

2026-09-23 19:36:17 -04:00

build-stella.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-title.sh

WebUI: its own daemon, up across every frontend; downloads read in blocks

2026-10-07 07:41:51 -04:00

build-vice.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

build-virtualjaguar.sh

Thirteen cores: 32X, PC Engine, PC-FX, Virtual Boy, Neo Geo Pocket, WonderSwan, Pokemon Mini, Lynx, Jaguar, 2600, 5200, 7800, MS-DOS

2026-10-06 22:11:05 -04:00

build-webui-daemon.sh

WebUI: a parallel transfer engine (batches, upload sessions, ranges, six lanes)

2026-10-07 08:23:21 -04:00

build-webui-http.sh

Add native RetroArch WebUI on port 6769

2026-10-02 11:07:52 -04:00

build-webui-update.sh

Add verified console updates and BIOS alerts to the WebUI

2026-10-02 19:06:46 -04:00

build.sh

Manual Scan: choosing Content Directory again no longer crashes

2026-10-04 19:36:09 -04:00

check-core.py

RPCS3: the core builds, loads, installs the firmware and runs a PS3 program

2026-09-28 21:30:19 -04:00

check-ftp-write.py

Fix FTP access to RetroArch managed directories

2026-09-19 13:22:39 -04:00

check-headers.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

check-manifest.sh

Add reproducible PS5 FCEUmm build and record native loader blocker

2026-09-19 14:05:29 -04:00

check-memory-diagnostics.py

Capture allocation owners and XMB context on first failure

2026-09-19 19:19:32 -04:00

check-notices.py

Releases carry the frontends, with their notices and sources

2026-10-04 23:20:37 -04:00

console-run.sh

Run this project's own title on the console

2026-09-18 13:56:02 -04:00

core-fork.sh

Seven more cores: PS1, N64, Saturn, C64, MAME, DS and 3DS

2026-09-28 15:06:47 -04:00

core-imports.py

RPCS3: realpath from the platform layer; SDK 8160289

2026-09-28 21:51:54 -04:00

core-stamp.sh

Build with my payload SDK fork, and adopt its platform layer

2026-09-26 01:02:30 -04:00

deploy-title.py

Run an SDL2/OpenGL frontend executable beside eboot.bin

2026-10-04 15:05:48 -04:00

doctor.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

doctor.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

esde-profile.py

Measure EmulationStation's frame times, and bring browsing to 60 fps

2026-10-04 17:09:50 -04:00

esde-settings.py

Run EmulationStation (ES-DE 3.5.0) on the PS5 beside RetroArch

2026-10-04 16:31:50 -04:00

evidence.py

Link the title and register the PS5 video driver

2026-09-18 14:37:57 -04:00

fetch-retroarch.sh

Link the title and register the PS5 video driver

2026-09-18 14:37:57 -04:00

generate-core-metadata.py

Add guided WebUI settings for every included core except RPCS3

2026-10-02 13:06:01 -04:00

host-nasm.sh

RPCS3: the core builds, loads, installs the firmware and runs a PS3 program

2026-09-28 21:30:19 -04:00

init-project.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

inspect.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

lint-format.sh

WebUI: its own daemon, up across every frontend; downloads read in blocks

2026-10-07 07:41:51 -04:00

lint-shell.sh

Link the title and register the PS5 video driver

2026-09-18 14:37:57 -04:00

lint.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

make-title-art.py

Launcher background: the starry sky over a magenta grid again, drawn by tools/make-title-art.py

2026-10-01 09:26:26 -04:00

prepare-assets.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

prepare-assets.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

probe-xmb-allocations.py

Capture allocation owners and XMB context on first failure

2026-09-19 19:19:32 -04:00

ps5_ftp.py

Ship offline video effects and fix overlay and temporal shader rendering

2026-10-02 15:58:41 -04:00

rebuild-libc.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

rebuild-libc.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

retroarch-flags.sh

Ship offline video effects and fix overlay and temporal shader rendering

2026-10-02 15:58:41 -04:00

retroarch-sources.sh

Ship offline video effects and fix overlay and temporal shader rendering

2026-10-02 15:58:41 -04:00

run_clang_format.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

run_clang_tidy.sh

Build with my payload SDK fork, and adopt its platform layer

2026-09-26 01:02:30 -04:00

run-title.sh

run-title: --game=CORE:PATH starts RetroArch in a core with its content

2026-10-06 21:16:01 -04:00

setup-ffpkg-tooling.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

setup-mkpfs-tooling.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

setup-native-dependencies.ps1

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

setup-native-dependencies.sh

Pins: the new ids of my rewritten commits

2026-10-05 14:00:05 -04:00

setup-pacbrew-dependencies.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

setup-packaging-dependencies.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

setup-test-dependencies.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

source-bundle.py

Source archives: SHA256SUMS lists every archive, ICU's .tgz and .zip too

2026-10-05 00:16:33 -04:00

stage-notices.py

Releases carry the frontends, with their notices and sources

2026-10-04 23:20:37 -04:00

symbolize-crash.py

Make the frontend honour the driver's own limits, and symbolise console crashes

2026-09-18 23:33:17 -04:00

validate-assets.sh

Scaffold the native pipeline for RetroArch, with the display layer

2026-09-18 13:50:22 -04:00

verify.sh

Licences, notices and source for every build; what each release was built from

2026-09-29 10:28:46 -04:00

video-assets.py

Ship offline video effects and fix overlay and temporal shader rendering

2026-10-02 15:58:41 -04:00