Hey MacD - Yes, this should work by passing the WebSocket URL as ws_url in the Visualizer page URL, e.g.:
http://<public-host>:<http-port>/?ws_url=ws://<public-host>:<websocket-port>
For the default dai.RemoteConnection, the WebSocket port is 8765 and the HTTP UI port is 8082, unless overridden with webSocketPort / httpPort. If you are proxying over HTTPS, use wss://... instead of ws://....
Docs: OAK Visualizer and the custom frontend example documents the same ws_url pattern: oak-examples custom frontend.
Best,
Oskar