The github page still says it requires Windows 11: https://github.com/microsoft/wslg
Though I suppose it's possible they've also pushed it to the insider builds for Windows 10.
Within the "Target:" setting, for a shortcut, just "wslg.exe /some/program -args". No wrappers, no setting DISPLAY, no calling /bin/sh -c "whatever", etc.