I made a rookie mistake and installed the curl from the snap store and that is not compatible with SDKMan. I would get errors about curl failing:
curl: Failed to open /home/user/.sdkman/tmp/spark-3.4.0.headers.tmp
The solution was to remove the snap curl and get the apt one installed:
sudo snap remove curl
sudo apt install curl
Easy enough and I can now install all my java tools.