Ports other then 443 are not really supported. You are asking for trouble.
Actually 443 is the Apache Web Server.
But you'd have to update all the metadata too, like the config data in https://hostname/.well-known/openid-configuration
And also the SAML metadata.
And you still might face bugs....
Recommendation: use a virtual ethernet interface and a different IP address on your server rather than trying to update the port to a different port.