How to change OAuth2 client id_token signature algorithm?

I’m create an OAuth2 client, it work fine if used HS256 as id_token algorithm. However, when I use with OAuth2 Proxy is show that it cannot support id_token signature algorithm. After spend time to search, I want to try to change id_token signature algorithm to another one. But I don’t see any ‘how to’ or even base code to change this. Please help.

I found this line of code return constructed token, but does’t know to change them. frappe/frappe/integrations/oauth2.py at f7fb0d7b35511e6207015418b74c6e813bb91552 · frappe/frappe · GitHub

If you get https://YOURSERVER/api/method/frappe.integrations.oauth2.openid_configuration
It will response id_token_signing_alg_values_supported HS256 statically.