Power Automate losing authentication after set time

Hi there, I've created a custom connector for Power Automate. It works fantastically until the authorization expires then consistently 401 fails until I refresh the token manually.

In terms of the custom connector I assume it uses the Server Flow with the refresh URL and have input all the URLs based on this.

Any clues on keeping authentication would be greatly appreciated.