Edit jail.conf file . It is located (usually) at /etc/fail2ban/
Locate the line wich contains “ignoreip” You can manage ip range too …
Add your ip address/es like this: ignoreip = xx.xx.xx.xx/mm (where xx is the ip and mm the mask). ie: ignoreip = 80.80.80.81/24
There is a lot of documentation about Fail2Ban config.
Restart Fail2Ban service.
Hope it helps.