virtual server user lockout also blocks my whitelisted webmin admin user ip address

Hi guys, another issue...

if i am attempting to login using a virtual server user on my administrative office ip address, and stuff it up enough times to get locked out...i cannot access webmin root because the office ip address is now banned as a result of the lower access level virtual server user getting locked out.

i do not have failban server running so i think its firewalld doing this.

EDIT....

I have setup fail2ban to run at server startup and added my offce ipaddress to /fail2ban/jail.conf line "ignoreip="

hopefully this will sort my problem.