One good way to avoid intruders to go inside a Linux server thru brute force attack, is to disable any possible login using passwords. If you do this, then, how are going to be able to log into that server? Well, using ssh public key authentication.
Check this how-to to learn how to do it. ssh with no password
