The process is called a “three-way handshake.” The handshake starts with the source computer sending a TCP packet to the target computer with the SYN flag (a bit in the header) set and a ...

I don't think the TCP handshake would even start?, but again I'm not a networking expert. Shutting down fail2ban does not make a difference, although it only blocks port 22.