Soo I am just confirming this please?

Would RSA encryption on my server and client make it so only MY client with my RSA keys perfectly matching be able to connect?
Or am I not understanding what RSA does?