Hi CJ,
RFC destination is taking you out to the external system. The external server must know that a connection request is coming from your SAP system and program. Please review your configuration, both RFC destination and external server. Your RFC destination should know correctly about your external system and vice-versa.
Hope that helps.
Sincerely,
Amrit