Join existing Node to Main Cluster

When I try to join Node with VMs inside to Main Cluster then error occurs "this host already contains virtual machines - please remove the first".
Node has different VM ID with Main Cluster.

If I just move all qemu/ovz configs (so no VM listed on Proxmox UI) then is it save to join this node to Main Cluster? Both Nodes use local storage.