Move EV server to a different site - site consolidation

2 EV servers, each created in its own site.  Can we consolidate - move 1 of the servers into the other EV site?

(All relevant servers (EV, SQL, Exchange) are in the same physical location)