Hi,
You thoughts are good but unfortunately VDP is not capable of backing/restoring VMs from another site. Currently VDP boundaries are within vCenter. However you can use vSphere Replication for CPD (Continuous Data Protection) in case if your site1 is down, you can have recovery from replicated VMs in site2. You can still have point in time restore points at site1 using VDP.