How we configure Point to Site VPn for two different Virtual Networks (Vnet1 and Vnet2)

HI

Can you please help me out here this below scenario

Scenario :

I have created two Point to site VPN’s and appended Vnet1 and Vnet 2 to VPN-1 ,Vnet2  & Vnet3 to VPN2.  (note : Vnet1 and Vnet2 are Site to Site connected ).

 Now I am facing a challenge if anyone connected through VPN-1 should SSH the VM’s (which are located under Vnet1 and Vnet2 Virtual Networks)  but here we cannot SSH the VM which is located under Vnet2 , only we can SSH to Vm’s under Vnet1 only .

 We can able to SSH the VM under Vnet2  from Vnet1 VM ,  Since Vnet1-Vnet2 are Connected . The same problem we seeing in VPN-2  as well .    

If this is the case then we need three Point to site VPN’s Instead of Two Vpn’s right  ? , Please suggest me what is the best solution here or correct me if I did any mistake in configurations.

Thanks

Santosh