VM Proxy server on Hyper-V performance slow.

I've a physical server ML350Gen8 with broadcom NIC as a window 2012-r2 hyper-v server. The Hyper-v have 2 VM (AD and Proxy). 

The AD VM is installed with win2012 and the proxy VM(win2003) is a VM converted from vmware server. 

First the ping value was high when perform ping to the VM. After disabled the physical and VM's VMQ the ping value low. 

But I encounter after the proxy server converted to hyper-v VM, the client machine that connected to proxy server internet browsing is awfully slow.

It does not have performance issue when its on Vmware server. I setup a new VM as proxy server installed with linux but the performance for the client to browse internet is still slow.

Any Hyper-v setting that could improve the performance?