slow scp/iperf3 between ubintu-18.04 nodes

[mannyeve]

Very simple set up. Server1 ---> L2 switch ---> server2. file transfer and iperf3 show the transfer is consistently less than 150KB/s. eve-ng is running on esxi on a dell poweredge 650. VM has 8 vcpu and 100G RAM,1G port. I am using the image thats here in the image section. Any ideas what I can try to speed this up?

[Uldis (UD)]

might be your L2 switch is vIOS??

then makes sense, throughput of vIOS is very poor.
better is IOL L2

vIOS performance vs IOL is

vIOS 1.5 Mbps vs IOL 100Mbps

first pic is IOL
second vIOS