Hi there,
I have a connection as follows, and I want to start using remote desktop to connect into my windows laptop via my ubuntu laptop. I downloaded UltraVNC for the laptop and can connect to my laptop successfully but it is slow, far slower than I would expect for a remote desktop connection via a switch.

Code:
[Router]
    |
    | 100Mb/s (Wired)
    |
[Switch]
 |    |
 |    | 100Mb/s (Wired)
 |    |
[PC] [Laptop]
If I ping the laptop from my PC I get a range of results from highs to lows, why am I not always getting a fast 1-2ms:

PING 192.168.0.11 (192.168.0.11) 56(84) bytes of data.
64 bytes from 192.168.0.11: icmp_seq=1 ttl=128 time=352 ms
64 bytes from 192.168.0.11: icmp_seq=2 ttl=128 time=179 ms
64 bytes from 192.168.0.11: icmp_seq=3 ttl=128 time=19.8 ms
64 bytes from 192.168.0.11: icmp_seq=4 ttl=128 time=643 ms
64 bytes from 192.168.0.11: icmp_seq=5 ttl=128 time=1.02 ms
64 bytes from 192.168.0.11: icmp_seq=6 ttl=128 time=1.13 ms
64 bytes from 192.168.0.11: icmp_seq=7 ttl=128 time=781 ms
64 bytes from 192.168.0.11: icmp_seq=8 ttl=128 time=1.71 ms
64 bytes from 192.168.0.11: icmp_seq=9 ttl=128 time=205 ms
64 bytes from 192.168.0.11: icmp_seq=10 ttl=128 time=68.6 ms
64 bytes from 192.168.0.11: icmp_seq=11 ttl=128 time=50.6 ms

I could understand if it was slow because it was going through the router, since that handles traffic from the rest of my family as well, however the switch joins my 2 pc's up, and being unmanaged shouldn't it get a routing table from the router and by pass the router from my pc to my laptop?

I an doing this because I want to share my mouse, keyboard, monitor and so on and I don't want to have to keep plugging my laptop into a KVM all the time, i'd rather just plug in an ethernet cable and keep it closed on my desk out the way.

It's a netgear FS605v3 100Mb/s switch I am using.
Do I need to upgrade to a 1Gb/s switch?

Any suggestions?
Cheers,
Matt