I finally figured out my Vista Ultimate 64-bit networking issues.
Apparently, the netgear app that manages network connections is bad. I disabled it and let Vista manage the network connections.
And now I can remote desktop from afar into my Vista desktop.
With the netgear software running, it was disabling the network connection.
Quite handy when I'm 29 miles away and cannot access the box.
So just as similar stories have cropped out that 20% of Vista issues were because of NVidia drivers, I'd say a big percentages of my issues were because of Netgear.