Even simpler still:

I like using the .IndexOf() method.

Dim myItem As New ListViewItem("matchstring")

ListView1.Items.RemoveAt(ListView1.Items.IndexOf(myItem))