i'm trying to swap forks on my ht and when i take the stem and top bolt off the fork still sits in there tight. i use a FSA pig headset and i believe this little piece is what is keeping it tight. i tried prying it off with a flathead and a knife and no luck. don't wanna mess it up but how can i get this thing off? also, some pics at the bottom. thanks and enjoy