How far do you have to drill out the pin? I have drilled it out past the enclosing black sleeve so the assembly freely turns and moves laterally and the key still does not turn. Do I have to go in further?

Thanks.