I think this would be a much better solution for you guys....or something like this. This is the LET idler pulley from my 181mm crank pulley kit. Using this and a spacer to position it should be about right...
Better than turning down the grooved pulley...