Only if the oil has penetrated the belt. If the oil has penetrated the belt, the centrifugal force of the belt spinning could cause oil to get on the pulleys again causing the belt to slip off. But if the oil has not penetrated the belt, you should be fine.