Are you sure you are turning the headlights off. They have a parking light position for the left and right side.
I did this on accident when I first test drove my car, so I found right away about the parking light position.