You are describing a bad battery or really bad battery cable connections.

For example, you should be able to turn key ON, turn headlights on, and turn key to START and have your headlights and warning indicator lights still stay on (at reduced intensity but they should stay on).