I see now that what I used is not recommended for foam backed material.
It was recommended in some posts on this forum though.
Knowing what I know now I would not recommend the 3M Super 77.
3M makes the stuff that should be used.
3M Headliner and Fabric Adhesive
Edit
I used Permatex Heavy Duty Spray Adhesive when it came down to doing the job as it was easier to find. It is recommended for headliners on the cans label, we will see how it does over time. Once in place you can hardly move the material so you basically have just one go at material placement.