Cap off the vacuum line to the power brake booster at the manifold.
CAREFULLY see if this resolves the problem - YOU WILL HAVE VERY LITTLE BRAKES !!!
If it does, you probably have a defective power booster.