Ok, I promised myself I'd not buy a house till I retire in 2030. But, renting is just not working for me. Rents here are low, but Im not content and now the owner of this house wants to retire and move back here in June.

Homes are selling here like nuts. If you list your house, within a few days, you will have a bidding war on your hands. The average home is listing for $232,000 and is selling for just over $250,000.
Most homes are on the market less than 48 hours before a contract is in place. If you ask for a home inspection, another buyer will step in and buy with no inspection - it's nuts.

Building is the only way out, in my view, anyway.

I close on my land in April. I'm working on what I want to build. I'm thinking of a concrete slab with large garage and living area above it.
Something like what is pictured below....