Trying to Pick a House May Just Kill Us

Argh. One day of house hunting and I'm already frustrated. This is not a good sign.
We got a better deal on the previously mentioned loan and went with another company. Same interest rate but a much better deal in the long run. So, now that we're approved and have the letter and all that, it's time to house shop. Easy right? Not on your life.
We looked at 6 houses last night. There were 3 more on the list but they were immediately dismissed due to the proximity of a major street to the backyard. (How we missed this detail while driving to them previously I have no idea.)
One house was an immediate bust. Too much work needed to be done. One was just meh. I thought it would be better but eh. The next house we went to- I LOVED. And I mean LOVED. Gorgeous architecture, sun room, sunken living room, utility room, master bedroom on one side and guest rooms on the other, great location near a creek, and a hot tub! The kitchen was a little cramped but totally workable and the closet space could be bigger but that is also doable. We can knock out the wall from the living room to the sun room for more space. I really like the place. The boy: eh, too small. It's 1500 sq feet! They want to sell too! But I'm going to press on this one.
The next house was just ok, nothing special. A little small. The house after that was on a cul-de-sac. Loved that part. The outside was nice, excellent ceramic tile on the walkway. Inside was really neat, with a loft area and a deck off of that. Master bedroom was downstairs with French doors to the back. And the kitchen- oh. My idea of a perfect kitchen. The only problem was the yard. It just was tiny. It's on the corner of a cul-de-sac so it got cut off. It's just too small for our needs. I wish the yard had been bigger because other than that, the house was great. But the yard is a deal breaker.
The last house we saw was great. It didn't give me the I love it feel, but it was a nice house. The kitchen was big and newly remodeled, in fact the entire house was re-done. It's an investment house. The yard is HUGE and just needs a new fence. Rooms are big and there's plenty of storage. It's a definite possibility but I didn't love it like I loved the other one. But this one has more boy approval. But we'll see about that.
We're making a list for this weekend. More houses to see. We're expanding our area bit.
But this is going to be tough. Finding a house we BOTH agree on, is not going to be easy.