(I'd never driven there, only bused, but it was in an area I remember driving around in, 8 years ago, when I first moved to the area and still had a car. I found it by recognizing the rough location, then by the roads and intersections. Not in street view, just aerial.
It's a fun game for me, one I've been practicing even before Google Maps was a thing. (Remember MS Terraserver, anyone?)
I can find any house I've ever lived in, from air/space. If anything, guess that means I'm a good flyer!