One English guy from my work speaks Japanese. He learned it when he had a jap GF around 20 years ago. He's the only one english person that I've met who can speak another language.
It's that forced environment that tends to be the exception. My workmate knew German for a time as his girlfriend was and they didn't speak a word of each other's language. When I was in sixth form my Spanish (Galician) was better than now as my girlfriend was from A Coruña (plus Italian similarities).
Ultimately you only properly learn when being forced to speak during immersion, whether that is in the country itself, with native speakers, or by creating that environment around you.