Linguists draw the line in different places, usually based on mutual intelligibility. There are dozens of American dialects, as well as a handful of British ones, and I (as a speaker of one of the American dialects) have a hard time understanding quite a few English speakers.

There's a political side to "different language" too, because it can generate Casus Belli or affect the diplo cost for culture conversion.