Perhaps, but he was still a skilled tailor. I've also met much younger people with native proficiency in no language. Not many, perhaps only 3 total in my life but they exist.
It would be interesting to know what happens to native language skills if they returned to a native environment though. I expect they'd recover fairly quickly, at least in younger people.