My grandmother (in South Australia) didn't agree when they instituted house numbers (in the 1960s I believe) and continued to gave out her house name, never the number. I still have no idea what her house number was.
I'm not sure how she voted (it's compulsory in AUS) but apart that (possible) problem it seemed to cause no inconvenience.
I grew up on a few Aussie properties, and some of them had no numbered address. Road Mail Box numbers seem to be pretty common now, but back then it was more like "Bindabundee Homestead, Bindabundee Road, NSW".
For one place I don't even know the road name, because nobody used it officially. It was just "the Snake Track", and everyone on that road had their mail addressed to the post office, which was really a general store with a few PO boxes, and we trusted each other not to take mail with someone else's name on it.
I'm not sure how she voted (it's compulsory in AUS) but apart that (possible) problem it seemed to cause no inconvenience.