What is the actual tangible risk with address poisoning?

I understand people can create addresses to mimic the one that I have and the main issue with address poisoning is individuals not checking their addresses before sending coins/tokens. What confuses me is, what is the actual problem with address poisoning? What is the actual harm?

Besides people not checking the address before sending, is there a actual reason why address poisoning causes actual harm? Everywhere I read about address poisoning, treats it as a boogie man; when all it is, is people not checking before sending.