You haven't even touched on the problems with regard to theft. My 94-year-old stepmother is in a senior facility, living in a studio apartment. One morning she got up, went to the drawer where she had put her wedding ring (from my late father) and found that it was not there.
We encouraged the staff to look on the hallway video camera footage for any proof of another person entering her room while she slept. They said they saw nothing.
I have heard too many terrible stories. I hope to be able to age in place, not leaving my own home.