The CASM perceptual hash scanning is not the only new thing, there's also on-device machine learning algo used by Messages app attempting to identify "sexually explicit photos" as well:
"The Messages app will add new tools to warn children and their parents when receiving or sending sexually explicit photos.
When receiving this type of content, the photo will be blurred and the child will be warned, presented with helpful resources, and reassured it is okay if they do not want to view this photo. As an additional precaution, the child can also be told that, to make sure they are safe, their parents will get a message if they do view it. Similar protections are available if a child attempts to send sexually explicit photos. The child will be warned before the photo is sent, and the parents can receive a message if the child chooses to send it.
Messages uses on-device machine learning to analyze image attachments and determine if a photo is sexually explicit. The feature is designed so that Apple does not get access to the messages." -- https://www.apple.com/child-safety/
While that's billed as "available for Family accounts in iCloud", so _probably_ opt in, it's another piece of software I never asked for and don';t want on the phone I bought.
I'm well aware, and that's a good feature. I do think they should go one step further and give minors the option to report abusive messages (eg. sextortion).
"The Messages app will add new tools to warn children and their parents when receiving or sending sexually explicit photos. When receiving this type of content, the photo will be blurred and the child will be warned, presented with helpful resources, and reassured it is okay if they do not want to view this photo. As an additional precaution, the child can also be told that, to make sure they are safe, their parents will get a message if they do view it. Similar protections are available if a child attempts to send sexually explicit photos. The child will be warned before the photo is sent, and the parents can receive a message if the child chooses to send it.
Messages uses on-device machine learning to analyze image attachments and determine if a photo is sexually explicit. The feature is designed so that Apple does not get access to the messages." -- https://www.apple.com/child-safety/
While that's billed as "available for Family accounts in iCloud", so _probably_ opt in, it's another piece of software I never asked for and don';t want on the phone I bought.