Apple has introduced four new audio features in developer betas for iOS and watchOS for Apple Watch Series 12.
The update covers sound detection, song recognition via Shazam, 15-second audio rewinds, and conversation summarization features.
The features are included in the first beta versions of iOS 27.3 and watchOS 27.3, released to developers on Tuesday. Two of them detect important sounds, such as an alarm or doorbell, and identify songs using Shazam technology. Sound recognition can help people with hearing impairments.
The other two features are “Live Replays” and “Siri Recap.” The former allows the user to review what was said in the previous 15 seconds. The latter records and summarizes sounds from the day, saving notes with what it considers important.
The experience from testing to everyday life
In one test, the editor took her teenager’s car in for repairs and picked up a rental. The employees verbally gave her a lot of information about the cost, repair time, and terms. Later, Siri Recap captured useful details like the deductible amount, estimated repair time, and how much gas the rental had when they picked it up.
But there was a problem: The feature put the car information in the same note as later discussions at home about chores and the childcare schedule. It also recorded the family’s intention to watch coverage of the U.S. midterm elections on TV — something, the editor notes, she wouldn’t normally include in a note.
↳
READ ALSO
HACKS.GR / RELATED
HACKS.GR
Smartphones, Wearables & Gadgets
Cheap electric motorcycles and scooters caught the eye at the EICMA exhibition
↗
This made it more noticeable that the watch was listening to everyday conversations. The editor considered turning off Siri Recap in the evenings at home so that family conversations wouldn't become material for notes.
How data is processed
Apple says that where possible, audio and AI are processed on the device. The feature also doesn't recognize who's speaking, doesn't store the original audio files, and removes sensitive information like ID numbers or personal account details.
The author would like to see irrelevant information stored in separate notes or sections, which the user can delete or export individually. She also suggests a way to delete a single bullet point without having to edit the entire text, as well as automatically saving notes to Apple's Notes app.
Despite reservations about the watch listening to conversations, the editor believes that automatic recording can be useful in everyday life — as long as users have better control over what is stored and where.
>Stay connected with Hacks.gr
Set us as a preferred source on Google and find us on social media.
Preferred source
↗
end of article
Top comments (0)