Apple Watch Series 12 and Ultra 4's controversial AI features are going live

Apple Watch Series 12 & Ultra 4: Groundbreaking AI Features Now Rolling Out

Apple's latest smartwatch offerings, the Apple Watch Series 12 and Watch Ultra 4, unveiled in September, are finally bringing their highly anticipated, albeit controversial, Audio Intelligence features to users. While Sound Recognition and Shazam-powered Music Recognition launched with the devices, the more discussed functionalities, Live Rewind and Siri Recap, are now appearing in the first watchOS 27.3 developer beta.

Live Rewind: Never Miss a Detail

The Live Rewind feature offers a unique way to catch missed information. With a simple double-press of the Digital Crown, your watch displays a text snippet of what was said in the preceding 15 seconds. This could be anything from daily specials announced by a server to directions you didn't quite catch. You then have the option to ask Siri for more details about the snippet or save it to the Siri app. If left untouched, the snippet vanishes about 30 seconds after the screen dims. To ensure transparency, Live Rewind emits an audible chime, even in silent mode or with headphones, and displays a full-screen animation with a microphone indicator, signaling to those nearby that the feature is active.

Siri Recap: Your Personal Conversation Summarizer

Taking conversation analysis a step further, Siri Recap ambiently captures notes from your daily discussions. Post-conversation, it generates a title, a concise summary, and key points within the Recaps tab of the Siri app. Importantly, this is not a transcript, and it does not attribute statements to specific individuals. Apple has designed Siri Recap to proactively omit sensitive information such as financial details and government-issued identifiers. Recaps are automatically deleted after seven days unless manually saved, with options to export them to the Notes or Journal apps. Users can customize when Siri Recaps are active, setting schedules based on time or location (e.g., "only at work" or "never at night"), and can easily toggle the feature on or off via Control Center.

Privacy-Focused AI: How it Works

Apple emphasizes its commitment to privacy, stating that no audio recordings are ever created. Raw audio data is processed within a secure, hardware-isolated Secure Enclave on the S11 chip and the paired iPhone, inaccessible to the operating system, apps, the user, or even Apple itself. Live Rewind is processed entirely on-device. For Siri Recap, a condensed version of the conversation transcript is sent to Private Cloud Compute for summarization.

Both of these advanced features are strictly opt-in. To utilize them, you'll need a Series 12 or Ultra 4 paired with an iPhone 16 or newer (excluding the iPhone 16e) that supports Apple Intelligence and Siri AI. Currently, these features are only available in English, with broader language support planned for the future. Users under the age of 13 are ineligible. As anticipated, these AI functionalities will not be immediately available in the EU due to the current absence of Siri AI in that region. A public beta is expected soon, paving the way for a wider rollout to all eligible users.

Source