Apple Watch AI Audio Features Enter Beta Testing
Apple has launched developer beta testing for its new Audio Intelligence features on the Apple Watch, introducing tools designed to help users catch up on conversations and manage notes.
Radwan AbdulhadiEditor and technology writer
Beta Testing Begins for Audio Intelligence
Apple's new AI-powered Audio Intelligence technology for the Apple Watch is now rolling out into beta testing, initially targeted at developers in the iOS 27.3 update. First unveiled at the company's Surprise and Shine hardware event in September, the technology introduces a set of four opt-in features designed for Apple Watch Series 12 wearers.
The suite of tools incorporates sound recognition to assist deaf and hard-of-hearing users in identifying critical sounds like sirens, alarms, or doorbells. Additionally, a song recognition feature integrates with Apple's Shazam app to identify background music, showing both the song name and artist directly on the device.
Live Rewind and Conversational Support
Among the newly introduced capabilities are two features focused on listening to human conversations: Live Rewind and Siri Recaps. Apple designed these additions to offer practical assistance while attempting to address privacy concerns associated with AI wearable devices.
Live Rewind lets users look back at what someone recently said if they missed it. By double-pressing the watch's digital crown, a wearer can view a text snippet of the past 15 seconds displayed on the watch face. Users can choose to let the snippet disappear permanently, or save it to the standalone Siri app that shipped with iOS 27 for future reference.
When executing the double-press gesture, an audible chime and an animation appear to signal to surrounding individuals that a recording action has taken place. If not saved, the temporary snippets are deleted automatically after 30 seconds. Users can also tap an 'Ask Siri' prompt below the snippet to query technical terms or details mentioned during the exchange.
Siri Recaps and Meeting Notes
The second major tool, Siri Recaps, extends ambient listening further to create high-level summaries of conversations. Apple states that the feature avoids word-for-word transcriptions, speaker identification, and raw audio storage, opting instead to summarize discussions with a brief sentence and key bullet points.
Intended for scenarios like work meetings, parent-teacher conferences, or personal training sessions, the recap feature focuses on factual elements such as dates, deadlines, or pricing details. The capability remains inactive while users listen to music with headphones or active noise cancellation.
Once enabled, users are prompted to review recorded recaps and select which notes to store in their Notes app or export to the Journal app. Unreviewed recaps automatically delete themselves within seven days. Furthermore, Siri Recaps automatically filters out sensitive information, including government-assigned identifiers, financial data, and self-harm language.
Hardware, Processing, and Privacy Architecture
The Audio Intelligence capabilities available on the Apple Watch Series 12 and Apple Watch Ultra 4 rely on a combination of hardware, software, and cloud services. This technical framework utilizes the S11 chip, built-in microphones, iPhone-based Apple Intelligence models, and Apple's Private Cloud Compute infrastructure.
The always-on processor features a secure enclave housing a dedicated audio buffer that processes raw audio securely, ensuring the data remains inaccessible to external parties, including Apple. Lightweight AI models on the S11 chip detect active conversations, which are then passed securely to the paired iPhone for processing into condensed text before routing through encrypted channels.
Apple notes that these features are engineered to operate without impacting the battery life of the connected watch or phone. Following the current developer beta, the functionality will expand to a public beta before seeing a broader public release.
Sources
- TechCrunchApple Watch’s AI features for rewinding and recapping conversations begin beta testing
Continue chronologically
Related entity coverage
Related stories
Apple's iPhone 18 Pro lineup arrives worldwide
Apple has launched the iPhone 18 Pro lineup, Apple Watch Series 12, Ultra 4, and AirPods 5 in stores worldwide.
Apple HomePod Mini 2 First Look: Speed, Style, and Bugs
A first look at the $149 HomePod Mini 2 reveals major speed improvements and a deep green design, but Siri AI and Mac speaker features fall short.
Apple Opens Claims Process for $250 Million Siri AI Settlement
Eligible US iPhone owners can now file claims for the $250 million settlement regarding delayed AI features. Find out if you qualify for a payout.
iOS 27.2 Brings Two Major CarPlay Features and Updates
Apple officially releases iOS 27.2, introducing two major CarPlay changes alongside updated Podcasts app tabs and expanded Siri AI capabilities.
