It is expected that Apple will introduce a plethora of AI features with iOS 18 under the codename “Project Greymatter”. New details about Siri, Notes, and Photos’ AI tools have been revealed by AppleInsider.
Graymatter Catch Up is the new notification summary feature that was previously described as “smart recaps”. Users will be able to ask Siri for a recap of their recent notifications for missed notifications, web pages, notes, and documents.
With Siri, Apple’s digital assistant is getting Apple’s on-device LLM and a new smart response framework. As a result, Siri should provide more cognitive and natural-sounding responses, with a deeper integration of contacts, companies, events, and locations. According to reports, Apple is also working on cross-device media controls with Siri – allowing users to control media playback on their Apple TV from their Apple Watch.
A text summarization and audio-to-text transcription feature is also expected to be built into Siri and Notes.
The Photos app on iOS 18, iPadOS 18 and macOS 15 will also feature generative AI features. Similar to Google’s Magic Eraser, Clean Up allows users to remove unwanted objects from their photos. Photo editing and image generation will be possible in the Photos app as well as through an app extension in iMessage with Generative Playground.
Besides transcripts and summaries, Notes also gets audio recordings. A single note can contain text, audio, and images. The Notes app gets a big productivity boost with the addition of Math Notes, which recognizes mathematical equations and provides solutions.
