Apple’s Worldwide Developers Conference next week is set to be a landmark event in the company’s history. The Cupertino-based tech giant will unveil how it plans to incorporate AI technology into its devices and software, bolstered by a historic partnership with OpenAI. Rumors and leaks about iOS 18 and its AI-powered apps and features have been circulating as the event approaches.
Apple is expected to power some of its new AI features using its Ajax LLM. Additional reports suggest that Apple will process AI data in a way that even employees won’t have access to, maintaining a strong commitment to user data privacy.
Here’s a sneak peek at how Apple plans to integrate AI into its apps and services in the upcoming iOS 18 update, along with other enhancements and features.
Siri’s AI-enabled future
- Apple’s digital assistant is primed for an AI transformation. Leveraging Apple’s large language models, Siri will be able to control specific features within applications without any setup from developers or users, unlike App Intents or Siri Shortcuts. Users will be able to ask Siri to perform tasks like deleting an email or editing a photo.
- Some of Siri’s advanced AI capabilities, like handling tasks with multiple steps, may not be available until next year.
- Enhanced AI-driven Siri features will also extend to the Apple Watch, allowing you to use Siri on your Watch to play music on another device.
- Siri will receive more natural-sounding voices.
- Siri will be capable of summarizing notifications that include various types of information such as people, companies, and events.
- Could Siri’s new look be hinted at in the animations below?
Apple Photos’ new look
- A refreshed interface is anticipated.
- Users will be able to retouch photos with AI, potentially challenging Google Photos.
- A “Clean Up” feature will allow users to remove objects from photos using generative AI, similar to Google’s Magic Eraser.
- An internal-only application called Generative Playground uses genAI to create and edit images, though its exact user-facing implementation is unclear. iMessage integration was spotted as an app extension.
Safari with more AI
Notes injected with AI
- Users will be able to get AI recaps of Notes.
- GenAI will assist in transcribing audio in Notes.
- In-app audio recording will be supported alongside transcription and AI summarization.
- Math Notes will help users create graphs and solve equations using AI.
- Auto-completion for mathematical equations in Notes might also be available.
- Project Greymatter is the code name for AI tools integrating into core apps like Safari, Photos, and Notes, as reported by Bloomberg.
Voice Memos transcriptions
iMessages’ gets an AI makeover
- Generative AI emojis will be supported, allowing users to create custom emojis.
- AI recaps of missed texts will be included.
- Deeper Siri integration is expected.
- Tapbacks will feature new icons.
- Message effects for individual words will be supported in addition to effects for the entire message.
- Suggested replies generated by Apple’s on-device Ajax LLM will help make replying easier.
- RCS support is expected this year, bringing features like read receipts, typing indicators, and high-quality videos and images when texting Android users via iMessage.
Calendar refresh
- Apple’s LLM will be able to interact with the Calendar app to check for events during message composition.
Mail with support for AI
New Settings interface
- Settings will hopefully become less confusing with a redesigned interface and updates that offer better organization and improved search functionality.
Control Center updates
- A new Music widget will be available, possibly featuring larger artwork.
- Enhancements to HomeKit for improved smart home integrations.
Notifications
Spotlight
Home Screen updates
- iOS 18 will introduce the ability to place app icons anywhere on the Home Screen, instead of aligning them to a strict grid.
- Users will also be able to change app icon colors, possibly as Apple’s answer to Google’s Material You.
Maps with route creation
Music with AI-powered playlists
More improvements
Other apps with updates planned include Freeform, Xcode, and Apple’s productivity apps like Keynote and Pages, which could receive genAI features.
