Apple is preparing for its annual developer conference, WWDC 2024, set to take place from June 10 to June 14. This event is highly anticipated, as the company is expected to unveil significant updates for its upcoming flagship products, including the next-generation iOS update—iOS 18.
Billed as the most substantial iOS update to date, iOS 18 will focus heavily on AI, incorporating several groundbreaking tools and features. Ahead of the official debut at WWDC, Apple has already teased some details. Notable features include eye-tracking capability, music haptics, and generative AI. Here’s a closer look at these innovations:
Eye-Tracking
Initially introduced in the Vision Pro, Apple’s eye-tracking technology will now be available on iPhones and iPads. This feature allows users to navigate their devices using only their eyes, eliminating the need for touch input. By using the front camera and on-device machine learning, users can hold their gaze to select elements on the screen. Importantly, no additional hardware is required, though a quick setup will be necessary to activate this function.
Generative AI
iOS 18 will bring advanced on-device AI capabilities to all Apple devices, making them smarter and more intuitive. Potential AI-powered features include auto-generated playlists in Apple Music and AI-assisted writing tools in Pages and Keynote. These AI functionalities will operate directly on the device, without relying on cloud servers.
Several apps are expected to benefit from these AI enhancements:
- Notes: Generative suggestions and editing capabilities powered by on-device Large Language Models (LLM).
- Photos: AI-driven editing features, similar to those on Google’s Pixel devices, which allow users to erase unwanted elements from images.
- Siri: An AI makeover that will significantly enhance its capabilities.
- Real-time Audio Transcription: A feature enabling users to read, edit, copy, and share transcriptions of audio content. Additionally, a summarization feature is anticipated.
Vehicle Motion Cues Another notable feature expected at WWDC 2024 is designed to reduce motion sickness for passengers viewing screens while travelling. This feature will use animated dots on the screen’s edges to mimic the motion of the vehicle, minimizing sensory conflict and reducing motion sickness.
Music Haptics Aimed at users who are hard of hearing or have lost their hearing, the Music Haptic feature will translate songs on Apple Music into taps, textures, and vibrations. This allows users to experience music through touch, providing an alternative way to enjoy audio content.
iOS 18 Release Date Traditionally, Apple releases new iOS versions during its September event, coinciding with the launch of new iPhones. At WWDC 2024 in June, Apple is expected to announce iOS 18 and make it available for beta testing, either for developers or the public.