Apple Integrates Visual Intelligence Across iOS 27 and macOS

Apple has announced a significant expansion of its AI capabilities with the introduction of 'Visual Intelligence' in iOS 27 and macOS 27. By integrating this technology directly into the native Camera app and system-wide workflows, Apple is enabling users to interact with the physical and digital world in real-time. This feature allows users to point their cameras at objects to retrieve information, identify landmarks, or perform context-aware actions, such as splitting restaurant bills or adding event details to a calendar.

This update marks a strategic shift in how Apple leverages its proprietary AI, Apple Intelligence. By embedding these tools into the core operating system, Apple is streamlining tasks that previously required third-party apps or manual web searches. The integration of Siri into the Camera app creates a more conversational and intuitive user experience, allowing for follow-up questions and persistent history, which ensures that information gathered during a camera session remains accessible even after the app is closed.

For Mac users, the 'Golden Gate' update introduces a similar workflow that allows for screen-based analysis. By using a keyboard shortcut to select portions of the screen, users can trigger reverse image searches or request contextual data, such as nutritional information or event scheduling. While these features are currently limited to devices supporting Apple Intelligence—specifically iPhone 15 Pro models and newer, and M-series Macs—the move signals a broader commitment to making AI a foundational element of the Apple ecosystem. This development positions Apple to compete more directly with established tools like Google Lens while emphasizing privacy and system-level integration.