Apple partners with OpenAI to bring artificial intelligence to iPhone, iPad and Mac this fall

Manzana has revealed this afternoon its plans for the new generation of software that will arrive this fall on its devices and, finally, how it is going to get on the artificial intelligence bandwagon. It will do so starting with the iPhone 15 Pro and iPads and Mac computers that have an M1 or later processor and under the name Apple Intelligencewhich is not a particular application but a functionality that It will be integrated with the operating system and a wide range of appsbeing Siri its greatest exponent. He has also announced his alliance with OpenAI to integrate, in certain use cases, ChatGPTin its version GPT-4owith their devices.

Apple's voice assistant, with 13 years behind it, it has undergone its greatest remodeling. Its interface has a new design but, above all, it has new capabilities. Better understands natural language and offers greater interaction with applications. A user can ask her what time her mother's flight will arrive, one of the examples shown during the opening of WWDC, Apple's annual developer conference, and Siri will extract the information from the email in which it appears, How could I do it from another application if that were the case?.

And here the issue of privacy comes into play. One of the reasons why Apple Intelligence will be available starting with the latest generation of the iPhone and the most recent generations of iPads and Mac computers is the need to have with the necessary hardware to process AI functions on the device and not in the cloud. This is important considering that what we are looking for is an AI that understands the “personal context” of the user. That is, access all your information: images, files, emails, etc. Local processing of language models allows them to not leave the user's device, but this will not happen in all cases.

When the AI ​​determines that a task cannot be performed with the hardware of the device on which it operates, will send it to the cloud for processing. This will be a “private cloud” whose servers will work with M series processors and in the that user data is not storedsomething that Apple has assured has been independently verified.

AI automatically resolves operations. Manzana.

And what can you do with Apple Intelligence? AI makes use of “powerful generative models” to summarize and rewrite texts, write responses to emails, create images and emojis to the user's liking, delete objects in photographs, search for images and videos in the device gallery with natural language, transcriptions, record telephone conversations – always informing participants -, organizing and prioritizing emails and notifications, correcting the user's handwriting when writing with a Apple Pencil, solve mathematical operations in the notes you take or replace a botched sketch with a version created by AI in a document, among other examples that have been seen at the conference. Is under all, a more natural way to interact with the device and that eliminates barriers between applications by not having to depend on direct interaction with her. For example, you can tell it “play the podcast that my wife sent me the other day” without having to search or launch the application. Ask and the AI ​​gives it to you.

In the last part of the broadcast was when Apple's long-rumored alliance with OpenAI was announced. What has not been completely clear is its extent and to what extent new features depend on ChatGPT or Apple itself. In the examples seen, the interface gives the option to perform the task with ChatGPT as an alternative, something that had not been shown in all previous use cases of the new AI functions. Apple has also indicated that They will add support for language models other than ChatGPT in the future.

The rest of the news: iOS 18, iPadOS 18, macOS Sequoia, watchOS 11, AirPods and Apple TV+

The rest of the news that Apple has presented has been less glossy, as expected when faced with the issue of AI. The VisionPro will receive the second version of their operating system, which includes new control gestures, the possibility of using a virtual screen when working with a Mac equivalent to 2 4K monitors side by side and will be able to convert any image in the user's gallery to photography spatial, giving it a certain perspective that varies as the observer moves, among other improvements. Furthermore, the device It will go on sale this summer in new markets, not including Spain among them.

iOS 18 arrives with new customization options for the home screen, highlighting changing colors on icons that the user can choose and adjust to their liking. will allow block apps so that they can only be opened with biometric identification in case the cell phone is being used by another person. Messages gains more options for the Apple version of WhatsApp reactions and animations in texts, will allow you to schedule the sending of messages and will use a satellite connection, so that communication is possible even in the absence of Wifi or 5G.

Icon customization in iOS 18.
Icon customization in iOS 18.Manzana.

WatchOS 11 wins the feature Training Load which measures the intensity of the user's training, evaluates it and tells them how well they are doing. Another new app, Vitalsgathers all the information that the Apple Watch sensors record and alerts the user if they notice something out of the ordinary.

iPadOS 18In addition to the Home Screen customization functions of iOS 18, it brings a novelty that is hard to believe: a calculator, which it has lacked natively until now. This, like other applications that have also been redesigned for this format, will adapt to the iPad screen. Receive the AI ​​news mentioned above through the applications Grades and Math Notes and with the use of Apple Pencil.

macOS Sequoia arrives with a Safari which, according to Apple, is the fastest browser in the world and more efficient than Chrome, ensuring more hours of operation on a portable device. Will use AI to offer summaries of the web that is open and will offer navigation “really private” in which the information collected by the websites visited will be more limited.

iPhone mirroring on a Mac computer.
iPhone mirroring on a Mac computer.Manzana.

The operating system now allows adjust window size automatically by dragging them to one of the sides, allowing various window configurations. It will have iPhone Mirroringwhich is a function that allows you to control, from the Mac and in its full capacity, an iPhone that we can have in another room and without it being unlocked or vulnerable while being used from the computer.

Lastly, the AirPods will allow you to silently respond to Siri, nodding or shaking your headand the application of Apple TV+ It will offer information about the content that is being played, such as the actors and the roles they play, in the style of what can be done on Prime Video.