Apple has finally made its productive artificial intelligence move, which has been talked about for months, under the name Apple Intelligence at the WWDC 2024 developer event. announced. Here are the details about Apple Intelligence features.
Apple Intelligence Features
Apple introduces its Apple Intelligence innovation as a new personal intelligence system that makes your most personal products more useful and enjoyable. The company is focused on 5 topics: Power, intuitiveness, integration, individuality and privacy. It is stated that powerful productive models will be placed at the very center of iPhones, iPads and Macs, and it is underlined that deep integration into the platform and applications will be provided.
Deep natural language understanding powers new authoring tools that provide system-wide access. You will be allowed to automatically rewrite text or make corrections in Mail, Notes, Safari, Pages, Keynote and third-party applications.
The personal intelligence system will allow you to express yourself visually with picture capabilities, from photos to emojis and GIFs. You will now be able to create new images. You will be able to personalize the days of the speeches, and to create a happy day with balloons and cake to wish a happy birthday to your friend.
Apple Intelligence will be able to perform actions within applications. You’ll be able to ask a person to open files they shared with you last week or to be shown photos of you with someone.
Apple Intelligence will be based on your personal information. It will be able to access data in your applications and on your screen. Let’s say a meeting has been rescheduled for later in the afternoon. The system will be able to tell you, for example, whether it will prevent you from getting to your child’s performance on time. Again, the system will be able to understand who your child is, the details he emailed a few days ago, the schedule of your meeting and the traffic between your office and the theatre.
Apple Intelligence and Privacy
There will be no need to transfer all the information in your life to someone’s artificial intelligence cloud. Apple underlines that the system is built with privacy at its core. On-device processing will be aware of your personal data without collecting your personal data. Â Apple emphasizes that they have the computational foundation to power Apple Intelligence with advanced Apple Silicon and says that the system includes highly capable LLM and diffusion models.
It is also among the information that many models will work completely on the device. However, sometimes when more power is needed, servers will help with this. It is stated that with Apple, you will have control of your data and with Private Cloud Compute, the privacy of your iPhone will expand to the cloud to unlock more intelligence. Private Cloud Compute will allow Apple Intelligence to flex and scale computing capacity and use server-based models while protecting your privacy. The feature will run on servers built on Apple Silicon.
When you make a request, Apple Intelligence will analyze whether it can be accomplished on the device. If it needs more processing capacity, it will send the data needed to fulfill the request. This data will not be stored and will only be used for your requests.
Apple Intelligence and New Siri
Siri has been getting a new look and is being experienced more deeply. Assistant now offers richer understanding capabilities. Siri will allow you to make corrections in real time and preserve the context of the conversation. It is now possible to contact Siri. To open a keyboard to talk to Siri, just double-tap the bottom of the screen.
Siri will keep you informed about features and settings to help you do things on your iPhone, iPad or Mac. When you describe a feature, Siri will be able to find it for you.
Siri will finally have screen awareness. You will be able to have Siri add the address sent to a contact in a message. Siri will also be able to perform actions within and between apps, including apps that take advantage of display and writing capabilities. Over time, the assistant will be able to understand and take action on more applications.
Siri will automatically be able to find your driver’s license photo, get your ID number and enter it into a form.
More features will be available next year.
More from Apple Intelligence
The new feature, called Rewrite, will allow you to change the tone or reread inline text in Mail and other applications. Smart Reply in Mail allows you to receive suggested answers that describe the questions asked to you in a message. Instead of previewing the first few lines of an email, it is also possible to receive summaries of emails in your inbox.
Notifications can also be summarized automatically. The new Focus mode, called “Reduce Interruptions,” will automatically review notifications and messages to see if they are important enough to disturb you.
genmoji
Even though Messages has thousands of emojis to choose from, Genmoji is now coming. Thus it is possible to create new emoji on the device.
Image Playground
Image Playground also offers a brand new experience. You will be able to choose from a variety of concepts such as themes, costumes, accessories, locations and more. It is stated that you do not need to be an engineer for the best command for this. Both previews will be created on the device. You will be able to write descriptions and choose between Animation, Illustration or Drawing. You’ll be able to access your creations from Messages, Pages, Freeform, and even a dedicated Image Playground app.
image wand
The new Image Wand tool in notes will be able to turn a rough sketch into a bright image. On-device intelligence will be used to analyze a sketch and words and create an image. The tool will be able to remove and repair images.
Search and Create with Apple Intelligence
It will be possible to easily access photos or videos by searching for “Maya skateboarding in a tie-dye shirt” or “Katie with stickers on her face”. Apple Intelligence will be able to create memories with the story you want to see. For example; “Ali is learning to fish and catches a big fish.” You will be able to create a clip by saying.
Apple Intelligence and Notes
Notes will be able to record audio and convert it to text. When your recording is finished, Apple Intelligence will automatically create a summary. Recordings and summaries of phone calls are also provided.
Apple Intelligence and ChatGPT
Apple Intelligence will be available for free with iOS 18, Sequoia and iPadOS 18. The system will be able to integrate external models with experiences, including ChatGPT, and will be supported by GPT-4o. It will also offer built-in support in Siri. You will be able to access ChatGPT for free without creating an account. Requests will not be logged either. ChatGPT subscribers will have access to paid features in the experiences. Support for other artificial intelligence models is also planned in the future.
Apple Intelligence Supported Devices
Apple Intelligence will be supported on iPhone 15 Pro and iPad and Mac devices with M1 and later.
When Is Apple Intelligence Coming?
The system is coming in US English this summer. It will be available in beta this fall as part of iOS 18, iPadOS 18, and macOS Sequoia. Other languages and platforms will arrive later this year.
