Apple Introduces Apple Intelligence: A Powerful Generative Personal Intelligence System for IPhone, IPad and Macbook Series

Apple Intelligence sets a new standard for privacy in AI by understanding personal context to give useful and relevant intelligence.

Apple today launched Apple Intelligence, a personal intelligence system for iPhone, iPad, and Mac that blends the power of generative models with personal context to give extremely valuable and relevant information. Apple Intelligence is tightly interwoven into iOS 18, iPadOS 18, and macOS Sequoia. It uses Apple hardware to comprehend and generate language and graphics, conduct actions across apps, and rely on personal context to simplify and accelerate daily chores. Apple's Private Cloud Compute sets a new standard for AI privacy by allowing users to flex and scale computing power between on-device processing and bigger, server-based models that operate on dedicated Apple silicon servers.

“We’re thrilled to introduce a new chapter in Apple innovation. Apple Intelligence will transform what users can do with our products — and what our products can do for our users,” stated an excited Tim Cook, Apple’s CEO. “Our unique approach combines generative AI with a user’s personal context to deliver truly helpful intelligence. And it can access that information in a completely private and secure way to help users do the things that matter most to them. This is AI as only Apple can deliver it, and we can’t wait for users to experience what it can do.”

Apple Intelligence, the personal intelligence system for iPhone, iPad, and Mac, mixes generative models with user context to provide valuable and relevant intelligence.

New Capabilities for Language Understanding and Creation

Apple Intelligence provides people with additional methods to improve their writing and communicate more effectively. Users can revise, proofread, and summarize content almost anywhere they write, including Mail, Notes, Pages, and third-party apps, thanks to new systemwide Writing Tools in iOS 18, iPadOS 18, and macOS Sequoia.

Writing Tools make users feel more secure in their writing, whether they're tidying up class notes, ensuring a blog post reads correctly, or crafting an email that's ideal. Apple Intelligence's Rewrite feature lets users to select alternative versions of their writing, altering the tone to suit the audience and work at hand. Rewrite can help you provide the correct words for the occasion, whether you're finessing a cover letter or adding fun and imagination to a party invitation. Proofread examines grammar, word choice, and sentence structure while also recommending fixes (with reasons) that users can review or quickly approve. Summarize allows users to pick content and have it recapped in the form of a digestible paragraph or bulleted key points or a list or table.

Users can now revise, proofread, and summarize content almost anywhere they write thanks to Apple Intelligence's new systemwide Writing Tools.

It's never been easier to keep on top of emails with Mail. Priority Messages adds a new column at the top of the inbox that displays the most urgent emails, such as a same-day dinner invitation or flying pass. Instead of previewing the first few lines of each email, users can browse summaries without opening the letter. Users can easily access relevant details in long threads with a single press. Smart Reply makes suggestions for short responses and will identify questions in an email to guarantee that everything is addressed.

Priority Messages in Mail adds a new column at the top of the inbox that displays the most urgent emails.

A thorough understanding of language extends to notifications. Priority alerts display at the top of the stack to highlight the most critical information, while summaries allow users to skim long or stacked alerts to view key details directly on the Lock Screen, such as when a group conversation is extremely active. Reduce Interruptions, a new Focus, helps users stay focused on what they're doing by surfacing only alerts that may require quick attention, such as a text about an early pickup from daycare.

Priority messages highlight the most critical information, and summaries allow users to skim long or stacked messages and view key contents directly on the Lock Screen.

Users of the Notes and Phone apps can now record, transcribe, and summarize audio files. When a recording is started during a call, participants are automatically notified, and when the call concludes, Apple Intelligence creates a summary to help them remember important points.

Users of the Notes and Phone apps can now record, transcribe, and summarize audio files.

Image Playground enhances communication and self-expression.

Apple Intelligence drives fascinating picture creation capabilities, allowing people to communicate and express themselves in new ways. Image Playground allows users to make amusing graphics in seconds by selecting from three styles: animation, illustration, or sketch. Image Playground is simple to use and integrated into apps like as Messages. It's also accessible as a separate app, which is ideal for experimenting with new concepts and styles. All photos are made on-device, allowing users to explore with as many images as they like.

Image Playground, which is simple to use and embedded right into apps like Messages, allowing users to quickly create interesting photographs.

Image Playground allows users to select from a variety of concepts in categories such as themes, costumes, accessories, and locations; provide a description to define an image; incorporate someone from their own photo library in their image; and select their favorite style.

Image Playground allows users to select from a variety of concepts in categories such as themes, costumes, accessories, and locales.

The Image Playground experience in Messages allows users to rapidly create amusing photos for their pals and even get tailored suggested themes based on their chats. For example, if a user is texting a group about going hiking, they will get suggested concepts based on their friends, destination, and activity, making image creation faster and more meaningful.

In Messages, users may utilize Image Playground to rapidly create amusing images for their pals and view tailored suggested concepts based on their chats.

Users can generate an image using context from the surrounding environment by selecting empty space in the Apple Pencil tool palette and using Image Wand.

Users may access Image Playground in Notes using the new Image Wand in the Apple Pencil tool palette, which makes notes more visually appealing. Rough sketches can be transformed into fascinating images, and users can even use empty space to generate an image based on information from their surroundings. Image Playground is also included in programs such as Keynote, Freeform, and Pages, as well as third-party apps that use the new Image Playground API.

Genmoji Creation fitting any moment

Taking emoji to an entirely new level, users can create an original Genmoji to express themselves. By simply typing a description, their Genmoji appears, along with additional options. Users can even create Genmoji of friends and family based on their photos. Just like emoji, Genmoji can be added inline to messages, or shared as a sticker or reaction in a Tapback.

Simply inputting a description generates a Genmoji and more options.

New features in photos giving users control like never before

Apple Intelligence makes it much easier to search for photographs and videos. Natural language can be used to search for specific photographs, such as "Maya skateboarding in a tie-dye shirt," or "Katie with stickers on her face." Search in videos gets more powerful with the ability to discover specific moments in clips, allowing users to jump right to the relevant segment. Furthermore, the new Clean Up tool can detect and eliminate distracting things from a photo's background without affecting the subject.

The new Clean Up tool in Photos can identify and eliminate distracting elements from a photo's background without changing the subject.

Memories allows users to construct the tale they want to see by simply typing a description. Using language and picture understanding, Apple Intelligence will select the finest photographs and videos based on the description, create a plot with chapters based on themes recognized in the photos, and organize them into a movie with its own narrative arc. Apple Music will even suggest songs based on users' recollection. As with all Apple Intelligence services, user photographs and videos remain private on the device and are not shared with Apple or anyone else.

With Memories, Apple Intelligence can select the finest photographs and videos based on a user's description, create a storyline, and combine them into a movie with its own narrative arc.

Siri is set to enter a new era

Siri, powered by Apple Intelligence, is becoming increasingly integrated into the system experience. Siri is more natural, contextually relevant, and personal, with the capacity to simplify and accelerate daily chores thanks to improved language understanding. It can follow along with users who stumble over words and keep context from one request to the next. Users can also type to Siri and switch between text and voice to connect with Siri in the method that feels most natural at the moment. Siri now has a new design, including an exquisite glowing light that wraps around the screen while Siri is activated.

Users may now type to Siri and switch between text and speech to connect with her in the method that feels most natural at the moment.

Siri can now provide device help wherever consumers go and answer hundreds of queries about how to accomplish things on the iPhone, iPad, and Mac. Users may learn everything from scheduling an email in the Mail app to switching between Light and Dark Modes.

Siri's onscreen awareness allows you to easily do an action connected to the information on the screen, such as adding an address received in Messages to a friend's contact card.

Siri will eventually be able to understand and act on user content in more apps thanks to onscreen awareness. For example, if a friend messages a user their updated address in Messages, the receiver may say,“Add this address to his contact card.”

Siri can now perform hundreds of additional activities within and across apps, such as finding book recommendations sent by a friend via Messages and Mail.

With Apple Intelligence, Siri will be able to perform hundreds of additional tasks within and between Apple and third-party apps. For example, a user may say, "Bring up that cicadas article from my Reading List," or "Send the photos from Saturday's barbecue to Malia," and Siri would take care of it.

Siri can now perform hundreds of additional activities within and across apps, such as finding book recommendations sent by a friend via Messages and Mail.

Siri will be able to provide intelligence that is specific to the user and their on-device information. For example, a user can say, "Play that podcast that Jamie recommended," and Siri will find and play the episode without requiring the user to remember if it was mentioned in a text or an email. Or they can ask Siri, "When is Mom's flight landing?" and Siri will look up the flight information and cross-reference it with real-time flight monitoring to provide an arrival time.

Siri can provide specialized intelligence based on the user's on-device information, such as locating information about an impending flight or keeping track of a dinner reservation.

Setting new standards for privacy in AI

To be genuinely useful, Apple Intelligence must comprehend deep personal context while maintaining user privacy. On-device processing is a key component of Apple Intelligence, and many of the models that fuel it operate fully on the device. To conduct more complex queries that need more processing power, Private Cloud Compute extends Apple devices' privacy and security into the cloud, revealing even more intelligence.

Apple Intelligence can use Private Cloud Compute to flex and extend its computational capabilities, as well as access larger, server-based models for more sophisticated queries. These models run on servers powered by Apple hardware, providing a basis for Apple to assure that no data is retained or exposed.

Independent experts can review the code that runs on Apple silicon servers to assure privacy, and Private Cloud Compute cryptographically ensures that iPhone, iPad, and Mac devices do not communicate with a server unless its software has been publicly logged for scrutiny. Apple Intelligence with Private Cloud Compute establishes a new standard for AI privacy, allowing consumers to access trusted intelligence.

ChatGPT integration across all Apple platforms

Apple is integrating ChatGPT access into iOS 18, iPadOS 18, and macOS Sequoia experiences, letting users to use its knowledge as well as image and document interpretation capabilities without having to switch between products.

Siri can use ChatGPT's knowledge as needed. Users are prompted before sending any inquiries to ChatGPT, along with any documents or photographs, and Siri then displays the response directly.

When a user authorizes authorization, Siri can access ChatGPT's extensive world knowledge and provide an answer directly.

ChatGPT will also be included in Apple's systemwide Writing Tools, which assist users generate material for any topic they are writing about. Users can also use Compose's ChatGPT image capabilities to create graphics in a number of styles to match their words.

ChatGPT will be included in Apple's systemwide Writing Tools for macOS, which assist users in creating material for whatever they are writing about.

Users who visit ChatGPT benefit from built-in privacy measures, such as having their IP addresses masked and OpenAI not storing requests. ChatGPT's data-use policies apply to users who connect their accounts.

ChatGPT will be available for iOS 18, iPadOS 18, and macOS Sequoia later this year, powered by GPT-4o. Users can view it for free without registering, while ChatGPT subscribers can link their accounts and access paying features directly from these experiences.

Availability

Apple Intelligence is free to users and will be available in beta as part of iOS 18, iPadOS 18, and macOS Sequoia this autumn in US English. Some new features, software platforms, and languages will be introduced during the following year. Apple Intelligence will be available on the iPhone 15 Pro, iPhone 15 Pro Max, iPad, and Mac running M1 or later, with Siri and the device language set to US English. For additional information, go to apple.com/apple-intelligence.

About Apple

In 1984, Apple introduced the Macintosh, which transformed personal technology. Apple currently leads the world in innovation, with products like as the iPhone, iPad, Mac, AirPods, Apple Watch, and Apple Vision Pro. Apple's six software platforms — iOS, iPadOS, macOS, watchOS, visionOS, and tvOS — offer unified experiences across all Apple devices and empower users with innovative services such as the App Store, Apple Music, Apple Pay, iCloud, and Apple TV Plus. Apple's more than 150,000 people are committed to creating the best products on the planet and leaving the world better than we found it.

Images and Videos Courtesy:

https://www.apple.com/newsroom/2024/06/introducing-apple-intelligence-for-iphone-ipad-and-mac/