🍎 Apple’s mind blowing AI features

Everything we know from Apple’s conference

Estimated Read Time: 6 to 7 minutes

Apple just had their huge WWDC conference where they announced everything AI related. We have all the info you need in one place.

• 🤯 Everything Apple announced at WWDC.

• 🌹 The AI beauty pageant. (God help us.)

• 🚨 Microsoft’s Recall gets safety changes.

• 🍿 Elon Musk goes on another rage.

🤯 Everything Apple announced at WWDC

What happened: Apple just announced all of their planned AI features, many of whom use OpenAI’s model. Here’s all the details. (There’s a quick summary at the bottom of this article!)

The details: 

• All of Apple’s AI offering fall under the moniker of Apple Intelligence.

• The push into AI is ecosystem-wide; it expands to every Apple product, not just iPhone.

• The goal of Apple Intelligence is to make general life easier by knowing about how you communicate, your daily schedule, etc.

• A lot of Apple Intelligence is powered by OpenAI’s latest model, GPT-4o.

• You won’t have to create an OpenAI account or pay for features, despite most of Apple’s features being powered by GPT-4o, the latest model.

• Apple Intelligence is largely powered locally on the device. As such Apple Intelligence is only available for iPhone 15 Pro and devices with M1 or newer chips. (Serious bummer, this limits availability.)

• Most of the features listed carry across IOS 18 for iPhone and iPad, and also for the next macOS update.

• (Note: It’s not yet fully confirmed if the normal iPhone 15 is left out in the cold.)

• AI will be built into the OS and able to interact with most apps, starting with first party apps and expanding to third party apps as time goes on. This means you can get AI assistance when writing an email using the Mail app.

• Apple Intelligence will understand the context between apps now. So you won’t have to switch between Calendar, Mail, and Maps. It’ll all work together seamlessly now. You can say, “Drive me a route to my meeting” and it should understand the context.

• Apple Intelligence uses a new notification system, and will prioritize your notifications by what it deems are most important.

• Siri is getting a massive AI update, and will use ChatGPT’s newest features. It’s also getting a new look and icon.

• When using Siri, it will no longer cut off your screen. It now shows a line/outline around your screen while in use.

• You can now type directly into Siri.

• Siri is more personal and can understand natural speech better (stumbles in words, ums and ahs.)

• Siri will have onscreen awareness. An example is if someone sends you their address, you’ll be able to ask Siri to “add this address to contact card” and it’ll do just that.

• An example of the onscreen awareness; if you had a reminder or note to “wish grandpa a happy birthday,” you could instead tell Siri “FaceTime him”. It’s that simple now.

• Siri can interact with across apps. An example is asking Siri to alter a photo, like adjusting the color. And it’ll do that for you.

• An example is having Siri find an old family photo you can no longer locate.

• The new “App Intent” API allows developers to give Siri access to their apps.

• Other examples of things Siri can interact with on your behalf include emails, managing contacts, calendar events, files and photos.

• Summary: Siri is now a full blown personal assistant that is baked into IOS across all apps.

• Apple’s apps and features, including Siri, can tap into ChatGPT for expertise and answers.

• An example is asking Siri a question about a photo, and with permission it’ll ask ChatGPT on your behalf and give you the response.

• Another example is using ChatGPT while writing in Notes.

• OpenAI’s paid members will be able to access paid features in Apple’s ecosystem.

• Pencil users can circle text to create a new image based on the circled word.

• Math Notes is a calculator that will do the math for you. (It got a massive applause, it looks impressive.) It solves any math formula you draw on the screen. It’s a much more natural way of solving a math problem. (I believe this app is only for iPad right now.)

• Apple is reorganizing the Photos app with a new grid layout, a “trips” section, and more cosmetic and organizational changes. Photos will automatically be organized by topics like time, people, favorite memories, trips, etc.

• IOS will allow more cosmetic customization like changing the color tint of icons and allowing devs to create new Control Center shortcuts.

• You can also individually lock apps, requiring a passcode or face ID to open that particular app. (I can sense cheaters will use this.)

• You can create AI-generated images with your friends and family members based on the photos you already have of them.

• AI tools will help power photo editing apps (including Photos).

• Siri will be able to search the database of other apps using the new Spotlight API which enables app entities to be included in its index.

• Apple Vision Pro’s os is getting a new update, including some cool features such as creating spacial photos out of 3D images. It’s also becoming available in more regions.

  

  Apple Vision’s new spacial photo feature.

• Apple is debuting AI-generated Bitmojis, or emojis/whatever you want to call them. It’s exactly what it sounds like, the AI will generate a small image to represent whatever thought you want to express in the text message. Pretty cool.

• Apple confirmed they are still planning to use Google Gemini’s features in the future. So they’re working with partners beyond OpenAI.

• Apple swears privacy is their number one concern, and that your user data is safe. 🤔

• Apple’s big AI features will arrive with IOS 18, visionOS2 (the apple vision) and macOS Sequoia later this year.

• There are many minor changes coming as well, most of which are organizational or cosmetic, such as the new categories in the Mail app.

SUMMARY 👀

KEEP IT SHORT!!! Apple is integrating new AI features across all of their OSs, such as macOS and iPhone/iPad. These features are mostly powered by GPT-4o.

The AI features, dubbed Apple Intelligence, will be OS-level, and able to interact multiple apps at once and understand the context between them, creating an all-in-one personal assistant.

This includes revamps and features to Siri (makes it more like GPT-4o’s voice demo), email/writing apps, photos, etc. Siri understand your screen and schedule appointments or find photos for you.

But Apple Intelligence is mostly limited to newer devices with an M1 chip or newer/iPhone 15 Pro. This is because most of these features are powered locally by the device, with only a few things needing the cloud.

Apple Intelligence is basically a super AI-personal assistant.

🤖 Elon Musk is threatening to ban iPhones from all of his companies because of Apple’s partnership with OpenAI. He’s talking about physically in his businesses, not banning iPhone users from X or anything. This includes not just employees, but also visitors, who would have to leave their iPhone’s in the car/at home. Pretty hilarious.

🤓 Researchers have found that concise chain of thought prompting can cut AI costs by 20%. Basically it maintains performance while cutting usage. Concise Chain-of-Thought (CCoT) prompting combines the step-by-step reasoning approach of standard chain of thought prompting with the brevity of concise prompting. Basically you tell the LLM to think step by step… but you also tell the LLM to be concise in with their answer.

🌹 The AI beauty pageant

What happened: The world is officially ending. Miss AI is the world’s first official AI beauty pageant. It’s exactly what it sounds like, create a beautiful girl in Midjourney or any image generator, then enter her in the contest!

The details:

• The contestants are AI generated women made in any image generator. Gotta give them a name too.

• The winner receives $5,000, along with PR and mentorship opportunities for the top three finalists. (Virtual influencer stuff.)

• Judging criteria is more than looks. Contestants must interact through social media and act like a real person. Check out an example here.

• We’re basically having a bunch of sweaty dudes make robot girls and pretend to be those girls on the internet. 👏

• The contestant should ideally look realistic enough that you can’t tell if they’re human.

• We’re doomed once sex robots 🤖 hit the market.

Why it matters: I have nothing to say. Reality will only get weirder. No one should be surprised this is so popular. I expect virtual girlfriends to be a hot topic next year.

🚨 Microsoft’s Recall gets safety changes

What happened: Microsoft is revamping Recall’s safety measures after tons of criticism and literal hacks before the feature is publicly available.

The details: 

• First off, Recall will be switched off by default. (You could always turn it off though.)

• Biometrics will now be required to use Recall. Stuff like your fingerprint or voice. (But we can make AI voice clones… how do they stop that?)

• Users will need to enroll in Windows Hello in order to enable it. Basically a “proof of presence” in order to use it.

• Recall data will be encrypted, and only become decrypted once the user accesses the data through Windows Hello.

• Microsoft’s Recall will release publicly in about a week (from this writing). Oh boy.

Why this matters: Only time will tell if a security revamp is enough. Recall is inherently dangerous on a security level, but it’s also dangerous to our privacy. Who collects the data? Is Recall really “off” when we tell it to turn off? Let’s see what next week holds for Recall.

💁‍♀️ Bake your own Fake Instagram Model!

Yeah, all of these are made by Midjourney.

Source: Midjourney

Give us your feedback!

Got feedback? Rate today’s newsletter by clicking below! 

Got more personal feedback? Fill in the box when you rate us and give us your criticism and feedback.

Thank you for reading! 

❤️Share the (ARTIFICIAL) Love!

Got a friend who wants to appear as smart as you? An AI fanatic or someone shaking in their boots of getting replaced? Share us by clicking the link below and you’ll get our love ;)