Apple Executives on the Photos Overhaul in iOS 18 →

Linked By Federico Viticci

Alvin Cabral, writing for The National, got a nice quote from Apple’s Billy Sorrentino on the redesigned Photos app in iOS 18:

“As our features, users and libraries have grown, so has the density of the [Photos] app. So rather than hunt and peck throughout, we’ve created a simple streamlined single view photos experience based on deep intelligence,” Billy Sorrentino, senior director at Apple’s human interface design unit, told The National.

“Ultimately, we wanted to remove friction” in how Photos is used, he added.

It’s been a few weeks since I installed iOS 18 on my primary iPhone, and I feel pretty confident in saying this: I was wrong about the new Photos app at first.

I’ll reserve more in-depth comments for the public beta and final release of iOS 18; of course, given the drastic redesign of the app, there’s also a chance Apple may scrap their plans and introduce a safer update with fewer structural changes. However, over the past few weeks, I noticed that not only do I find myself discovering more old photos in iOS 18, but the modular approach of the more customizable Photos app really works for me. I was able to fine-tune the top carousel to my liking, and I customized pinned collections with shortcuts to my favorite sections. Put simply, because of these changes, I use the Photos app a lot more and find navigating it faster than before.

Anecdotally, when I showed my girlfriend the new Photos app, she argued that the single-page design should be nicer than iOS 17 since she never used the other tabs in the app anyway. I don’t think she’s alone in that regard, which is why I believe Apple should stick with this major redesign this time around.

Permalink

iPadOS 18 Adds Support for Formatting External Drives →

Linked By Federico Viticci

Nice find by Kaleb Cadle in the first beta of iPadOS 18:

Now in the Files app on iPadOS 18, when we right click or hold press on an external drive and select “Erase”, new options appear for reformatting the drive. Currently, the format options here are APFS, ExFAT, and MS-DOS (FAT), the same format options available in Disc Utility. This is a major improvement for iPad power users and it will be interesting to keep an eye out for new improvements to this functionality and others within the Files app over the course of the iPadOS 18 beta cycle. It seems Apple may be taking a similar tact to the way they incorporated much of the functionality of the Preview app into the Files app via Quick Look, but now with functionality from Disc Utility.

Check out the blog post for a screenshot of what the feature looks like. Given the growing number of handhelds that store their games (or OS) on SD cards that I have to manage for NPC now, I’m very glad I no longer have to use my Mac to reformat those drives.

Permalink

The Issues of iPadOS 18’s New Tab Bars →

Linked By Federico Viticci

Earlier today on Mastodon, I shared some concerns regarding the Books app in iPadOS 18 and how Apple implemented the new tab bar design in the app. Effectively, by eschewing a sidebar, the app has returned to feeling like a blown-up iPhone version – something I hoped we had left behind when Apple announced they wanted to make iPad apps more desktop-class two years ago.

Unfortunately, it gets worse than Books. As documented by Nico Reese, the developer of Gamery, the new tab bars seem to fall short of matching the previous design’s visual affordances as well as flexibility for developers. For starters, the new tabs are just text labels, which may work well in English, but not necessarily other languages:

Since the inception of the iPhone, tabs in a tab bar have always included a glyph and a label. With the new tab style, the glyphs are gone. Glyphs play a crucial role in UX design, allowing users to quickly recognize parts of the app for fast interaction. Now, users need to read multiple text labels to find the content they want, which is slower to perceive and can cause issues in languages that generally use longer words, such as German. Additionally, because tab bars are now customizable, they can even scroll if too many tabs are added!

You’ll want to check out Nico’s examples here, but this point is spot-on: since tab bars now sit alongside toolbar items, the entire UI can get very condensed, with buttons often ending up hidden away in an overflow menu:

Although Apple’s goal was to save space on the iPad screen, in reality, it makes things even more condensed. Apps need to compress actions because they take up too much horizontal space in the navigation bar. This constant adjustment of button placement in the navigation bar as windows are resized prevents users from building muscle memory. The smaller the window gets, the more items collapse.

If the goal was to simplify the iPad’s UI, well, now iPad users will end up with three ways to navigate apps instead of two, with the default method (the top bar) now generally displaying fewer items than before, without glyphs to make them stand out:

For users, it can be confusing why the entire navigation scheme changes with window resizing, and now they must adjust to three different variations. Navigation controls can be located at the top, the bottom, or the left side (with the option to hide the sidebar!), which may not be very intuitive for users accustomed to consistent navigation patterns.

The best way I can describe this UI change is that it feels like something conceived by the same people who thought the compact tab bar in Safari for iPad was a good idea, down to how tabs hide other UI elements and make them less discoverable.

Nico’s post has more examples you should check out. I think Marcos Tanaka (who knows a thing or two about iPad apps) put it well:

It makes me quite sad that one of the three iPad-specific features we got this year seems to be missing the mark so far. I hope we’ll see some improvements and updates on this front over the next three months before this feature ships to iPad users.

Permalink

Designing Dark Mode App Icons →

Linked By Federico Viticci

Apple’s announcement of “dark mode” icons has me thinking about how I would approach adapting “light mode” icons for dark mode. I grabbed 12 icons we made at Parakeet for our clients to illustrate some ways of going about it.

Before that though, let’s take some inventory. Of the 28 icons in Apple’s preview image of this feature, only nine have white backgrounds in light mode. However, all icons in dark mode have black backgrounds.

Actually, it’s worth noting that five “light mode” icons have black backgrounds, which Apple slightly adjusted to have a consistent subtle black gradient found on all of their new dark mode icons. Four of these—Stocks, Wallet, TV, and Watch—all seem to be the same in both modes. However, no other (visible) icons are.

Fantastic showcase by Louie Mantia of how designers should approach the creation of dark mode Home Screen icons in iOS 18. In all the examples, I prefer Mantia’s take to the standard black background version.

See also: Gavin Nelson’s suggestion, Apple’s Human Interface Guidelines on dark mode icons, and the updated Apple Design Resources for iOS 18.

Permalink

Apple Details Its AI Foundation Models and Applebot Web Scraping →

Linked By Federico Viticci

From Apple’s Machine Learning Research¹ blog:

Our foundation models are trained on Apple’s AXLearn framework, an open-source project we released in 2023. It builds on top of JAX and XLA, and allows us to train the models with high efficiency and scalability on various training hardware and cloud platforms, including TPUs and both cloud and on-premise GPUs. We used a combination of data parallelism, tensor parallelism, sequence parallelism, and Fully Sharded Data Parallel (FSDP) to scale training along multiple dimensions such as data, model, and sequence length.

We train our foundation models on licensed data, including data selected to enhance specific features, as well as publicly available data collected by our web-crawler, AppleBot. Web publishers have the option to opt out of the use of their web content for Apple Intelligence training with a data usage control.

We never use our users’ private personal data or user interactions when training our foundation models, and we apply filters to remove personally identifiable information like social security and credit card numbers that are publicly available on the Internet. We also filter profanity and other low-quality content to prevent its inclusion in the training corpus. In addition to filtering, we perform data extraction, deduplication, and the application of a model-based classifier to identify high quality documents.

It’s a very technical read, but it shows how Apple approached building AI features in their products and how their on-device and server models compare to others in the industry (on servers, Apple claims their model is essentially neck and neck with GPT-4-Turbo, OpenAI’s older model).

This blog post, however, pretty much parallels my reaction to the WWDC keynote. Everything was fun and cool until they showed generative image creation that spits out slop “resembling” (strong word) other people; and in this post, everything was cool until they mentioned how – surprise! – Applebot had already indexed web content to train their model without publishers’ consent, who can only opt out now. (This was also confirmed by Apple executives elsewhere.)

As a creator and website owner, I guess that these things will never sit right with me. Why should we accept that certain data sets require a licensing fee but anything that is found “on the open web” can be mindlessly scraped, parsed, and regurgitated by an AI? Web publishers (and especially indie web publishers these days, who cannot afford lawsuits or hiring law firms to strike expensive deals) deserve better.

It’s disappointing to see Apple muddy an otherwise compelling set of features (some of which I really want to try) with practices that are no better than the rest of the industry.

How long until this become the ‘Apple Intelligence Research’ website? ↩︎

Permalink

iOS and iPadOS 18: The MacStories Overview

By Federico Viticci

Image: Apple.

At its WWDC 2024 keynote held earlier today online and with an in-person event at Apple Park in Cupertino, California, Apple officially announced the next versions of the operating systems for iPhone and iPad – iOS and iPadOS 18.

As widely speculated in the lead up to the event, Apple’s focus for both OSes largely revolves around artificial intelligence, or as the company likes to refer to the AI acronym now, “Apple Intelligence”. The new AI features in iOS and iPadOS promise to make both operating systems, well, more intelligent than before thanks to a completely revamped Siri and proactive functionalities that learn from users’ habits and apps. Presented as a fast, private, and personal set of features that draws from the user’s context and combines it with generative models, Apple Intelligence – which will debut in U.S. English only later this year, with a beta expected later this summer – will power a variety of new system features and experiences, starting from a revamped Siri and text analysis features to image creation, performing actions inside apps, and more.

But AI-related improvements aren’t the only new features Apple announced today. From a renewed focus on Home Screen customization and redesigned Control Center to a new design for tab bars on iPad and expanded Tapbacks in Messages, Apple has showed that, while they can follow the rest of the tech industry in rethinking how AI can enhance how we use our devices, they can continue shipping other functionalities for iPhone and iPad, too. Or, at the very least, they certainly can for the iPhone and iOS.

We’ll have in-depth overviews for both iOS and iPadOS 18 when the public betas for each OS come out next month, and, of course, we’ll continue diving into the announcements later this week on MacStories via our WWDC 2024 hub as well as AppStories. We’ll also have a dedicated story about Apple Intelligence coming later on MacStories with the highlights of all the AI-infused features announced by Apple today.

In the meantime, here’s a recap of everything else that Apple showed today for iOS and iPadOS 18.

Apple Announces Vision Pro Launching in More Countries Later This Month

By Federico Viticci

During its WWDC 2024 keynote earlier today, Apple announced that the Vision Pro will be launching in more countries and regions later this month.

Specifically, the Vision Pro will become available for pre-order in China mainland, Hong Kong, Japan, and Singapore on June 13, with availability starting on Friday, June 28. On the same day, pre-orders will go live for customers in Australia, Canada, France, Germany, and the United Kingdom, with availability starting on Friday, July 12.

From Apple’s announcement:

“The enthusiasm for Apple Vision Pro has been extraordinary, and we are thrilled to introduce the magic of spatial computing to more customers around the world,” said Tim Cook, Apple’s CEO. “We can’t wait for more people to see the impossible become possible, whether working and collaborating with an infinite canvas for apps, reliving treasured memories in three dimensions, watching TV shows and movies in a one-of-a-kind personal cinema, or enjoying brand-new spatial experiences that defy imagination.”

In addition to announcing availability in more countries and regions, Apple also showcased visionOS 2, the next major update to the Vision Pro’s operating system. Highlights from visionOS 2 include new gestures to invoke the Home Screen and Control Center, train Travel Mode, mouse support, and more. We’ll cover all the changes in visionOS 2 in a more detailed overview later today.

You can follow all of our WWDC coverage through our WWDC 2024 hub or subscribe to the dedicated WWDC 2024 RSS feed.

Josh King Built the iPhone Game Controller No One Wants to Make →

Linked By Federico Viticci

I love this story that I first saw mentioned on Brendon’s blog a few weeks ago about a Redditor who designed the iPhone game controller of my (our?) dreams.

Picture this: it’s a PSP Go/Xperia Play-styled, slide-out controller that attaches via MagSafe to any iPhone, has Bluetooth, a USB-C port for charging, and therefore works with any modern iOS game or emulator regardless of whether the iPhone is mounted on it or not. The controller has a built-in kickstand that supports landscape and portrait gaming (the latter is essential for DS emulation in Delta) and is much more portable than other snap-on solutions available for iOS devices.

The best part: the creator of this controller, called the M-Con, has announced plans to make this a real product that you can buy in the future. You can watch the announcement video below:

As Jonathan’s story in last Saturday’s issue of MacStories Weekly showed, the dream for many of us right now is a compact, MagSafe-enabled game controller for iPhone that doesn’t use USB-C and allows the iPhone to be rotated. No official product that is not a 3D-printed adapter or DIY hack that does all that exists right now.

I wish Josh all the best in this adventure, and I hope to be able to purchase an M-Con game controller in the near future.

Permalink

Introducing the Latest MacStories Podcasts: Next Portable Console and Comfort Zone

By Federico Viticci

NPC and Comfort Zone join the MacStories family of podcasts.

I’m incredibly excited to introduce two brand new shows joining the MacStories family of podcasts today: Next Portable Console (or NPC), hosted by me, Brendon Bigley, and John Voorhees, and Comfort Zone, hosted by Niléane Dorffer, Chris Lawley, and Matt Birchler. You can find both shows, along with links to subscribe, on MacStories’ Podcasts hub.

Before I hand it over to Brendon and Niléane to provide more context around NPC and Comfort Zone, allow me to say a few words since this launch marks an important milestone in MacStories’ growth for the next 15 years of the website.