Hardware

OxSight uses augmented reality to aid the visually impaired

Comment

[tc_unified_video code=”f797b0c8-5bfd-3928-9970-948a1c2364ab”]

One percent of the world’s population, approximately 70 million people, are blind.

That is not a huge number when you think of it in terms of a potential use base for a consumer product, but it is massive when you consider that there are currently few assistive technologies available as an aid to make easier the lives of the visually impaired.

A new startup that spun out of Oxford last year, OxSight, is looking to change that. The company built and is testing augmented reality glasses to help the visually impaired recognize and navigate objects in their environment. Think of it as a hearing aid for the blind.

OxSight is a potential replacement for canes and seeing-eye dogs. Those give you immediate localization of obstacles near you, but don’t give you a sense of awareness of the environment that you are in.

Most of the people who have tested the OxSight previously had some level of sight that has degraded over time. The product uses the sight they still have, whether it’s detection of light, movement or a small amount of shape, and amplifies it inside a pair of augmented reality glasses.

Nothing is hooked into the brain and the hardware doesn’t interact with the eyeball. Instead, the OxSight smart glasses rely on technologies like see-through displays, camera systems and computer vision techniques that have been developed for augmented reality to understand the environment.

OxSight layers different Prisma-esc modes and that can be adjusted using hand controls.
OxSight layers different Prisma-esque modes that can be adjusted using hand controls.

“Once you start to lose your sight, it really becomes difficult to differentiate between say a foreground object and a background one,” says founder Dr. Stephen Hicks, a neuroscientist specializing in physical control. “They kind of blur together. But with our project, what we can do is identify a certain class of object and make them stand out. So it enables them to be more intuitive and more interactive in the way they deal with the world and really make use of that small amount of sight that most people who are blind still have.”

The brain processes three-dimensional space similar to how modern gaming cameras map and define the difference between the floor, a couch and a wall, for example. They identify the larger objects and figures out the relation between them and the user. Using this concept of mapping and how the brain already works, OxSight adds cartoon-like layers to the user’s surroundings.

For people with minimal vision, the software can project a cardboard cutout of what a person looks like. Users who are blind but still have limited vision can customize their experience by boosting colors or zooming in or out. Because each person who is considered blind is affected differently, OxSight built a product that can be adjusted and customized to allow each unique user to understand where they are and what is around them.

A research participant wearing OxSight while bowling.
A research participant wearing OxSight while bowling.

“So the person can see the world as they normally do, but then in a sense you get an aura on certain types of objects, which say in the dark are really handy for recognizing a doorway or an obstacle or say something you want to avoid,” Hicks said. “So we can highlight the edges of that to make them really stand out so that you can really quickly and intuitively pick it up. A lot of these technologies to help people who are blind require a huge amount of learning, like trying to understand the world around them as a sense of sound. That’s just a complex thing that is really difficult.”

After trying OxSight’s glasses for the first time, most people comment about the freedom of movement it gives them and their ability to go out with more confidence and go to dark places like bars and restaurants, where sight would be limited. To many, the ability to see their families faces again and interact with them has been especially powerful, especially for those who never thought they’d be able to have that experience again.

The attached battery pack can be worn over the shoulder and has hand controls for adjusting to different lighting and settings.
The attached battery pack can be worn over the shoulder and has hand controls for adjusting to different lighting and settings.

There are a lot of unknowns about how to bring the product to market or how much it will cost because no one has ever tried to sell a device like this. OxSight has secured grants from private and public sources and has found an investor willing to take on the philanthropic risk. “If we don’t make a huge amount of money it is still a lot of fun. There is still a lot of technology we’ll be developing and there is so many people who can benefit from it,” said Hicks.

Currently, the company’s biggest obstacle is figuring out what minimum viable product is and bringing it to market. There are a lot of regulations for medical devices. The product must address specific needs, like recognition of objects, form factor and lasting battery life that aren’t being offered in consumer areas. Focusing in on helping the visually impaired people, OxSight plans to build a platform that will address these needs, but also grow with the advancement of future hardware. Eventually, Hicks believes, they can use the same underlying AR technologies to explore dementia, autism and even dyslexia.

More TechCrunch

iOS 18 will be available in the fall as a free software update.

Here are all the devices compatible with iOS 18

The tests indicate there are loopholes in TikTok’s ability to apply its parental controls and policies effectively in a situation where the teen user originally lied about their age, as…

TikTok glitch allows Shop to appear to users under 18, despite adults-only policy

Lhoopa has raised $80 million to address the lack of affordable housing in Southeast Asian markets, starting with the Philippines.

Lhoopa raises $80M to spur more affordable housing in the Philippines

Former President Donald Trump picked Ohio Senator J.D. Vance as his running mate on Monday, as he runs to reclaim the office he lost to President Joe Biden in 2020.…

Trump’s VP candidate JD Vance has long ties to Silicon Valley, and was a VC himself

Hello and welcome back to TechCrunch Space. Is it just me, or is the news cycle only accelerating this summer?!

TechCrunch Space: Space cowboys

Apple Intelligence features are not available in the developer beta, which is out now.

Without Apple Intelligence, iOS 18 beta feels like a TV show that’s waiting for the finale

Apple released the public betas for its next generation of software on the iPhone, Mac, iPad and Apple Watch on Monday. You can now test out iOS 18 and many…

Apple’s public betas for iOS 18 are here to test out

One major dissenter threatens to upend Fisker’s apparent best chance at offloading its unsold EVs, a deal that would keep the startup’s bankruptcy proceeding alive and pave the way for…

Fisker has one major objector to its Ocean SUV fire sale

Payments giant Stripe has delayed going public for so long that its major investor Sequoia Capital is getting creative to offer returns to its limited partners. The venture firm emailed…

Major Stripe investor Sequoia confirms $70B valuation, offers its investors a payday

Alphabet, Google’s parent company, is in advanced talks to acquire Wiz for $23 billion, a person close to the company told TechCrunch. The deal discussions were previously reported by The…

Google’s Kurian approached Wiz, $23B deal could take a week to land, source says

Name That Bird determines individual members of a species by identifying distinguishing characteristics that most humans would be hard-pressed to spot.

Bird Buddy’s new AI feature lets people name and identify individual birds

YouTube Music is introducing two new ways to boost song discovery on its platform. YouTube announced on Monday that it’s experimenting with an AI-generated conversational radio feature, and rolling out…

YouTube Music is testing an AI-generated radio feature and adding a song recognition tool

Tesla had internally planned to build the dedicated robotaxi and the $25,000 car, often referred to as the Model 2, on the same platform.

Elon Musk confirms Tesla ‘robotaxi’ event delayed due to design change

What this means for the space industry is that theory has become reality: The possibility of designing a habitation within a lunar tunnel is a reasonable proposition.

Moon cave! Discovery could redirect lunar colony and startup plays

Get ready for a prime week of savings at TechCrunch Disrupt 2024 with the launch of Disrupt Deal Days! From now to July 19 at 11:59 p.m. PT, we’re going…

Disrupt Deal Days are here: Prime savings for TechCrunch Disrupt 2024!

Deezer is the latest music streaming app to introduce an AI playlist feature. The company announced on Monday that a select number of paid users will be able to create…

Deezer chases Spotify and Amazon Music with its own AI playlist generator

Real-time payments are becoming commonplace for individuals and businesses, but not yet for cross-border transactions. That’s what Caliza is hoping to change, starting with Latin America. Founded in 2021 by…

Caliza lands $8.5 million to bring real-time money transfers to Latin America using USDC

Adaptive is a platform that provides tools designed to simplify payments and accounting for general construction contractors.

Adaptive builds automation tools to speed up construction payments

When VanMoof declared bankruptcy last year, it left around 5,000 customers who had preordered e-bikes in the lurch. Now VanMoof is up and running under new management, and the company’s…

How VanMoof’s new owners plan to win over its old customers

Mitti Labs aims to transform rice farming in India and other South Asian markets by reducing methane emissions by 50% and water consumption by 30%.

Mitti Labs aims to make rice farming less harmful to the climate, starting in India

This is a guide on how to check whether someone compromised your online accounts.

How to tell if your online accounts have been hacked

There is a general consensus today that generative AI is going to transform business in a profound way, and companies and individuals who don’t get on board will be quickly…

The AI financial results paradox

Google’s parent company Alphabet might be on the verge of making its biggest acquisition ever. The Wall Street Journal reports that Alphabet is in advanced talks to acquire Wiz for…

Google reportedly in talks to acquire cloud security company Wiz for $23B

Featured Article

Hank Green reckons with the power — and the powerlessness — of the creator

Hank Green has had a while to think about how social media has changed us. He started making YouTube videos in 2007 with his brother, novelist John Green, at a time when the first iPhone was in development, Myspace was still relevant and Instagram didn’t exist. Seventeen years later, posting…

Hank Green reckons with the power — and the powerlessness — of the creator

Here is a timeline of Synapse’s troubles and the ongoing impact it is having on banking consumers. 

Synapse’s collapse has frozen nearly $160M from fintech users — here’s how it happened

Featured Article

Helixx wants to bring fast-food economics and Netflix pricing to EVs

When Helixx co-founder and CEO Steve Pegg looks at Daisy — the startup’s 3D-printed prototype delivery van — he sees a second chance. And he’s pulling inspiration from McDonald’s to get there.  The prototype, which made its global debut this week at the Goodwood Festival of Speed, is an interesting proof…

Helixx wants to bring fast-food economics and Netflix pricing to EVs

Featured Article

India clings to cheap feature phones as brands struggle to tap new smartphone buyers

India is struggling to get new smartphone buyers, as millions of Indians don’t go for an upgrade and continue to be on feature phones.

India clings to cheap feature phones as brands struggle to tap new smartphone buyers

Roboticists at The Faboratory at Yale University have developed a way for soft robots to replicate some of the more unsettling things that animals and insects can accomplish — say,…

Meet the soft robots that can amputate limbs and fuse with other robots

Featured Article

If you’re an AT&T customer, your data has likely been stolen

This week, AT&T confirmed it will begin notifying around 110 million AT&T customers about a data breach that allowed cybercriminals to steal the phone records of “nearly all” of its customers. The stolen data contains phone numbers and AT&T records of calls and text messages during a six-month period in…

If you’re an AT&T customer, your data has likely been stolen

In the first half of 2024 alone, more than $35.5 billion was invested into AI startups globally.

Here’s the full list of 28 US AI startups that have raised $100M or more in 2024