Hey Google, what's this rash? Google unveils AI tool that can identify 288 skin conditions including warts, cysts and lipoma from just THREE photos

 Google has revealed an artificial intelligence (AI)-powered tool that can identify 288 different skin conditions, including warts, cysts and lipoma. 

The tool, which Google hopes to launch as a pilot later this year, will let users take and submit three images of an area of concern – either skin, hair or nails – from different angles. 

They'll then be asked questions about skin type, how long they've had the issue and other symptoms to give a list of possible matching conditions. 


The tool, revealed at Google's I/O developer conference, has been trained with around 65,000 images of diagnosed skin conditions, as well as millions of other images of concern and thousands of examples of healthy skin.  

Google stressed that the tool is not intended to provide a diagnosis nor be a substitute for medical advice, but rather help users make a 'more informed decision' about whether to go to a doctor.  

The AI-powered 'dermatology assist' tool is a web-based application. Once launched, users will be able to aim their phone¿s camera to take three images of the skin. The AI analyses photos and draws from its knowledge of 288 conditions to give  possible matching conditions

The AI-powered 'dermatology assist' tool is a web-based application. Once launched, users will be able to aim their phone's camera to take three images of the skin. The AI analyses photos and draws from its knowledge of 288 conditions to give  possible matching conditions


'Each year we see almost ten billion Google Searches related to skin, nail and hair issues,' Google said in a blog post

'Two billion people worldwide suffer from dermatologic issues, but there's a global shortage of specialists. 

'While many people's first step involves going to a Google Search bar, it can be difficult to describe what you're seeing on your skin through words alone.

'Our AI-powered dermatology assist tool is a web-based application that we hope to launch as a pilot later this year, to make it easier to figure out what might be going on with your skin.'

Google said the tool accounts for factors like age, sex, race and skin types, from 'pale skin that does not tan to brown skin that rarely burns'. 

For each matching condition, it will show dermatologist-reviewed information and answers to commonly asked questions, along with similar matching images from the internet.  

The product has been given a CE marking as a Class I medical device for a release in Europe, but it has not been evaluated by the US Food and Drug Administration (FDA).  

Google said its creation is the culmination of over three years of machine learning research and product development.  

The company's researchers already detailed the system in a scientific paper published last year in Nature Medicine

A more recent study from this year, published in JAMA Network Open, also demonstrated its ability to help improve skin condition diagnoses by primary care physicians and nurse practitioners. 

Using Google to self-diagnose has been a point of contention, as it can throw up misleading results and contribute to missed diagnoses. 

Doctors have advised against using Google in an attempt to self-diagnose a potential condition (stock image)

Doctors have advised against using Google in an attempt to self-diagnose a potential condition (stock image) 

Acknowledging this, the tech giant said: 'The tool is not intended to provide a diagnosis nor be a substitute for medical advice as many conditions require clinician review, in-person examination, or additional testing like a biopsy. 

'Rather we hope it gives you access to authoritative information so you can make a more informed decision about your next step.' 

Experts have previously suggested that researching symptoms on Google makes conditions appear worse than they actually are. 

In an interview with Pulse magazine in 2017, Professor Helen Stokes-Lampard, chair of the Royal College of GPs said: 'Dr Google enters 80 per cent of consultations that I have now. 

'I feel we need to raise that particularly with patients... and we have to work with it and we have to be bold and that's a challenge for all of us I think.' 

'I have patients all the time where the only reason they come into my office is because they Googled something and the Internet said they have cancer,' said paper author and clinician David Levine of Brigham and Women's Hospital in Boston

'I have patients all the time where the only reason they come into my office is because they Googled something and the Internet said they have cancer,' said paper author and clinician David Levine of Brigham and Women's Hospital in Boston

However, a surprising study from earlier this year found volunteers were slightly better at diagnosing ailments correctly after performing an internet search for the corresponding symptoms.

The findings flew in the face of the commonly-given advice to avoid consulting 'Dr Google' before visiting a GP's clinic.

'I have patients all the time where the only reason they come into my office is because they Googled something and the Internet said they have cancer,' said study author and clinician David Levine of Brigham and Women's Hospital in Boston.

'I wondered, "Is this all patients? How much cyberchondria is the Internet creating?"'

Also at the I/O developer conference this week, Google revealed Docs will start to suggest edits to prompt people to use gender-free language.

These include writing 'mail carrier' instead of 'mailman' and 'chairperson' instead of 'chairwoman'. 


Hey Google, what's this rash? Google unveils AI tool that can identify 288 skin conditions including warts, cysts and lipoma from just THREE photos Hey Google, what's this rash? Google unveils AI tool that can identify 288 skin conditions including warts, cysts and lipoma from just THREE photos Reviewed by Your Destination on May 19, 2021 Rating: 5

No comments

TOP-LEFT ADS