Skip to main content
Part of complete coverage on

Are you happy or sad? New smartphone app maps your mental state

The Xpression app phone display, with the bottom box detailing the emotion analyzed as present in the speech sample.
The Xpression app phone display, with the bottom box detailing the emotion analyzed as present in the speech sample.
STORY HIGHLIGHTS
  • New smartphone app allows users to record their mood through their speech acoustics
  • The app is designed to be used in the clinical treatment of stress and depression
  • It could replace manually-recorded "mood diaries", which patients often leave incomplete
  • App may also appeal to consumers interested in self-tracking technology

London (CNN) -- A British firm is developing an app that will allow smartphones to track their owners' moods through their speech patterns, in the hope it can improve aspects of mental health treatment.

The app, known as Xpression, will record the user's voice throughout the day, whether they are making a phone call or not, analyzing the acoustics for emotional content.

Matt Dobson, co-founder of EI Technologies, said the app was designed to provide a more objective, reliable record of patient's emotions than "mood diaries" currently used in the treatment of people with anxiety, depression or stress.

"Over half of adults in the UK suffer from severe stress once or twice a week so there's a lot of opportunity in the market," he said.

This is the turbo-charged version of manually recording your emotions
Matt Dobson, co-founder of EI Technologies

"I wanted to know: could we bring something into the market that would help people sort out their stress and depression and anxiety? ... I found that voice-based recognition was something that would work on a smartphone."

Psychologists often ask patients to keep track of changes in their emotional state by noting them down in mood diaries, he said, but medical literature suggests only 30-50% of patients provided enough information in their diaries to be useful in treatment.

"This replaces that old technology. This is the turbo-charged version of manually recording your emotions," he said.

Harvesting rubber from dandelions
The bionic hand with the human touch
Invention makes objects liquid repellent
'Credit card computer' enhances learning
How Tetra Pak took over the world

Tracey Parsons, a clinical psychologist working as clinical adviser on the project, said the major problem with mood diaries was that people simply don't fill them in.

"They don't believe they'll be useful and it's too much of a hassle, or they're so unable to recognize their own feelings that they struggle to complete them," she said.

The app, which would activate when it recognized the user's voice, would provide the patient and psychologist a more complete record of changes in emotion and mood, allowing the patient to get a better sense of their emotional triggers.

"It's useful to have that to allow you to think: 'How did I react? What was I thinking? Why did I get so angry about it?'" says Parsons.

"This would allow for more effective use of mental health services, making the app a potentially attractive proposition for health systems around the world," she said.

Read also: Harvesting rubber from dandelions

The app does not record the speaker's words, said Dobson, but rather monitors the acoustic elements of their speech -- such as volume, intensity, pace and pitch -- to take an emotional reading.

"We look for acoustic features within your words. We don't know what you're saying," he said.

Snapshots of the user's acoustic patterns were sent to a remote server, where the user's emotional state would be calculated by a machine-learning system.

Professor Stephen Cox, head of the speech processing laboratory at the University of East Anglia and scientific adviser to the project, said the technology was made possible due to advances in machine-learning algorithms.

"This is an area called paralinguistics where one is extracting things from the voice which are not said verbally but convey meaning -- one being emotion," he said.

All we need to do is collect lots of angry speech or happy speech. We show them to the classifier and the algorithm sorts it out
Professor Stephen Cox, head of the speech processing laboratory at the University of East Anglia

"All we need to do is collect lots of angry speech or happy speech. We show them to the classifier and the algorithm sorts it out."

Dobson said one of the biggest unknowns facing the project was how willing patients would be to expose themselves to constant monitoring through their phones -- even though only data relating to the acoustics, rather than the words themselves, would be recorded.

"What we don't know is: 'How intrusive is that? What's the trust required to do this?'"

However, he saw the app as belonging to a group of existing smartphone products that monitored the human body, such as jogging or sleep monitors, which had gained widespread acceptance. The apps were a product of the "Quantified Self" movement, which saw users employ self-tracking technologies to gain a better sense of how their bodies responded to different inputs.

He said if a consumer version of the app was released, targeting those interested in self-tracking, it could hit the market in the second half of the year. An app suitable for use by mental health services would take a little longer due to testing requirements, he said.

ADVERTISEMENT
Part of complete coverage on
April 26, 2013 -- Updated 1341 GMT (2141 HKT)
More than 10 billion USB sticks are believed to be in use around the world today ensuring co-inventor, Ajay Bhatt, has a place in tech's unofficial hall of fame.
April 16, 2013 -- Updated 2007 GMT (0407 HKT)
The AOptix wrap-around device turns an iPhone 4 or 4S into a portable iris, face, fingerprint and voice scanner.
A California tech company has launched a tool that turns a regular iPhone 4 or 4S into a powerful biometrics scanning tool.
April 12, 2013 -- Updated 1757 GMT (0157 HKT)
Inventor Greg Dash holds the world's smallest digital fisheye camera.
What's four centimeters long, two centimeters high and smaller than the average thumb? The "Little Cyclops" fisheye camera.
March 14, 2013 -- Updated 1242 GMT (2042 HKT)
They are a formidable new force in the tech world -- tween developers with world-class coding skills and firsthand insights into the games kids really want to play.
February 15, 2013 -- Updated 1618 GMT (0018 HKT)
The rubber from dandelion roots could be on your car wheels before the decade is out. CNN's Nick Glass visits the Dutch firm pioneering the effort.
February 22, 2013 -- Updated 1734 GMT (0134 HKT)
The notion of self-healing materials might sound a bit "Terminator" -- but the first versions of the technology are destined to hit the market in 2013.
February 1, 2013 -- Updated 1611 GMT (0011 HKT)
CNN's Nick Glass meets David Gow, inventor of the i-limb -- a revolutionary prosthetic hand which is changing lives.
January 18, 2013 -- Updated 1452 GMT (2252 HKT)
British tech firm P2i has developed a "liquid repellent nano-coating" that can be sprayed onto a solid surface and repels nearly all liquids.
January 8, 2013 -- Updated 1743 GMT (0143 HKT)
In a world where computers are increasingly powerful and flashy, the Raspberry Pi offers surprising proof for the virtue of moderation.
December 7, 2012 -- Updated 2247 GMT (0647 HKT)
Watching Peter Dearman at work amid the clutter of his workshop, it's easy to see why one of his sons refers to him as a "nutty professor."
November 29, 2012 -- Updated 1804 GMT (0204 HKT)
An Afghan designer has developed a low-cost, wind-powered, mine-detonating device inspired by the toys he played with as a child.
November 23, 2012 -- Updated 1032 GMT (1832 HKT)
A toy helicopter controlled by nothing but brainwaves could be available to the public just in time to hover under this year's Christmas tree.
October 26, 2012 -- Updated 0802 GMT (1602 HKT)
An iPhone encased in sugru to protect it from droppage and spillages
It´s the ultimate repair tool. A silicone material which molds like playdough, bonds to almost any surface before becoming a super-strong, durable rubber.
ADVERTISEMENT