top of page
![title background3.png](https://static.wixstatic.com/media/9f3ba2_3bf0348db0d447349eef2210ace6dd67~mv2.png/v1/fill/w_49,h_20,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/9f3ba2_3bf0348db0d447349eef2210ace6dd67~mv2.png)
Memory:
Machine learning for the elderly
In the reflection of apply hi-tech to real life, I looked into minor groups of people - the elderly, and exploration on how they can benefit from machine learning in psychological aspects.
Design Brief
Responsibilities and Skills
Product Designer
User Research
Quick Draft
Mock-up and Testing
CMF
Digital 3D Development
This is project focuses on care for elder people. Through research, I find that although there are diverse products in the current market which do aware of the inconvenience of elder people, however, there is little attention paid to their psychological aspects. Therefore, from the perspective of the users, I designed a interactive device which based on machine learning and can provide more emotion care for the elder.
Project Type
Timeline and Teams
2018.
Solo work
thesis project
General Background
![Asset 4_4x.png](https://static.wixstatic.com/media/9f3ba2_2c0165daf4274feabc48ed868f1ebaa8~mv2.png/v1/fill/w_163,h_163,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%204_4x.png)
In cities, over 50% elders live alone or with their couples.
We call them “empty nest”.*
![Asset 5_4x.png](https://static.wixstatic.com/media/9f3ba2_1d39e659b8294e839fab7d0dbd45c33b~mv2.png/v1/fill/w_163,h_163,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%205_4x.png)
Over 20% elder people aged more than 60 are suffering from mental or neurological disorder.*
![Asset 6_4x.png](https://static.wixstatic.com/media/9f3ba2_a793e2bd041945258fde47d7ddea0501~mv2.png/v1/fill/w_163,h_163,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%206_4x.png)
Mental health has an impact on physical health and vice versa.*
![Asset 7_4x.png](https://static.wixstatic.com/media/9f3ba2_b0da1899dc1e47818231adb288b280e8~mv2.png/v1/fill/w_163,h_163,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%207_4x.png)
However, mental health problems are always ignored by doctors and family. Elder people usually do not tend to admit it.
Observation
I spent two days staying with my friends' grandma who live alone. Here are some moment inspire me most.
![Asset 9_4x.png](https://static.wixstatic.com/media/9f3ba2_2ce084b600574da0ac7d7c358d1babed~mv2.png/v1/fill/w_55,h_39,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%209_4x.png)
Most time of the day, she just in a chair with silence or listen to radio.
![Asset 10_4x.png](https://static.wixstatic.com/media/9f3ba2_6cfe9f3aeff84bd7aad9d74436d117e4~mv2.png/v1/fill/w_54,h_39,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2010_4x.png)
Except for chating with her sister who is also live alone, she has no chance to communicate with people.
![Asset 12_4x.png](https://static.wixstatic.com/media/9f3ba2_afb836ca1a534a34a541c4786bd0e625~mv2.png/v1/fill/w_52,h_39,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2012_4x.png)
she collects old photos carefully and always take them out to have a look.
![Asset 11_4x.png](https://static.wixstatic.com/media/9f3ba2_6640384abd7f4d2b9fa597bbde9c1ce5~mv2.png/v1/fill/w_59,h_39,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2011_4x.png)
As we get familiar, she shares a lot of memories with me, from her primary school to now.
Survey about those behavious
To confirm those behaviours, I prepare four problems and chat with 40 elderly people met in 2 parks
![Asset 13_4x.png](https://static.wixstatic.com/media/9f3ba2_89e16ab904b74787a8ab97d86b629f64~mv2.png/v1/fill/w_158,h_96,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2013_4x.png)
How do you think of your life? full of variety? simple ? or is it boring?
![Asset 14_4x.png](https://static.wixstatic.com/media/9f3ba2_93dc4c06c94e46d7858f3b3a4804a13d~mv2.png/v1/fill/w_126,h_114,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2014_4x.png)
Do you often have chance to talk to others?
How often do you watch old photo?
![Asset 15_4x.png](https://static.wixstatic.com/media/9f3ba2_16c73329e90d4079a21fc6fb401ea959~mv2.png/v1/fill/w_173,h_172,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2015_4x.png)
![Asset 16_4x.png](https://static.wixstatic.com/media/9f3ba2_a51a533d98514d0b93082a974e361dc4~mv2.png/v1/fill/w_176,h_141,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2016_4x.png)
Why do you watch old photos
Journey map: How an elderly living alone passes her daytime
![交互17all wix-17.png](https://static.wixstatic.com/media/9f3ba2_0ac60b03a9674a73b7a2442e01424188~mv2.png/v1/fill/w_49,h_27,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/%E4%BA%A4%E4%BA%9217all%20wix-17.png)
What people say VS What Data says
![Asset 18_4x.png](https://static.wixstatic.com/media/9f3ba2_ea213cb79fd442e5811068e669c8445c~mv2.png/v1/fill/w_118,h_91,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2018_4x.png)
It’s unecessary for elderly people to share things about past with their families.
![Asset 17_4x.png](https://static.wixstatic.com/media/9f3ba2_694f4c6a59bb4377a3c0318db4e5a37b~mv2.png/v1/fill/w_98,h_63,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2017_4x.png)
The following is a psychological experient which focus on depression elder. The comparison group utilized the traditional treatment methods. On the contrary, the experimental group made use of old objects to help awake the awareness of the elder about the past. here is the result. Y refers to the degree of depression level. The higher the number, the more negative feelings they hold.
But look into past with the company of old photo is so good for elderly people’s mental health.
How might we
Create a warm heart experience for elderly people who like to watch old photos?
What they need
![Asset 19_4x.png](https://static.wixstatic.com/media/9f3ba2_b3c7da147d8a43cfb72fa44ac3b39ea2~mv2.png/v1/fill/w_77,h_44,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2019_4x.png)
Sympathetic
Seeking resonance is human instinct. Old people living alone have few friends, there is little information that resonates with them. They are eager to resonate.
![Asset 20_4x.png](https://static.wixstatic.com/media/9f3ba2_47dca83b542d4c77922f6a298557ebcc~mv2.png/v1/fill/w_78,h_44,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2020_4x.png)
Companion
The reason why elder people often turn on thee radio and TV when they are at home lies in that they hope to get a sense of companionship.
![Asset 21_4x.png](https://static.wixstatic.com/media/9f3ba2_84b42afc38fe4a6fae93a18abcd0f8f3~mv2.png/v1/fill/w_82,h_44,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2021_4x.png)
Fresh information
Monotonous life, boring TV shows make them more lonely. Fresh information can also help their mental health
How we do
The device can automatically identify the life tracks of the elders and then help to find friends who share the same experience with themselves.
![Asset 22_4x.png](https://static.wixstatic.com/media/9f3ba2_c95d8ca68757497590fac02a01f3030f~mv2.png/v1/fill/w_101,h_78,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2022_4x.png)
Elderly people put photos in a “box”
![Asset 24_4x.png](https://static.wixstatic.com/media/9f3ba2_fd4f8474094d419eaeabf85560326d1d~mv2.png/v1/fill/w_72,h_81,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2024_4x.png)
This box will play the photos as well as the corresponding songs of that age
Technology support: Machine learning
Public sources can provide large numbers of digitally archived photos taken over the past century with known dates, it’s relatively straight forward to obtain labeled data (dated photos, in this case) with which to train this network. Once the network is trained, we can feed in a photo, and we get out the year in which the system guesses it was taken.
![Asset 25_4x.png](https://static.wixstatic.com/media/9f3ba2_f902877734a24415badd1fe83aef3f2c~mv2.png/v1/fill/w_48,h_14,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2025_4x.png)
Input image
Convolution
Max pooling
“Fully Connected” Network
Output
2D Development
![交互20all wix-20.png](https://static.wixstatic.com/media/9f3ba2_fd96c3ccd8414cf286cd2496d1f0508e~mv2.png/v1/crop/x_0,y_99,w_1755,h_888/fill/w_49,h_25,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/%E4%BA%A4%E4%BA%9220all%20wix-20.png)
Mockup testing and feedback
In order to make sure whether my design was in line with the ergonomics principles, as well as whether the buttons are comprehensible enough for the elder to use, I made a paper model. During the test, I told the grandma that it is a device which can automatically play music through identifying the information behind photos. Then, I observed the methods she used to put the music on and other actions.
![Asset 28_4x.png](https://static.wixstatic.com/media/9f3ba2_8a0256adb7e947ffb19bebf0a7aede3e~mv2.png/v1/fill/w_147,h_107,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2028_4x.png)
![Asset 27_4x.png](https://static.wixstatic.com/media/9f3ba2_44501fb0b0074220bb72fbc3d9464762~mv2.png/v1/fill/w_146,h_107,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2027_4x.png)
![Asset 26_4x.png](https://static.wixstatic.com/media/9f3ba2_911c4d827e22473ea1570f7b4bf79c53~mv2.png/v1/fill/w_133,h_107,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2026_4x.png)
![Asset 29_4x.png](https://static.wixstatic.com/media/9f3ba2_834c6984c3634d5485758cd7c4b4caea~mv2.png/v1/fill/w_146,h_107,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2029_4x.png)
![Asset 32_4x.png](https://static.wixstatic.com/media/9f3ba2_45426eeacae94e2c85aada159b48bed7~mv2.png/v1/fill/w_67,h_50,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2032_4x.png)
she quickly found the mouth and put the photo inside.
![Asset 30_4x.png](https://static.wixstatic.com/media/9f3ba2_624442b62453480da49325f1d076558b~mv2.png/v1/fill/w_67,h_51,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2030_4x.png)
However, she did not know how to make the music stop
![Asset 31_4x.png](https://static.wixstatic.com/media/9f3ba2_a6744b30821f45febea73a88ac2e6ebe~mv2.png/v1/fill/w_65,h_49,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2031_4x.png)
She thought the mouth was little bit wide.
![Asset 34_4x.png](https://static.wixstatic.com/media/9f3ba2_620625c0d51942f9ad55c8c25e7a6892~mv2.png/v1/fill/w_189,h_189,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2034_4x.png)
The switches should differ from each other
![Asset 36_4x.png](https://static.wixstatic.com/media/9f3ba2_0cfe150937724c12a3c6b310bd73750d~mv2.png/v1/fill/w_189,h_189,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2036_4x.png)
The surface should be more slope
![Asset 33_4x.png](https://static.wixstatic.com/media/9f3ba2_37badc45f4f44e77a52c0af01d5f588c~mv2.png/v1/fill/w_189,h_189,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2033_4x.png)
The mouth is too loose
![Asset 35_4x.png](https://static.wixstatic.com/media/9f3ba2_896434c18bcc4227a53888bd9b0eef41~mv2.png/v1/fill/w_189,h_189,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%2035_4x.png)
The buttons for volume and channel turning can not differ from each other
Ideation
![Asset 38_4x.png](https://static.wixstatic.com/media/9f3ba2_06e0762d005642f9872d8b9a09d9330b~mv2.png/v1/fill/w_56,h_47,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2038_4x.png)
![Asset 37_4x.png](https://static.wixstatic.com/media/9f3ba2_eacd3ee683344a2ca2ba997c9d8df4f0~mv2.png/v1/fill/w_120,h_111,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2037_4x.png)
CMF inspiration
3D development
![Asset 1_4x.png](https://static.wixstatic.com/media/9f3ba2_4c67954447eb4a68a3fea1a40438ca7e~mv2.png/v1/fill/w_86,h_48,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%201_4x.png)
![Asset 4_4x.png](https://static.wixstatic.com/media/9f3ba2_7d9bfc8722c94484a6f97a15e5ed311f~mv2.png/v1/fill/w_55,h_39,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%204_4x.png)
![Asset 5_4x.png](https://static.wixstatic.com/media/9f3ba2_b218a441571849b584ef381e329f220a~mv2.png/v1/fill/w_52,h_69,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%205_4x.png)
Volume
![Asset 6_4x.png](https://static.wixstatic.com/media/9f3ba2_8be0738bbd9d47afa704f0b59a9cb6ac~mv2.png/v1/fill/w_66,h_63,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%206_4x.png)
Channel turning
![Asset 7_4x.png](https://static.wixstatic.com/media/9f3ba2_fcb505eac6124935a1204be474ef9d81~mv2.png/v1/fill/w_61,h_93,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%207_4x.png)
Switch
![Asset 8_4x.png](https://static.wixstatic.com/media/9f3ba2_99b0e6679b734af184c15eedced80c41~mv2.png/v1/fill/w_185,h_39,al_c,q_85,usm_0.66_1.00_0.01,blur_3,enc_auto/Asset%208_4x.png)
Previous
Pause / play
Next
When the photo is put, the music will automatically play and the mood Lighting will be turned on
![Asset 3_4x.png](https://static.wixstatic.com/media/9f3ba2_8559553f9efa4ea880e8fa297542b51b~mv2.png/v1/crop/x_0,y_0,w_1692,h_1964/fill/w_50,h_57,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%203_4x.png)
Storyboard
![Asset 42_4x.png](https://static.wixstatic.com/media/9f3ba2_a45c87a180a44ce4912802a279b095e3~mv2.png/v1/fill/w_62,h_46,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2042_4x.png)
1. An old man living with himself is looking outside the window with a sense of loneliness.
![Asset 43_4x.png](https://static.wixstatic.com/media/9f3ba2_7cd39a12a4944b9e9270082da9316e7b~mv2.png/v1/fill/w_61,h_42,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2043_4x.png)
![Asset 44_4x.png](https://static.wixstatic.com/media/9f3ba2_5db4ff546f394e19a1809f00c3b72117~mv2.png/v1/fill/w_108,h_46,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2044_4x.png)
2. With the missing to the past, he puts the photo into the device.
3. The device automatically reads the information and then play the musics of the corresponding years.
![Asset 45_4x.png](https://static.wixstatic.com/media/9f3ba2_0f9671211800450ea841bf201231ea2b~mv2.png/v1/fill/w_64,h_42,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2045_4x.png)
4. The devices analyzes the living track of the old man and finds there are some elderly people sharing the same experience with himself. The community will organize an activity to enable them get to know each other.
4. The devices analyzes the living track of the old man and finds there are some elderly people sharing the same experience with himself. The community will organize an activity to enable them get to know each other.
![Asset 46_4x.png](https://static.wixstatic.com/media/9f3ba2_18e351395c2b48ff998bb6355b4b29df~mv2.png/v1/fill/w_73,h_42,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2046_4x.png)
5. The old man decides to go out of home, and participate in the social activity.
![Asset 47_4x.png](https://static.wixstatic.com/media/9f3ba2_1466d3882c9f40f7bc1bc57854f47577~mv2.png/v1/fill/w_84,h_42,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/Asset%2047_4x.png)
6. He makes some new friends and feels no more lonely.
bottom of page