This document summarizes a data scientist's work using deep learning to classify different types of cries from recordings of her newborn baby. She collected around 70 audio recordings spanning the baby's first 4 months. Using these recordings, she aimed to build models to classify cries as hungry, angry, needing a diaper change, etc. Her best models achieved accuracies between 76-86%. However, she acknowledges limitations from a small dataset and risks of overfitting. She outlines plans to expand the data collection and improve the models to develop a baby cry translation app.

1. Hungry or angry?
Baby’s crying transla3on with Deep Learning
Ana Laguna Pradas
Data Scien3st at BBVA Data & Analy,cs
SoGooD²ata founder

3. Background
Pregnancy = happiness

4. Background
Pregnancy = fear

5. Background
Baby blues

6. Background
Baby’s cries seem all the same

7. Background
Baby’s crying app, please!

8. Data
§ Challenge 1: no baby’s cries data available
§ My own newborn’s data:
• ≈ 70 audios (.wav files)
• From 1st month un3l 4th month of life

9. Data
Supermum: recognizing every liRle cry

10. Data
Newborn’s daily life
Baby modes:
Sleepy
Hungry
Puke (gassy)
Diaper change
+Angry
+Pain (colic)
+Fussy

11. Data
§ Challenge 2: audio labelling
§ Challenge 3: not enough versa3lity (from mul3class to binary classifica3on)
HUNGRY FUSSY
ANGRY SLEEPY
Audio signals

12. Data
Algorithm input
HUNGRY FUSSY
ANGRY SLEEPY
Spectograms

13. Deep Learning Algorithms
Mul3layer perceptron
with Tensorflow
Recurrent & Convolu3onal
Neuronal Networks with Keras

14. Conclusion
Results: good models accuracy (0.76 – 0.86)
Learning: no fear of small datasets with DL when the signal is clear
But risk of:
• Bias
• Overfieng

15. Next steps
§ More mul3label data
§ More babies data
§ More mul3cultural babies data
§ Transfer learning
§ CapsNets
§ Clustering for labelling
§ Try new 2018 apps
§ Scien3fic papers
§ App release! sogooddata.org

16. [D4SG] Social impact
Useful for:
§ New parents (mainly the 1st month of life)
§ Grandparents
§ BabysiRers
§ Deaf parents
§ Au3sm early detec3on

17. State of the art
ChaRerBaby.org

18. THANK YOU!
anitalp/baby_crying_translator