New AI App Can Translate Your Baby's Cries

Every new parent knows the feeling. Your baby starts crying at 2am and you have no idea why. Are they hungry? Too hot? In pain? You try everything and sometimes nothing works.

A startup called Cappella thinks AI can help solve that problem.

What Is the Cappella App?

Cappella is a phone app that listens to your baby crying and tells you what they need.

It was first shown to the public at CES 2024 in Las Vegas which is one of the biggest tech shows in the world. Since then it has been available on iPhone and has attracted a lot of attention from tired parents looking for answers.

The app was created by Apolline Deroche who studied at MIT. Her team includes engineers from MIT Berkeley and Stanford which gives the technology some serious credibility behind it.

How Does It Actually Work?

The app uses a two phone setup.

You put one phone near your baby’s crib and keep the other with you. When your baby starts crying the first phone picks up the sound and the AI analyzes it. Within seconds you get a notification on your phone telling you what your baby likely needs.

It can tell you if your baby is hungry tired uncomfortable or needs a diaper change.

The app only listens to the sound of the cry. It does not use any other data like feeding history or sleep patterns to make its guess. The AI works purely from audio.

Cappella Baby App — *Cappella App/Screenshot by CNET*

Where Did the AI Learn This?

This is actually one of the most interesting parts of Cappella’s story.

The founders did not just train the app on random recordings. They partnered with hospitals that have maternity wards and recorded babies crying in those real environments.

Doctors then listened to each recording and labeled it. They would confirm whether a particular cry meant hunger or pain or discomfort before that data was used to train the algorithm.

That is a much more rigorous process than most apps go through and it is a big reason why Cappella’s accuracy claims hold more weight than you might expect.

How Accurate Is It?

Cappella claims its technology is about 95% accurate.

To put that in perspective the average parent correctly guesses why their baby is crying only about 30% of the time especially in the early weeks when you are still getting to know your baby.

That is a huge difference. Of course 95% is Cappella’s own claim and not an independent study so it is worth keeping that in mind. The app also gets better the more you use it as it learns your specific baby’s patterns over time.

If you ever disagree with what the app tells you there is an “I disagree” button you can tap. That feedback actually helps the app improve.

What Else Can It Do?

The Cappella app is not just a cry translator.

You can also use it to track your baby’s sleep schedule feedings and diaper changes all in one place. A lot of new parents end up with four or five different apps for these things and Cappella is trying to bring it all together in one spot.

The app is also working on AI generated sounds that are designed to soothe your baby automatically. The idea is that the app figures out what your baby needs and then plays calming sounds that are personalised to your baby specifically.

A parental dashboard is also in development. This will let you see patterns in your baby’s needs over time without having to enter anything manually.

How Much Does It Cost?

The app costs 10 dollars a month.

There is no extra hardware to buy which makes it cheaper than most alternatives. Competing products like Qbear+ which also claimed to translate baby cries required you to buy a separate physical device on top of any subscription fee.

With Cappella you just use the phone you already have.

Is It Available on Android?

Right now Cappella is only available on iPhone through the Apple App Store.

Android availability has not been confirmed yet. If you are an Android user you will need to wait for further updates from the company.

Is It Worth It for New Parents?

If you are in the first few months with a newborn and finding it hard to figure out what they need then a tool like this is worth trying.

The hospital trained data behind it is more serious than a typical app. The two phone setup means you do not need to be in the same room as your baby to know they are crying and why. And the added tracking features mean you are not juggling multiple apps.

The honest caveat is that no app should replace your own instincts as a parent. Babies are not machines and sometimes they just cry. But as a helpful tool to give you a better starting point especially at 3am when your brain is barely working it makes a lot of sense.

Our Review

Cappella is one of the more genuinely interesting uses of AI in everyday parenting.

It is built on real hospital data trained by actual doctors and designed by a team with serious engineering backgrounds. The 95% accuracy claim is bold but the foundation behind it is stronger than most.

At 10 dollars a month with no extra hardware needed it is not a huge investment to try.

If you have a newborn and an iPhone it is worth downloading and seeing if it helps. Your sleep might thank you for it.