Yes. This form of breathing is considered natural (it's how babies breath), healthy and a component of relaxation. I presume you've heard some of that since you're asking about it.

There are a ton of pages and videos on the topic. If you search "how to belly breathe" or "diaphragmatic breathing how to" you will get plenty of hits.

If you practice daily, it will come to you.