how to make utau voicebank

How to Create Your Own UTAU Voicebank

By Mark Harris
AD

Creating a UTAU voicebank can be an exciting and rewarding journey, turning your voice into a digital instrument. UTAU, or Ultimate UTAU, is a free software for creating and manipulating vocal synthesizers. Here's a comprehensive guide on how to make your UTAU voicebank.

Before we dive in, ensure you have a clear, mutable microphone, a computer with sufficient processing power, and a rough understanding of audio editing. Remember, making a UTAU voicebank requires time, patience, and practice. Let's start!

Understanding UTAU and Voicebanking

UTAU is a text-to-speech program that uses realistic voice synthesis. A UTAU voicebank is a collection of audio files that UTAU uses to create speech patterns. Each voicebank has its unique characteristics, determined by the recording process and audio editing.

AD
an anime character with black hair and glasses
an anime character with black hair and glasses
How to make your own Utau voicebank?
How to make your own Utau voicebank?
YOU CAN MAKE YOUR OWN UTAU VOICEBANK ON A MOBILE DEVICE!? | UTAU TUTORIAL #1
YOU CAN MAKE YOUR OWN UTAU VOICEBANK ON A MOBILE DEVICE!? | UTAU TUTORIAL #1

Voicebanking is the process of recording and editing these audio files. It involves capturing your voice in various pitches and intonations, then processing and organizing these recordings into a UTAU-friendly format.

UTAU Voicebank Basics

A basic UTAU voicebank consists of wav files named after syllables (e.g., "ah", "eh", "oo", "ei", etc.) and other sounds like "ng", "mb", "v", etc. These files, collectively called phonemes, allow UTAU to create a wide range of sounds and words.

【UTAU tutorial #3】 Voicebank & UST types
【UTAU tutorial #3】 Voicebank & UST types
【UTAU tutorial #5】How to make an UTAU cover
【UTAU tutorial #5】How to make an UTAU cover

resample: 44.1 kHz or higher (most UTAU users resample to 24kHz or 48kHz)
- Bit Depth: 16 bits
- Monophonic unless you're creating a multivoicebank

Preparing Your Equipment

Before you start recording, ensure your microphone is capable of capturing clear audio. Most UTAU users use condenser microphones, which are sensitive and records sound accurately. However, you can use any decent quality microphone to start.

AD

Also, choose a quiet space to record. Background noise can ruin your voicebank. Invest in a pop filter to minimize plosive sounds, and use headphones to monitor your audio.

Recording Your Voicebank

Recording the voicebank involves reading out various sounds, syllables, and sentences at different pitches. This process might seem boring, but it's crucial for creating a versatile voicebank.

Use a metronome to maintain consistent rhythm. Record in clean, short takes to minimize errors and make editing easier. Remember, quality is more important than quantity. One excellent take is better than ten mediocre ones.

AD

Recording Techniques

Keep your voice comfortable and stable. Don't strain yourself trying to reach extreme pitches. Maintain a consistent volume level throughout the recording. Use breath control to minimize background noise.

Once you've recorded all the necessary sounds, it's time to edit. Most UTAU users use Audacity, a free, open-source audio editor. Familiarize yourself with its features like the noise reduction tool and the envelope tool.

Editing Your Voicebank

Editing your voicebank involves extracting individual sounds from your recordings, cleaning them up, and organizing them into the correct folders. This process is labor-intensive, but it's critical for creating a high-quality voicebank.

AD

First, remove any background noise using Audacity's noise reduction tool. Then, use the envelope tool to smooth out the clicks and pops at the beginning and end of each sound. Finally, organize your files into the correct phoneme folder (e.g., C:\Users\User\Documents\UTAU\VoicebankName\Samples\CVC\C).

Resampling and Conclusion

Once you've organized your files, resample them to the correct format (see UTAU Voicebank Basics). Now, you have your very own UTAU voicebank!

Keep in mind that creating a UTAU voicebank is an ongoing process. You can always update and improve your voicebank by adding new sounds, resampling, or even using different voice techniques.

Share your voicebank with the UTAU community. They can provide feedback and help you improve. Who knows, you might even inspire someone to create their own voicebank. So, keep practicing, keep improving, and happy voicebanking!

AD