how to make your own utau voicebank

How to Create Your Own UTAU Voicebank

By Matthew Rodriguez
AD

Creating your own UTAU voicebank can be an exciting and rewarding process, allowing you to explore the creative world of voice synthesis and add your unique touch to the vast array of music and media powered by UTAU. This comprehensive guide will walk you through the steps of creating your own UTAU voicebank, from recording and editing audio to creating your custom UST files.

Before we dive into the technical aspects, it's essential to understand that creating a high-quality UTAU voicebank requires patience, practice, and a lot of attention to detail. The key is to ensure your voicebank accurately represents your unique voice and can be seamlessly integrated into various projects.

Gathering Equipment and Software

To create your UTAU voicebank, you'll need a few essential tools. Fortunately, many of these tools are affordable or even free, making the process accessible to beginners.

AD
an anime character with black hair and glasses
an anime character with black hair and glasses
How to make your own Utau voicebank?
How to make your own Utau voicebank?
YOU CAN MAKE YOUR OWN UTAU VOICEBANK ON A MOBILE DEVICE!? | UTAU TUTORIAL #1
YOU CAN MAKE YOUR OWN UTAU VOICEBANK ON A MOBILE DEVICE!? | UTAU TUTORIAL #1

First, you'll need a good quality microphone and a quiet space to record. A POP filter can also help eliminate plosive sounds (e.g., 'p', 'b', 't', 'k'). For software, UTAU itself is free and available on Windows, macOS, and Linux. You'll also need an audio editor like Audacity (free) or Adobe Audition (paid) for editing and processing your recordings.

Choosing a Microphone

Investing in a decent quality microphone is crucial for recording clear, high-quality audio. USB microphones like the Blue Yeti or Audio-Technica ATR2100x-USB are popular choices for their ease of use and reasonable prices. If you're on a tight budget, even a built-in laptop microphone can work, though results may vary.

【UTAU tutorial #3】 Voicebank & UST types
【UTAU tutorial #3】 Voicebank & UST types
utau voice banks google drive
utau voice banks google drive

When choosing a microphone, consider factors like sensitivity, polar patterns, and frequency response. A cardioid polar pattern is ideal for UTAU voicebank recording as it focuses on audio directly in front of the microphone, reducing background noise. Aim for a frequency response that covers the human vocal range (around 80-250 Hz for low-end and 2-4 kHz for high-end).

Preparing Your Recording Space

Ideally, record in a quiet space with minimal reverberation. This could be a closet, a spare room, or even a car. Use blankets, pillows, or other soft materials to dampen echoes and reduce background noise.

AD

Monitor your recording environment using the IEC 60268-1 standard for measuring loudspeaker sound power. Aim for apnl strength between 45-55 dB(A) for optimal sound quality. Keep in mind that room reflections and resonances can affect your recordings, so experiment with different room configurations to find the best sound.

Recording and Editing Your Voice Samples

Now that you have your recording setup in place, it's time to capture your voice samples.

Before recording, warm up your voice by singing or speaking scales to ensure you're at your best. Hydration is also crucial for maintaining a healthy voice, so make sure to stay well-hydrated throughout the recording process.

AD

Recording Techniques

Position your microphone at a 45-degree angle to your mouth to avoid plosive sounds. Maintain a constant distance from the microphone for consistent volume levels. To minimize mouth noise, avoid eating or drinking before recording, and keep your lips relaxed while singing or speaking.

Record in short sessions to prevent vocal fatigue. Aim for a comfortable volume level; speaking or singing too loudly can strain your voice, while whispering or speaking too softly may result in low-quality recordings.

Editing Your Recordings

Edit your recordings using an audio editor to remove unwanted sounds, background noise, and any Other extraneous audio. Use tools like the Noise Reduction effect in Audacity to minimize background noise. Be careful not to over-compress or distort your audio during the editing process.

AD

Save your edited recordings as WAV files, as they contain uncompressed, lossless audio data. This ensures the highest possible quality for your UTAU voicebank.

Creating Your UST File

UTAU uses a specific file format called UST (UTAU Standard Terrain) to store voicebank data. Creating a UST file involves converting your WAV recordings into a format that can be recognized and used by UTAU.

There are several tools available for converting your WAV files into UST format, such as UTAU-PyPy (a Python script) and Synthesizer V Voice File Converter. These tools use the Freedom Score system to analyze and convert your recordings, ensuring they can be accurately synthesized by UTAU.

Preparing your WAV Files

Before converting your WAV files, organize them into separate folders based on phoneme or romaji. For example, create a folder for vowels and another for consonants. Within each folder, organize your recordings by pitch (e.g., C4, C#4, D4, etc.). This will make the conversion process smoother and less prone to errors.

Review your recordings and remove any that are significantly different from their pitch or contain notable artifacts. This will help maintain a consistent quality across your voicebank.

Converting WAV Files to UST

To convert your WAV files to UST, you'll need to install the required tools and follow the software-specific instructions. Be patient, as the conversion process can take several hours or even days, depending on the size of your voicebank.

Once the conversion is complete, test your new UTAU voicebank by opening it in UTAU and singing a short phrase. If your voicebank synthesizes correctly, you're ready to share your creation with the world!

Congratulations on creating your own UTAU voicebank! The process involved careful planning, attention to detail, and a lot of practice. Now that you have your custom voicebank, the possibilities are endless. From singing along to your favorite songs to creating original music and multimedia projects, your unique voice can bring life and expression to a multitude of creative endeavors.

AD