Using WhisperSpeech - the Voice Synthesis AI for Voice-Over Generation at Scale

!pip install -Uqq WhisperSpeech

def is_colab():
    try: import google.colab; return True
    except: return False

import torch
if not torch.cuda.is_available():
    if is_colab(): raise BaseException("Please change the runtime type to GPU. In the menu: Runtime -> Change runtime type (the free T4 instance is enough)")
    else:          raise BaseException("Currently the example notebook requires CUDA, make sure you are running this on a machine with a GPU.")

import torch
import torch.nn.functional as F

from IPython.display import Markdown, HTML

from whisperspeech.pipeline import Pipeline

pipe = Pipeline(s2a_ref='collabora/whisperspeech:s2a-q4-tiny-en+pl.model')

pipe.generate_to_notebook("""
Hello, welcome to WhisperSpeech! Today, we're excited to guide you through the innovative world
of text-to-speech technology. We'll show you how to breathe life into your text with natural-sounding
voiceovers and explore the cutting-edge features that make WhisperSpeech a game-changer in digital content creation.
""", lang = 'en', cps=15)

pipe.generate_to_notebook("""
"Good evening, everyone. As Iron Man, I've faced some of the toughest challenges imaginable, but the real strength lies not in the suit, but in the heart and determination of those who strive to make the world a better place. Let's remember, it's not just about being heroes in battle, but being champions of innovation, courage, and unity. Together, we can overcome any obstacle."
""", lang='en', cps=15, speaker='https://tmpfiles.org/dl/4167328/robertdowneyjr.mp3')

pipe.generate_to_notebook("""
In a world that's constantly changing, the true measure of a person is not just in the ability to adapt, but in our capacity to use our gifts for the greater good. I've seen firsthand that technology, when guided by heart and responsibility, has the power to change the world. Let's be the heroes our future needs, not just in suits of armor, but in our everyday actions.
""", lang='en', cps=10, speaker='https://tmpfiles.org/dl/4168800/robertdowneyjr.mp3')

pipe.generate_to_notebook("""
As the morning mist hung low over Baker Street, Sherlock Holmes, with his characteristic keenness, peered across the sitting room at me, his friend and chronicler, Dr. John Watson. "Watson," he began, his voice carrying the thrill of a new challenge, "consider the peculiar case that has presented itself to us this day. A mystery that, I daresay, will require all our wits to unravel."
I looked up from my newspaper, intrigued by the spark in his eye.
""", lang='en', cps=10, speaker='https://tmpfiles.org/dl/4170772/y2meta.app-sherlockholmesaudiobookreadbybenedictcumberbatch_sherlockholmesaudiobook_freeaudiobook128kbps.wav')

pipe.generate_to_notebook("""
I could not help but lean forward, my interest piqued. "Robbery?" I ventured.
Holmes shook his head. "Too simple, Watson. No, there is more at play here. The constabulary found a peculiar token clenched in his fist—a small, intricately carved chess piece, a knight, to be precise. This, combined with the absence of any physical harm to the body, suggests a game of a far more sinister nature."
""", lang='en', cps=10, speaker='https://tmpfiles.org/dl/4170772/y2meta.app-sherlockholmesaudiobookreadbybenedictcumberbatch_sherlockholmesaudiobook_freeaudiobook128kbps.wav')

pipe.generate_to_notebook("""
As Holmes spoke, the room seemed to grow colder, the fog outside pressing against the windows as if trying to listen in. I knew then that we were on the cusp of an adventure that would test our limits and perhaps reveal the darker corners of the human heart.
""", lang='en', cps=10, speaker='https://tmpfiles.org/dl/4170772/y2meta.app-sherlockholmesaudiobookreadbybenedictcumberbatch_sherlockholmesaudiobook_freeaudiobook128kbps.wav')