MARS5 TTS

MARS5 TTS - Open-source, insanely prosodic text-to-speech model

Introduction

MARS5 an opensource TTS model to replicate performances (from 2-3s of audio reference) in 140+ languages, even for extremely tough prosodic scenarios like sports commentary, movies, anime & more. Join our Discord https://discord.gg/4GVdQ28cZC today!


Updated On:

Jun 14, 2024

Monthly Visitors:

SimilarWeb Icon
437.9M

Affiliate Program:

No

MARS5 TTS's Overview

MARS5 is a novel English speech model (TTS) developed by CAMB.AI. It follows a two-stage AR-NAR pipeline with a unique NAR component. With just 5 seconds of audio and a snippet of text, MARS5 can generate speech for diverse scenarios like sports commentary and anime. The model can be steered with punctuation and capitalization to guide the prosody of the generated output. Speaker identity can be specified using an audio reference file. MARS5 supports both shallow and deep cloning, with the latter requiring the prompt transcript. The model can be easily loaded using `torch.hub` and inference can be performed by providing the reference audio and transcript. The default settings provide good results, but the inference settings can be tuned for specific use cases. The checkpoints for MARS5, along with the necessary hardware requirements, are provided on the GitHub repo. Contributions to improve the model are welcome.


MARS5 TTS's Features

  • Two-stage AR-NAR pipeline

  • Guided prosody using punctuation and capitalization

  • Speaker identity specification

  • Shallow and deep cloning

  • Easy model loading using `torch.hub`

  • Inference using reference audio and transcript

  • Open-source with alternative licensing options


MARS5 TTS's Q&A


MARS5 TTS's Pricing

MARS5 is open-source and available under GNU AGPL 3.0 license. For alternative licensing options, please contact [email protected]

MARS5 TTS's Analytics

Website Overview

Key performance metrics for github.com

Bounce Rate

38.34%

Pages / Visit

6.50

Total Visits

437,914,238

Time on Site

7m 18s

Global Rank

#78

Country Rank

#111

Top Regions

Distribution of traffic by country

  • 1.
    United States15.94%
  • 2.
    China15.11%
  • 3.
    India9.28%
  • 4.
    Japan3.94%

Total Visitors

Monthly visitor statistics for the last 3 months

Trending down by 5.3% this month
April - June 2024

Traffic Sources

Distribution of traffic sources

Social:
6.7%
Paid Referrals:
0.0%
Mail:
0.9%
Referrals:
11.0%
Search:
30.1%
Direct:
51.3%
Dominant source: Direct
51.3% of total traffic

MARS5 TTS's Alternatives