Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upCommon Voice Dataset not working anymore #1792
Open
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
t2t-datagen command is not working properly with
problem=common_voice. It is due to the URL not being static anymore so the file being downloaded is just the webpage showingAccess Deniedin a .xml. You can directly enter the static common voice URL in browser and see that it does not download the .tar.gz dataset but instead shows the Access Denied webpageEnvironment information
Steps to reproduce:
Use the t2t-datagen command with
problem=common_voiceorproblem=common_voice_cleanIn the code we can see that the URL of common voice is static:
_COMMONVOICE_URL = "https://common-voice-data-download.s3.amazonaws.com/cv_corpus_v1.tar.gz"while for example the french URL is generated and looks like this:
https://voice-prod-bundler-ee1969a6ce8178826482b88e843c335139bd3fb4.s3.amazonaws.com/cv-corpus-4-2019-12-10/fr.tar.gzIf this gets fixed, it would also be nice to have a flag allowing us to choose which language we want our dataset to be in.