Skip to content

/ wav2letter

Facebook AI Research's Automatic Speech Recognition Toolkit

github.com/facebookresearch/wav2letter/wiki
View license
5.8k stars 980 forks
Star
Notifications
master
Switch branches/tags
15 branches 5 tags
Code
Clone

Use Git or checkout with SVN using the web URL.

Latest commit

@Molugan @facebook-github-bot
Molugan and facebook-github-bot Cpc vox populi (#965)
04b0305 Jun 2, 2021
Cpc vox populi (#965) 
Summary:
**IMPORTANT: Please do not create a Pull Request without creating an issue first.** Changes *must* be discussed.

**Original Issue**: #957

`closes #[issue 957]`

Patched version of Chaitanya Talnikar's implementation of masked_cpc: we needed to include the pre-training for the VoxPopuli dataset.

### Test Plan (required)

Fine-tuning with Common Voices Latvian

After downloading Common Voices:
```
export COMMON_VOICE_DIR=[Path to the parent directory containing all common voices subset]
export WAV2LETTERDIR=[Path to wav2letter root directory]
cd prepare_data
bash build_cc_data.sh lv
```

You should get the following output:
```
Building /private/home/mriviere/Common_voices/lv/lv_grapheme.tokens
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5098/5098 [00:12<00:00, 419.89it/s]
5098 files found out of 5098
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5098/5098 [01:20<00:00, 63.61it/s]
59 speakers found
Building /private/home/mriviere/Common_voices/lv/dev.lst
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1125/1125 [00:00<00:00, 1403.27it/s]
1125 files found out of 1125
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1125/1125 [00:17<00:00, 65.65it/s]
3 speakers found
Building /private/home/mriviere/Common_voices/lv/test.lst
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1629/1629 [00:01<00:00, 1563.26it/s]
1629 files found out of 1629
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1629/1629 [00:26<00:00, 62.50it/s]
54 speakers found
Building /private/home/mriviere/Common_voices/lv/train.lst
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2336/2336 [00:01<00:00, 1679.79it/s]
2336 files found out of 2336
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2336/2336 [00:34<00:00, 68.01it/s]
2 speakers found
```
Download and uncompress the checkpoint from https://dl.fbaipublicfiles.com/voxpopuli/wav2letter_100k_small.tar.gz

To fine-tune the model:

```
cd scripts_voxpopuli
bash train_lang.sh PATH_DIR_CHECKPOINT lv
```

Pull Request resolved: #965

Reviewed By: xuqiantong

Differential Revision: D28806871

Pulled By: tlikhomanenko

fbshipit-source-id: 18c91869708fb2ee94a864722ef35fa460a7c2ae
04b0305

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
.circleci
Update to C++ 17 (#973)
May 12, 2021
.github
Move wav2letter components into flashlight flashlight/flashlight#146:
Aug 20, 2020
data
move facebookresearch/wav2letter -> flashlight/wav2letter links (#967)
Apr 16, 2021
recipes
Cpc vox populi (#965)
Jun 1, 2021
.clang-format
Cut FOR_EACH_KV
Jun 9, 2020
.gitignore
Misc fixes for fairseq integration / FAIR cluster
Jul 29, 2019
CMakeLists.txt
Update to C++ 17 (#973)
May 12, 2021
CODE_OF_CONDUCT.md
Adopt Contributor Covenant
Aug 30, 2019
CONTRIBUTING.md
Bring back clang-format
Apr 19, 2019
LICENSE
Initial Commit
Dec 21, 2018
README.md
move facebookresearch/wav2letter -> flashlight/wav2letter links (#967)
Apr 16, 2021
wav2letter++ Important Note: wav2letter has been moved and consolidated into Flashlight in the ASR application. Recipes Building the Recipes Join the wav2letter community License

README.md

wav2letter++

CircleCI Join the chat at https://gitter.im/wav2letter/community

Important Note:

wav2letter has been moved and consolidated into Flashlight in the ASR application.

Future wav2letter development will occur in Flashlight.

To build the old, pre-consolidation version of wav2letter, checkout the wav2letter v0.2 release, which depends on the old Flashlight v0.2 release. The wav2letter-lua project can be found on the wav2letter-lua branch, accordingly.

For more information on wav2letter++, see or cite this arXiv paper.

Recipes

This repository includes recipes to reproduce the following research papers as well as pre-trained models:

Data preparation for training and evaluation can be found in data directory.

Building the Recipes

First, install Flashlight with the ASR application. Then, after cloning the project source:

mkdir build && cd build
cmake .. && make -j8

If Flashlight or ArrayFire are installed in nonstandard paths via a custom CMAKE_INSTALL_PREFIX, they can be found by passing

-Dflashlight_DIR=[PREFIX]/usr/share/flashlight/cmake/ -DArrayFire_DIR=[PREFIX]/usr/share/ArrayFire/cmake

when running cmake.

Join the wav2letter community

License

wav2letter++ is BSD-licensed, as found in the LICENSE file.

About

Facebook AI Research's Automatic Speech Recognition Toolkit

github.com/facebookresearch/wav2letter/wiki

Topics

deep-learning cpp end-to-end speech-recognition wav2letter

Resources

Readme

License

View license

Releases 5

v0.2 (pre Flashlight-consolidation) Latest
Dec 28, 2020
+ 4 releases

Packages

No packages published

Contributors 39

+ 28 contributors

Languages