Implemented ESPnet on Macbook

Background

I wanted to use an open source speech recognition library on my Mac, but after a lot of research, I couldn't even conclude if I could. Requirement environments according to ESPnet official documents

Supported Linux distributions and other requirements
We support the following Linux distributions with CI. If you want to build your own Linux by yourself, please also check our CI configurations. to prepare the appropriate environments
ubuntu18
ubuntu16
centos7
debian9

(In the documentation, only Linux seems to work, but I was able to implement it on macOS) Here is a summary of my own methods & problems that have arisen.

procedure

Operating environment

** macOS Calatina 10.15.4 ** (currently the latest version of 2020.4) Anaconda3(Python3.7.3)

Homebrew installation

https://brew.sh/index_ja

$ /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install.sh)"

Preparing the environment

According to the documentation, gcc 4.9+ for PyTorch 1.0.0+ is required

warp-transducer.done: espnet.done
    rm -rf warp-transducer
    git clone https://github.com/HawkAaron/warp-transducer.git
    # Note: Requires gcc>=5.0 to build extensions with pytorch>=1.0

Looking at the ESPnet makefile, ** gcc> = 5.0 ** is required.

install gcc

$ brew install gcc
$ ln -s /usr/local/bin/gcc-9 /usr/local/bin/gcc
$ ln -s /usr/local/bin/g++-9 /usr/local/bin/g++
$ gcc --version
gcc-9 (Homebrew GCC 9.3.0_1) 9.3.0
Copyright (C) 2019 Free Software Foundation, Inc.

install cmake

Download and install the macOS version from https://cmake.org/download/

Install sox, ffmepg, flac

$ conda install -c conda-forge sox
$ conda install -c conda-forge ffmpeg
$ brew install flac
$ brew install automake

install autoconf

Download from http://ftp.gnu.org/gnu/autoconf/.

$ wget http://ftp.gnu.org/gnu/autoconf/autoconf-latest.tar.xz
$ tar xvfz autoconf-latest.tar.xz
$ cd autoconf-latest
$ ./configure --prefix=/usr  #If you can't get permission here, prefix~Please in the following.
$ make
$ make install
$ git clone https://github.com/kaldi-asr/kaldi
$ cd kaldi/tools
$ ./extras/install_openblas.sh #openBLAS installation
$ ./extras/check_dependencies.sh 

After implementing all dependencies

$ make -j <Number of threads>  #It's unusually slow here, so hurry up and use all the cores.

compile without cuda

$ cd ../src
$ ./configure --mkl-root=/opt/intel/compilers_and_libraries_2020/mac/mkl --use-cuda=no
$ make -j clean depend; make -j <NUM-CPU>

ESPnet installation

$ git clone https://github.com/espnet/espnet
$ cd espnet/tools

If clang that comes with Xcode is already installed, clang will be called even if you hit the gcc command. Compiling with clang causes the problem of `clang: error: unsupported option'-fopenmp'`, so you have to define the compiler variables to gcc before doing make.

$ export CC=gcc
$ export CXX=g++

$ make KALDI=<PATH_TO_KALDI>  #OPTIONS

OPTIONS:

CUPY_VERSION='' #CPU-Empty cupy version to install only.
PYTHON=/opt/anaconda3/bin/python3.7 #Please specify PYTHON if there is a bug in miniconda.
TH_VERSION=1.2.0 #warp for macOS-Version 1 with integrated CTC Loss due to lack of ctc package.2.Requires 0 or more pytroch.
INFO: library availableness check start.
INFO: # libraries to be checked = 7
INFO: --> espnet is installed.
INFO: --> kaldiio is installed.
INFO: --> matplotlib is installed.
INFO: --> torch is installed.
INFO: --> chainer is installed.
INFO: --> chainer_ctc is installed.
WARNING: --> warprnnt_pytorch is not installed.
INFO: library availableness check done.
INFO: 6 / 7 libraries are correctly installed.
INFO: please try to setup again and then re-run this script.
make: *** [check_install] Error 1

It seems that warprnnt_pytorch does not need to be a CPU-only platform, so this is complete.

Verification

$cd espnet/egs/csj/asr1;bash ../../../utils/recog_wav.sh --models csj.transformer.v1 <wav file>

Below is the csj.transformer model with Japanese asr results

stage 0: Data preparation
stage 1: Feature Generation
steps/make_fbank_pitch.sh --cmd run.pl --nj 1 --write_utt2num_frames true decode/osa/data decode/osa/log decode/osa/fbank
steps/make_fbank_pitch.sh: moving decode/osa/data/feats.scp to decode/osa/data/.backup
utils/validate_data_dir.sh: Successfully validated data-directory decode/osa/data
steps/make_fbank_pitch.sh: [info]: no segments file exists: assuming wav.scp indexed by utterance.
steps/make_fbank_pitch.sh: Succeeded creating filterbank and pitch features for data
/Users/soshiyuu/signal/espnet/egs/csj/asr1/../../../utils/dump.sh --cmd run.pl --nj 1 --do_delta false decode/osa/data/feats.scp decode/download/csj.transformer.v1/data/train_nodup_sp/cmvn.ark decode/osa/log decode/osa/dump
stage 2: Json Data Preparation
/Users/soshiyuu/signal/espnet/egs/csj/asr1/../../../utils/data2json.sh --feat decode/osa/dump/feats.scp decode/osa/data decode/osa/dict
/Users/soshiyuu/signal/espnet/egs/csj/asr1/../../../utils/feat_to_shape.sh --cmd run.pl --nj 1 --filetype  --preprocess-conf  --verbose 0 decode/osa/dump/feats.scp decode/osa/data/tmp-EPng1/input_1/shape.scp
sym2int.pl: replacing X with 1
** Replaced 1 instances of OOVs with 1
stage 3: Decoding

Recognized text:Well, how about Monday morning, etc. I wonder if it's vacant.



Recommended Posts

Implemented ESPnet on Macbook
OpenPose on MacBook Pro
OpenPose on MacBook Pro Part 2
Implemented retina net on CentOS
Learn Paints Chainer on Macbook Pro-From operation