Tokenizers
=====================================================

Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.tokenizer
    :members:

AISHELL-1 Character Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.aishell.character
    :members:

KsponSpeech Character Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.ksponspeech.character
    :members:

KsponSpeech Subword Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.ksponspeech.subword
    :members:

KsponSpeech Grapheme Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.ksponspeech.grapheme
    :members:

LibriSpeech Character Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.librispeech.character
    :members:

LibriSpeech Subword Tokenizer
--------------------------------------------

.. automodule:: openspeech.tokenizers.librispeech.subword
    :members: