This folder contains examples for basic tasks of natural language processing.
| Notebook | Environment | Description |
|---|---|---|
| Cleaning | Local | Text cleaning |
| Normalization | Local | Text normalization by neologdn |
| Stopwords | Local | Stopwords by frequency and dictonary |
| Sentence Segmantation | Local | Sentence segmantation by ja_sentence_segmenter |
| Convert Japanese into Roman | Local | Convert Japanese into Roman by pykakasi |