For NLP tasks, the first step is to pre-process text for training. Let’s say you have the English language model ,you will have a model that includes over 1 million items of vocab, many classes of entity recognition and a lot of compound noun recognition. But what happens when we need to add new terms and customize the vocabulary? In this talk, we show an approach on how to create a custom vocabulary that can be further used for any NLP tasks.