标签：color tokenizer list object package pre token training 报错
使用keras包实现NLP问题时，报错
/lib/python3.5/dist-packages/keras/preprocessing/text.py”, line 302, in texts_to_sequences_generator elif self.oov_token is not None:
AttributeError: ‘Tokenizer’ object has no attribute ‘oov_token’
报错的代码行为
train_sequences = tokenizer.texts_to_sequences(new_training_list)
从texts_to_sequences()点进去keras的源码，发现它调用texts_to_sequences_generator()方法
而该方法里没有oov_token,后面有调用，但是没有设置
手动设置就ok
在texts_to_sequences_generator()方法里添加
tokenizer.ovv_token=None
OK.Fine
BUG-‘Tokenizer’ object has no attribute ‘oov_token’
标签：color tokenizer list object package pre token training 报错
原文地址：https://www.cnblogs.com/lyeeer/p/10337391.html
