CWS-Hmm_BiLSTM-CRF-master.zip
立即下载
资源介绍:
CWS-Hmm_BiLSTM-CRF-master.zip
# CWS Chinese word segmentation 中文分词
## 实现算法:HMM BiLSTM BiLSTM+CRF
数据集:人民日报 训练:测试=4:1
数据处理:
```
cd data
python data_u.py
```
HMM:
```
cd HMM
python hmm_model.py
```
LSTM:
```
cd LSTM
python train.py
```
BiLSTM+CRF:
```
cd BiLSTM-CRF
python train.py
```
我运行的结果:
```
BiLSTM+CRF
embedding_dim=100 hidden_dim=200 epoch=1 lr=0.005
precision:0.96975528
recall: 0.96779571
fscore: 0.96877451
LSTM:
precision:0.94323622
recall: 0.89368218
fscore: 0.91779080
HMM:
precision:0.87980196
recall: 0.84381022
fscore: 0.86143031
```
BiLSTM+CRF pytorch实现 参考 [ChineseNER](https://github.com/buppt/ChineseNER)
Hmm实现 参考 [HMM](https://github.com/ldanduo/HMM)