pymongo invalidstringdata strings in documents must be valid utf-8

发布时间:2016-12-29T10:52:04:手机请访问

今天采集竞争对手的网站的时候，发现无法保存到MongoDB 中，报错是

pymongo invalidstringdata strings in documents must be valid utf-8

1	pymongo invalidstringdata strings in documents must be valid utf-8

mongodb 保存必须是utf-8

首先查看字符串的编码格式

import chardet

print chardet.detect(title)

得到的编码

然后转码解码成utf-8
re.search('<title>(.*?)</title>',response.body,re.S).group(1).decode('<span class='wp_keywordlink_affiliate'><a href="https://www.168seo.cn/tag/gbk" title="View all posts in gbk" target="_blank">gbk</a></span>').encode('utf8')
完美解决