淘宝评论数据抓取简记
刚才趴在床上搞清楚了淘宝评论数据的抓取方法,在此记录,以备后用。
淘宝商品详情页面下方有如下script:
{"index":2,"items":[{"annoy":0,"buyer":"xxx","credit":91,"date":"2012-07-17","deal":"","rateId":19890633089,"text":"发货超快,经济实惠,以后就买你家产品了","type":0},{"annoy":0,"buyer":"xxx","credit":91,"date":"2012-07-16","deal":"","rateId":19859269704,"reply":"感谢您对我们的肯定和支持,非常感谢您对我们的服务认可,衷心的希望您能常来我们店!!!!o(∩_∩)o","text":"不好意思啊,确认晚了,发货速度很快,客服的态度也很好,特别是小依,有什么问题总能很快的得到答复.这已经是第三次购买了.","type":0},{"annoy":0,"buyer":"xxx","credit":501,"date":"2012-07-14","deal":"","rateId":19823225928,"reply":"亲,十一坊的纯的乳清蛋白粉溶解度是很好的,如果您说的其它品牌溶解速度快,那是因为那款产品里面加了速溶剂,而速溶剂属于添加剂呀,所以希望你能理解这点。另外十一坊纯乳清蛋白粉的原料是新西兰原产地纯牛奶提炼的,不知道怎么亲会闻出来羊奶味,我们有相关资质可以作证的,希望亲在好好闻闻哈!","text":"蛋白粉是我用过的的,外观最细腻的,泡沫最多的一款蛋白粉,同样也是奶味最浓的一款蛋白粉,有很浓的羊奶膻味,,(注意不是牛奶,不知为什么,)但是和美国大品牌蛋白粉比起来溶解度差,美国大品牌都是见水吉化,这款差点","type":0},{"annoy":0,"buyer":"xxx","credit":11,"date":"2012-07-14","deal":"","rateId":19816990927,"text":"好","type":0},{"annoy":0,"buyer":"xxx","credit":91,"date":"2012-07-13","deal":"","rateId":19801085374,"reply":"亲,多多关注我们店铺哦,还有更多优惠进行中~~~","text":"第二次购买了,不错的卖家。以后还会回来买。","type":0},{"annoy":0,"buyer":"xxx09","credit":11,"date":"2012-07-12","deal":"","rateId":19756966488,"reply":"感谢您对我们的肯定和支持,衷心的希望您能常来我们店!","text":"很好,有赠品和挂奖卡带金卡","type":0},{"annoy":0,"buyer":"xxx","credit":91,"date":"2012-07-11","deal":"","rateId":19726634975,"reply":"非常感谢您对店的支持~~~","text":"hao dong xi","type":0},{"annoy":0,"buyer":"xxx","credit":251,"date":"2012-07-09","deal":"","rateId":19678002719,"reply":"感谢您对我们的肯定和支持,衷心的希望您能常来我们店!","text":"很好,超划算,下次再来,谢谢小礼物","type":0},{"annoy":0,"buyer":"xxx","credit":251,"date":"2012-07-09","deal":"","rateId":19675522722,"text":"第一次来,卖家服务真好,还送了礼物,哈,还中了三等奖,别然小礼品一份,但也可看出卖家的用心,好评,会常来。","type":0},{"annoy":1,"buyer":"a**0","credit":41,"date":"2012-07-09","deal":"","rateId":19673848752,"text":"妈妈吃了,感觉还可以。坚持吃看看效果了哇。谢谢卖家的晓礼物哦","type":0},{"annoy":0,"buyer":"xxx","credit":41,"date":"2012-07-09","deal":"","rateId":19670631439,"reply":"亲,多多关注我们店铺哦,还有更多优惠进行中~~~","text":"一如即往的好,老顾客了","type":0},{"annoy":0,"buyer":"xxxx","credit":282,"date":"2012-07-06","deal":"","rateId":19611318847,"reply":"亲们若有疑问请拨打十一坊免费营养咨询热线:800 888 9988 ,非常感谢您对店的支持,祝您天天好心情~~","text":"发货速度很快,物流也很好。虽没查证,但感觉是正品,买家服务态度也很好,落发了一个摇摇杯说要给我寄过来,正在吃希望有效果,有效果再来喽!全5分好评了。。。。。","type":0},{"annoy":1,"buyer":"3**王","credit":4,"date":"2012-07-06","deal":"","rateId":19607636363,"text":"可以","type":0},{"annoy":0,"buyer":"xxx","credit":152,"date":"2012-07-06","deal":"","rateId":19596872786,"text":"蛋白粉一直在吃非常好","type":0},{"annoy":0,"buyer":"xxx","credit":152,"date":"2012-07-03","deal":"","rateId":19522938766,"text":"谢谢送的小赠品,还没喝不过看上去还不错","type":0}],"total":9}
p表示page;
ps表示page size;
结果中的total为总页数(随ps的不同而不同).
rateRs应该为评价结果,取值如下:all, good, ok, bad, 1, 0, -1. 但是加上这个参数没有起作用,不知什么原因。
至此,可以完整的实现一个商品评价数据的抓取了,可以分页抓取。
注:为避免商家及买家用户信息泄露,对敏感处以xxx取代。本文仅供技术研究,不得用于其他非正常或非法用途,“Don't be evil". 转载请注明出处(http://blog.csdn.net/wave_1102/article/details/7829911)。