Skip to content

S
searchhotcrawler
Commit b59bbeaa by chenweitao
Options

Merge branch 'working' into 'master' 

调整脉脉采集文本长度设定

See merge request !149
parents 5acbbd8e ad9bd7b0
Showing with 1 additions and 1 deletions
src/main/java/com/zhiwei/searchhotcrawler/crawler/MaiMaiHotSearchCrawler.java
...@@ -39,7 +39,7 @@ public class MaiMaiHotSearchCrawler { ...@@ -39,7 +39,7 @@ public class MaiMaiHotSearchCrawler {
log.error("脉脉热榜页面连接异常...", e); log.error("脉脉热榜页面连接异常...", e);
} }
//1024 - 26(时间戳+type) = 998 -> name.getBytes(StandardCharsets.UTF_8).length<998 -> 998/3 = 332 //1024 - 26(时间戳+type) = 998 -> name.getBytes(StandardCharsets.UTF_8).length<998 -> 998/3 = 332
int nameLengthMax = 332; int nameLengthMax = 300;
if (StringUtils.isNotBlank(htmlBody) && htmlBody.contains("feeds")) { if (StringUtils.isNotBlank(htmlBody) && htmlBody.contains("feeds")) {
JSONArray jsonArray = JSONObject.parseObject(htmlBody).getJSONArray("feeds"); JSONArray jsonArray = JSONObject.parseObject(htmlBody).getJSONArray("feeds");
if (jsonArray != null) { if (jsonArray != null) {
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment