Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
S
soubao_crawler
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zhiwei
soubao_crawler
Commits
c1281636
Commit
c1281636
authored
Apr 19, 2019
by
[zhangzhiwei]
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
升级核心采集包
parent
dd5cf58b
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
3 deletions
+3
-3
pom.xml
+2
-2
src/main/java/com/zhiwei/crawler/soubao/SouBaoCrawlerThread.java
+1
-1
No files found.
pom.xml
View file @
c1281636
...
...
@@ -29,7 +29,7 @@
<dependency>
<groupId>
com.zhiwei.tools
</groupId>
<artifactId>
zhiwei-tools
</artifactId>
<version>
0.1.
1
-SNAPSHOT
</version>
<version>
0.1.
3
-SNAPSHOT
</version>
</dependency>
<dependency>
...
...
@@ -53,7 +53,7 @@
<dependency>
<groupId>
com.zhiwei.crawler
</groupId>
<artifactId>
crawler-core
</artifactId>
<version>
0.
1.1
-RELEASE
</version>
<version>
0.
3.6
-RELEASE
</version>
</dependency>
</dependencies>
...
...
src/main/java/com/zhiwei/crawler/soubao/SouBaoCrawlerThread.java
View file @
c1281636
...
...
@@ -31,7 +31,7 @@ public class SouBaoCrawlerThread extends Thread{
/***开始采集**/
logger
.
info
(
"开始采集:{}搜报网关键词,目前未采集的关键词为:{}"
,
word
,
wordsQueue
.
size
());
long
s
=
System
.
currentTimeMillis
();
Crawler
.
start
(
1
,
word
,
ProxyHolder
.
NAT_PROXY
.
getProxy
());
Crawler
.
start
(
1
,
word
,
ProxyHolder
.
NAT_
HEAVY_
PROXY
.
getProxy
());
long
e
=
System
.
currentTimeMillis
();
logger
.
info
(
"采集:::{}搜报网关键词结束,采集所用时间为:{}"
,
word
,
(
e
-
s
));
}
catch
(
Exception
e
)
{
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment