Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
S
soubao_crawler
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zhiwei
soubao_crawler
Commits
1ea9bb86
Commit
1ea9bb86
authored
Aug 23, 2019
by
zhiwei
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
修复配置文件错误问题
parent
cb82a2d5
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
7 additions
and
4 deletions
+7
-4
pom.xml
+5
-2
src/main/java/com/zhiwei/crawler/config/CleanerFilterConfig.java
+1
-1
src/main/java/com/zhiwei/crawler/dbtemplate/RsidClientTemplate.java
+1
-1
No files found.
pom.xml
View file @
1ea9bb86
...
...
@@ -50,16 +50,19 @@
<artifactId>
crawler-core
</artifactId>
<version>
0.5.2-RELEASE
</version>
</dependency>
<dependency>
<groupId>
com.zhiwei.middleware
</groupId>
<artifactId>
cleaner-unified-filter
</artifactId>
<version>
0.0.7-SNAPSHOT
</version>
<version>
1.0.1.RELEASE
</version>
</dependency>
<dependency>
<groupId>
com.zhiwei.base
</groupId>
<artifactId>
base-objects
</artifactId>
<version>
0.2.7-SNAPSHOT
</version>
<version>
1.0.1.RELEASE
</version>
</dependency>
</dependencies>
...
...
src/main/java/com/zhiwei/crawler/config/CleanerFilterConfig.java
View file @
1ea9bb86
...
...
@@ -8,7 +8,7 @@ public class CleanerFilterConfig {
Properties
conf
=
null
;
try
{
InputStream
is
=
Thread
.
currentThread
().
getContextClassLoader
()
.
getResourceAsStream
(
"
redis
.properties"
);
.
getResourceAsStream
(
"
cleanerfilter
.properties"
);
conf
=
new
Properties
();
conf
.
load
(
is
);
is
.
close
();
...
...
src/main/java/com/zhiwei/crawler/dbtemplate/RsidClientTemplate.java
View file @
1ea9bb86
...
...
@@ -48,7 +48,7 @@ public class RsidClientTemplate {
public
static
boolean
addFilterUrl
(
CompleteText
completeText
){
for
(
int
i
=
0
;
i
<
3
;
i
++){
try
{
return
client
.
contains
(
completeText
.
filterInfo
());
return
client
.
contains
(
completeText
.
filterInfo
()
,
false
);
}
catch
(
Exception
e
)
{
logger
.
error
(
"判断此条网媒消息是否存在出现问题"
,
e
);
ZhiWeiTools
.
sleep
(
500
);
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment