Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
S
soubao_crawler
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zhiwei
soubao_crawler
Commits
72ee60b2
Commit
72ee60b2
authored
Sep 05, 2019
by
zhiwei
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
添加realSource及升级包版本
parent
b94223fa
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
2 deletions
+3
-2
pom.xml
+1
-1
src/main/java/com/zhiwei/crawler/util/TreatData.java
+2
-1
No files found.
pom.xml
View file @
72ee60b2
...
@@ -59,7 +59,7 @@
...
@@ -59,7 +59,7 @@
<dependency>
<dependency>
<groupId>
com.zhiwei.base
</groupId>
<groupId>
com.zhiwei.base
</groupId>
<artifactId>
base-objects
</artifactId>
<artifactId>
base-objects
</artifactId>
<version>
1.0.
4
.RELEASE
</version>
<version>
1.0.
6
.RELEASE
</version>
</dependency>
</dependency>
...
...
src/main/java/com/zhiwei/crawler/util/TreatData.java
View file @
72ee60b2
...
@@ -51,8 +51,9 @@ public class TreatData {
...
@@ -51,8 +51,9 @@ public class TreatData {
String
content
=
dataMap
.
get
(
"content"
)+
""
.
replaceAll
(
"<[^>]*>"
,
""
);
String
content
=
dataMap
.
get
(
"content"
)+
""
.
replaceAll
(
"<[^>]*>"
,
""
);
ClassD
cd
=
ClassA
.
selectA
(
TypeA
.
TEXT
).
selectB
(
TypeB
.
COMPLETE
).
selectC
(
TypeC
.
PGC
).
selectD
(
TypeD
.
平媒
);
ClassD
cd
=
ClassA
.
selectA
(
TypeA
.
TEXT
).
selectB
(
TypeB
.
COMPLETE
).
selectC
(
TypeC
.
PGC
).
selectD
(
TypeD
.
平媒
);
long
ctime
=
System
.
currentTimeMillis
();
long
ctime
=
System
.
currentTimeMillis
();
String
realSource
=
"搜报网"
;
CompleteText
completeText
=
new
CompleteText
.
Builder
(
date
.
getTime
(),
ctime
,
source
.
trim
()
CompleteText
completeText
=
new
CompleteText
.
Builder
(
date
.
getTime
(),
ctime
,
source
.
trim
()
,
cd
.
encodeA
(),
cd
.
encodeB
(),
cd
.
encodeC
(),
cd
.
encodeD
(),
cd
.
combineEncode
(),
"PC"
,
null
,
100010005L
)
,
cd
.
encodeA
(),
cd
.
encodeB
(),
cd
.
encodeC
(),
cd
.
encodeD
(),
cd
.
combineEncode
(),
"PC"
,
null
,
100010005L
,
realSource
)
.
url
(
url
)
.
url
(
url
)
.
title
(
title
)
.
title
(
title
)
.
content
(
content
)
.
content
(
content
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment