Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
S
searchhotcrawler
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
zhiwei
searchhotcrawler
Commits
62364c66
Commit
62364c66
authored
Oct 16, 2018
by
[zhangzhiwei]
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
添加微信公众号缓存
parent
81fa6229
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
109 additions
and
0 deletions
+109
-0
src/main/java/com/zhiwei/searchhotcrawler/dao/WechatUserDao.java
+62
-0
src/main/java/com/zhiwei/searchhotcrawler/timer/UpdateWechatUserRun.java
+47
-0
No files found.
src/main/java/com/zhiwei/searchhotcrawler/dao/WechatUserDao.java
0 → 100644
View file @
62364c66
package
com
.
zhiwei
.
searchhotcrawler
.
dao
;
import
java.util.List
;
import
com.mongodb.BasicDBObject
;
import
com.mongodb.DBObject
;
import
com.zhiwei.searchhotcrawler.config.Config
;
import
com.zhiwei.searchhotcrawler.dbtemplate.MongoDBTemplate
;
public
class
WechatUserDao
extends
MongoDBTemplate
{
public
WechatUserDao
()
{
super
();
super
.
setDbName
(
Config
.
dbName
);
super
.
setCollName
(
Config
.
collWechatUserName
);
}
/**
* 添加分组用户
* @param userlist
* @param groupName
* @param groupId
*/
public
void
addWechatUser
(
List
<
String
>
userlist
,
String
groupName
,
Integer
groupId
){
for
(
int
i
=
0
;
i
<
3
;
i
++){
try
{
DBObject
doc
=
new
BasicDBObject
();
doc
.
put
(
"_id"
,
groupId
+
"-"
+
groupName
);
doc
.
put
(
"groupId"
,
groupId
);
doc
.
put
(
"groupName"
,
groupName
);
doc
.
put
(
"user"
,
userlist
);
this
.
getReadColl
().
save
(
doc
);
break
;
}
catch
(
Exception
e
)
{
e
.
printStackTrace
();
continue
;
}
}
}
/**
* 根据分组名称查询分组用户
* @param group
* @return
*/
@SuppressWarnings
(
"unchecked"
)
public
List
<
String
>
getWechatUserByGroup
(
String
group
){
try
{
DBObject
query
=
new
BasicDBObject
();
query
.
put
(
"groupName"
,
group
);
DBObject
doc
=
this
.
getReadColl
().
findOne
(
query
);
if
(
doc
!=
null
){
return
(
List
<
String
>)
doc
.
get
(
"user"
);
}
}
catch
(
Exception
e
)
{
return
null
;
}
return
null
;
}
}
src/main/java/com/zhiwei/searchhotcrawler/timer/UpdateWechatUserRun.java
0 → 100644
View file @
62364c66
package
com
.
zhiwei
.
searchhotcrawler
.
timer
;
import
java.util.Calendar
;
import
java.util.List
;
import
java.util.Map
;
import
java.util.Map.Entry
;
import
org.slf4j.Logger
;
import
org.slf4j.LoggerFactory
;
import
com.zhiwei.searchhotcrawler.dao.WechatUserDao
;
import
com.zhiwei.searchhotcrawler.util.WechatCodeUtil
;
import
com.zhiwei.zhiweiTools.tools.ZhiWeiTools
;
public
class
UpdateWechatUserRun
extends
Thread
{
private
WechatUserDao
wechatUserDao
=
new
WechatUserDao
();
private
static
Logger
logger
=
LoggerFactory
.
getLogger
(
UpdateWechatUserRun
.
class
);
@Override
public
void
run
()
{
logger
.
info
(
"开始更新用户数据"
);
while
(
true
)
{
try
{
Calendar
calendar
=
Calendar
.
getInstance
();
int
hour
=
calendar
.
get
(
Calendar
.
HOUR_OF_DAY
);
if
(
hour
>
6
){
Map
<
String
,
Integer
>
groupMap
=
WechatCodeUtil
.
getAllGroupIp
();
logger
.
info
(
"此公众号的分组数量为:::{}"
,
groupMap
.
size
());
if
(!
groupMap
.
isEmpty
()
&&
groupMap
!=
null
){
for
(
Entry
<
String
,
Integer
>
group
:
groupMap
.
entrySet
()){
logger
.
info
(
"此公众号的分组名称及IP为:::{},{}"
,
group
.
getKey
(),
group
.
getValue
());
List
<
String
>
userList
=
WechatCodeUtil
.
getUserListByGroupId
(
group
.
getValue
());
logger
.
info
(
"{},此分组下的用户数量为::{}"
,
group
.
getKey
(),
userList
.
size
());
if
(
userList
!=
null
&&
!
userList
.
isEmpty
()){
wechatUserDao
.
addWechatUser
(
userList
,
group
.
getKey
(),
group
.
getValue
());
}
}
}
}
ZhiWeiTools
.
sleep
(
1
*
60
*
60
*
1000
);
}
catch
(
Exception
e
)
{
logger
.
debug
(
"知乎热搜推送出现问题,问题为:::{}"
,
e
.
fillInStackTrace
());
ZhiWeiTools
.
sleep
(
1
*
60
*
60
*
1000
);
continue
;
}
}
}
}
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment