添加线上应用服务资源说明.md

线上应用服务资源说明.md

+新 zookeeper 集群
+新 zookeeper 集群
+
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+
+新 Kafka 集群
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+
+## kafka 所创建的 Topic
+cleaner ：存储、渠道统计读取，清洗存入
+crawler-media：清洗读区，采集存入
+crawler-efMedia：事件后台读取，采集存入
+crawler-qbjc-event：舆情读取，采集存入
+
+
+
+## 中间件所需 base 资源说明
+
+### 去重中间件
+#### Redis
+192.168.0.122:7370   select 1
+192.168.0.122:7371   select 1 （记数）
+192.168.0.122:7372   select 1
+192.168.0.26:6379    select 1
+192.168.0.26:6380    select 1
+192.168.0.27:6379    select 1
+192.168.0.27:6380    select 1
+
+
+#### zookeeper
+192.168.0.203:2182
+192.168.0.104:2182
+192.168.0.105:2182
+#### Dubbo
+dubbo 组名
+dubbo.group = zhiwei-bloom-filter
+
+### 存储中间件
+#### ES
+192.168.0.25 9200;9300
+192.168.0.26 9200;9300
+192.168.0.27 9200;9300
+#### Mongo 
+hz: 192.168.0.101 30000 DW
+zc: 
+#### Kafka
+topic：cleaner
+kafaka.hzMongoGroupId = hz-mongo-consumer-group
+kafaka.zcMongoGroupId = zc-mongo-consumer-group
+kafaka.zcEsGroupId = zc-es-consumer-group
+地址：
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+### 清洗中间
+topic：crawler-media、cleaner
+kafka.consumer.group-id=consumer-group
+地址：
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+
+### 标注中间
+#### Dubbo
+dubbo-group:zhiwei-mark
+
+#### ES
+192.168.0.25 9200;9300
+192.168.0.26 9200;9300
+192.168.0.27 9200;9300 
+
+#### Mongo
+hz 192.168.0.101 30000 DW
+
+#### redis
+
+192.168.0.122:7373   select 2
+
+### 自动标注中间件
+#### Dubbo
+dubbo.group = zhiwei-automatic
+#### redis
+192.168.0.122:7373   select 3
+
+
+# 服务应用 base 资源所需
+### 监测系统、消息流
+#### redis
+192.168.0.122:7373   select 4
+
+#### Mongo
+hz:192.168.0.101 30000 
+
+#### ES
+192.168.0.25 9200;9300 
+192.168.0.26 9200;9300 
+192.168.0.27 9200;9300  
+
+### 动态版事件分析
+#### Redis
+192.168.0.122:7373   select 5
+
+#### Mongo
+hz: 192.168.0.101 30000
+
+### 微博商业接口
+#### Mongo
+hz: 192.168.0.101 30000
+
+#### redis
+
+192.168.0.122:7373   select 6
+
+
+### 网媒存储
+#### kafka
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+topic： crawler-media
+
+### 微博存储
+#### kafka 
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+topic： crawler-media
+
+### 情报监测事件采集
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+topic： crawler-qbjc-event
+
+### 代理ip 客户端
+#### zookeeper
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+group = hangzhou 
+
+### 微信采集程序
+#### kafka
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+topic crawler-media
+
+#### zookeeper
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+group = hangzhou
+
+### 可视化爬虫
+#### zookeeper
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+#### redis
+192.168.0.122:7374   select 7
+#### kafka
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+topic crawler-media
+
+#### zookeeper
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+
+
+### 事件系统
+
+#### redis
+192.168.0.122:7374   select 8
+#### kafka
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+Topic: crawler-efMedia
+
+#### zookeeper
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+
+
+### data-manage
+
+#### redis
+
+192.168.0.122:7374   select 9
+
+### shortUrl
+#### redis
+192.168.0.122:7374   select 11
+
+
+### crawler-maimai
+
+#### kafka
+
+192.168.0.203 9095
+192.168.0.104 9093
+192.168.0.105 9093
+Topic: crawler-media
+
+#### zookeeper
+
+192.168.0.203 2182
+192.168.0.104 2182
+192.168.0.105 2182
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+