前往小程序,Get更优阅读体验!
立即前往
首页
学习
活动
专区
工具
TVP
发布
社区首页 >专栏 >Kafka日志配置

Kafka日志配置

作者头像
程裕强
发布2022-05-06 20:18:52
6450
发布2022-05-06 20:18:52
举报

1、问题描述

在server.properties中配置了log.dirs值,表示kafka数据的存放目录,而非Kafka的日志目录。

代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# vi config/server.properties
代码语言:javascript
复制
log.dirs=/data/kafka

Kafka运行时日志默认输出到$KAFKA_HOME/logs目录下,容易撑爆分区,造成操作系统崩溃。需要将日志输出到指定分区,比如/var/log目录下。

2、解决办法

(1)首先停止Kafka

代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# bin/kafka-server-stop.sh

(2)修改$KAFKA_HOME/bin/kafka-run-class.sh

代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# vi bin/kafka-run-class.sh

定位到LOG_DIR

代码语言:javascript
复制
# Log directory to use
if [ "x$LOG_DIR" = "x" ]; then
  LOG_DIR="$base_dir/logs"
fi

增加一行,修改为

代码语言:javascript
复制
LOG_DIR=/var/log/kafka
# Log directory to use
if [ "x$LOG_DIR" = "x" ]; then
  LOG_DIR="$base_dir/logs"
fi

(3)修改log4j.properties

代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# sed -i 's/log4j.rootLogger=INFO/log4j.rootLogger=WARN/' config/log4j.properties

查看发现log4j.rootLogger的值已经修改为WARN级别

代码语言:javascript
复制
# Unspecified loggers and loggers with additivity=true output to server.log and stdout
# Note that INFO only applies to unspecified loggers, the log level of the child logger is used otherwise
log4j.rootLogger=WARN, stdout, kafkaAppender
代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# vi config/log4j.properties

将最后几行的TRACE修改为INFO

修改前

代码语言:javascript
复制
# Uncomment the lines below and change log4j.logger.kafka.network.RequestChannel$ to TRACE for additional output
# related to the handling of requests
#log4j.logger.kafka.network.Processor=TRACE, requestAppender
#log4j.logger.kafka.server.KafkaApis=TRACE, requestAppender
#log4j.additivity.kafka.server.KafkaApis=false
log4j.logger.kafka.network.RequestChannel$=WARN, requestAppender
log4j.additivity.kafka.network.RequestChannel$=false

log4j.logger.kafka.controller=TRACE, controllerAppender
log4j.additivity.kafka.controller=false

log4j.logger.kafka.log.LogCleaner=INFO, cleanerAppender
log4j.additivity.kafka.log.LogCleaner=false

log4j.logger.state.change.logger=TRACE, stateChangeAppender
log4j.additivity.state.change.logger=false

# Access denials are logged at INFO level, change to DEBUG to also log allowed accesses
log4j.logger.kafka.authorizer.logger=INFO, authorizerAppender
log4j.additivity.kafka.authorizer.logger=false

修改后

代码语言:javascript
复制
# Uncomment the lines below and change log4j.logger.kafka.network.RequestChannel$ to TRACE for additional output
# related to the handling of requests
#log4j.logger.kafka.network.Processor=TRACE, requestAppender
#log4j.logger.kafka.server.KafkaApis=TRACE, requestAppender
#log4j.additivity.kafka.server.KafkaApis=false
log4j.logger.kafka.network.RequestChannel$=WARN, requestAppender
log4j.additivity.kafka.network.RequestChannel$=false

log4j.logger.kafka.controller=INFO, controllerAppender
log4j.additivity.kafka.controller=false

log4j.logger.kafka.log.LogCleaner=INFO, cleanerAppender
log4j.additivity.kafka.log.LogCleaner=false

log4j.logger.state.change.logger=INFO, stateChangeAppender
log4j.additivity.state.change.logger=false

# Access denials are logged at INFO level, change to DEBUG to also log allowed accesses
log4j.logger.kafka.authorizer.logger=INFO, authorizerAppender
log4j.additivity.kafka.authorizer.logger=false

(4)重启Kafka

代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# bin/kafka-server-start.sh config/server.properties &
代码语言:javascript
复制
[root@node1 kafka_2.11-1.0.1]# cd /var/log/kafka/
[root@node1 kafka]# ll
total 76
-rw-r--r-- 1 root root 11111 Apr 24 13:49 controller.log
-rw-r--r-- 1 root root     0 Apr 24 13:16 kafka-authorizer.log
-rw-r--r-- 1 root root     0 Apr 24 13:16 kafka-request.log
-rw-r--r-- 1 root root  4472 Apr 24 13:49 kafkaServer-gc.log.0.current
-rw-r--r-- 1 root root   722 Apr 24 13:49 log-cleaner.log
-rw-r--r-- 1 root root 42951 Apr 24 13:49 server.log
-rw-r--r-- 1 root root  2715 Apr 24 13:20 state-change.log
[root@node1 kafka]# 
本文参与 腾讯云自媒体分享计划,分享自作者个人站点/博客。
原始发表:2018-04-24,如有侵权请联系 cloudcommunity@tencent.com 删除

本文分享自 作者个人站点/博客 前往查看

如有侵权,请联系 cloudcommunity@tencent.com 删除。

本文参与 腾讯云自媒体分享计划  ,欢迎热爱写作的你一起参与!

评论
登录后参与评论
0 条评论
热度
最新
推荐阅读
目录
  • 1、问题描述
  • 2、解决办法
领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档