526互联

kafka常见问题

发布时间 2023-12-19 10:52:46作者: DogLeftover
  • 报错1
[root@slave1 data_mocker]# kafka-console-consumer.sh --bootstrap-server slave1:9092 --topic topic_db
[2023-12-19 18:31:12,770] WARN [Consumer clientId=consumer-1, groupId=console-consumer-92215] Error while fetching metadata with correlation id 2 : {topic_db=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)
[2023-12-19 18:31:12,954] WARN [Consumer clientId=consumer-1, groupId=console-consumer-92215] Error while fetching metadata with correlation id 6 : {topic_db=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)

  • 解决方案：主题没有创建，需先创建

  • 报错2

[root@slave1 data_mocker]# kafka-topics.sh --create --bootstrap-server master:9092 --topic topic_db --partitions 1 --replication-factor 1
[2023-12-19 18:32:48,828] WARN Couldn't resolve server master:9092 from bootstrap.servers as DNS resolution failed for master (org.apache.kafka.clients.ClientUtils)
Exception in thread "main" org.apache.kafka.common.KafkaException: Failed to create new KafkaAdminClient
	at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:386)
	at org.apache.kafka.clients.admin.AdminClient.create(AdminClient.java:55)
	at kafka.admin.TopicCommand$AdminClientTopicService$.createAdminClient(TopicCommand.scala:150)
	at kafka.admin.TopicCommand$AdminClientTopicService$.apply(TopicCommand.scala:154)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:55)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)
Caused by: org.apache.kafka.common.config.ConfigException: No resolvable bootstrap urls given in bootstrap.servers
	at org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:88)
	at org.apache.kafka.clients.ClientUtils.parseAndValidateAddresses(ClientUtils.java:47)
	at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:346)
	... 5 more
  • 解决方案
# 错误原因：没有连接上主机
# 配置如下
主机名：slave1
域名映射：192.168.128.101 slave1
将master改为slave1
  • 报错3
[root@slave1 data_mocker]# kafka-topics.sh --create --bootstrap-server slave1:9092 --topic topic_db --partitions 1 --replication-factor 1
WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either, but not both.
Error while executing topic command : Topic topic_db already exists
[2023-12-19 18:38:38,299] ERROR java.lang.IllegalArgumentException: Topic topic_db already exists
	at kafka.admin.TopicCommand$AdminClientTopicService.createTopic(TopicCommand.scala:177)
	at kafka.admin.TopicCommand$TopicService.createTopic(TopicCommand.scala:134)
	at kafka.admin.TopicCommand$TopicService.createTopic$(TopicCommand.scala:129)
	at kafka.admin.TopicCommand$AdminClientTopicService.createTopic(TopicCommand.scala:157)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:60)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)
 (kafka.admin.TopicCommand$)
  • 解决方案
# 主题topic_db已经存在，需先删除后再重新创建