kafka eagle 踩坑windows安装-USB迷|专注于互联网分享

kafka eagle 踩坑windows安装

使用场景：安装kafka eagle windows环境，一直没有反应，报如下错：

The KE_HOME environment variable is not defined correctly

说一直找不到KE_HOME文件路径，直接cmd，输入命令查找%KE_HOME%也报一样的错

总结了下应该是配置环境变量的问题，以下是我的环境变量配置（自认为没有问题，有问题可踢我）：

然后一直启动不成功，后面，既然使用%KE_HOME%找不到指定文件，那么我就使用的手动修改，具体操作如下，使用我这种方式，可以不用配置环境变量。

第一，下载kafka-eagle-web，然后解压

第二，进入你的解压目录，进入conf文件夹，修改system-config.properties配置文件

######################################
# multi zookeeper&kafka cluster list
######################################
# 配置 zk,我这里是单节点,集群的话配置如下面 cluster2 所示
kafka.eagle.zk.cluster.alias=cluster1
cluster1.zk.list=localhost:2191
#cluster2.zk.list=xdn10:2181,xdn11:2181,xdn12:2181######################################
# zk client thread limit
######################################
kafka.zk.limit.size=25######################################
# kafka eagle webui port
######################################
kafka.eagle.webui.port=8048######################################
# kafka offset storage
######################################
cluster1.kafka.eagle.offset.storage=kafka
#cluster2.kafka.eagle.offset.storage=zk######################################
# enable kafka metrics
######################################
# 开启图表监控,将 false 变为 true
kafka.eagle.metrics.charts=true
kafka.eagle.sql.fix.error=false######################################
# kafka sql topic records max
######################################
kafka.eagle.sql.topic.records.max=5000######################################
# alarm email configure
######################################
kafka.eagle.mail.enable=false
kafka.eagle.mail.sa=alert_sa@163.com
kafka.eagle.mail.username=alert_sa@163.com
kafka.eagle.mail.password=mqslimczkdqabbbh
kafka.eagle.mail.server.host=smtp.163.com
kafka.eagle.mail.server.port=25######################################
# delete kafka topic token
######################################
kafka.eagle.topic.token=keadmin######################################
# kafka sasl authenticate
######################################
cluster1.kafka.eagle.sasl.enable=false
cluster1.kafka.eagle.sasl.protocol=SASL_PLAINTEXT
cluster1.kafka.eagle.sasl.mechanism=PLAIN
cluster1.kafka.eagle.sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="admin" password="kafka-eagle";######################################
# kafka mysql jdbc driver address
# 数据存储数据配置  mysql/sqlite 以下为mysql配置
######################################
kafka.eagle.driver=com.mysql.cj.jdbc.Driver
kafka.eagle.url=jdbc:mysql://localhost:3306/ke?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull&serverTimezone=UTC
kafka.eagle.username=root
kafka.eagle.password=root123456

第三，最重要的一步来了，使用环境变量找不到指定文件的，那么则不需要配置环境变量，直接手动指定。

进入E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\bin 目录下，右键编辑ke.bat

将所有应用环境变量的地方，替换成你的路径（解压路径）。

比如说：我的 KE_HOME 值为：E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5

则我的ke.bat文件中所有包含 %KE_HOME%的地方，全部替换成 E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5，你的安装路径则替换成自己的。

最后替换后的结果如下，不要替换漏了或者错了。

@echo offrem ---------------------------------------------------------------------------
rem Start script for the KE Server
rem ---------------------------------------------------------------------------echo KE Service check ...setlocalif exist "%JAVA_HOME%" goto okKafkaEagke
echo Error: The JAVA_HOME environment variable is not defined correctly.
echo Error: This environment variable is needed to run this program.
goto end:okKafkaEagke
if exist "E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5" goto okHome
echo Error: The KE_HOME environment variable is not defined correctly.
echo Error: This environment variable is needed to run this program.
goto end:okHomeif exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke (rem Delete ke dir menu.rd /s /q E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
)if exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\work (rem Delete tomcat work dir menu.rd /s /q %KE_HOME%\kms\work
)md E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
cd E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke
rem echo Current Path :: %cd%
%JAVA_HOME%\bin\jar -xvf E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke.warping /n 2 127.1 >nulcd E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5
SET CLSNAME=org.smartloli.kafka.eagle.plugin.server.TomcatServerListensetlocal enabledelayedexpansion
for %%i in (E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\lib\dom*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\log4j*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\slf4j*.jar,%KE_HOME%\kms\webapps\ke\WEB-INF\lib\kafka-eagle*.jar) do (set CLSPATH=!CLSPATH!;%%i
)
rem echo %CLSPATH%
%JAVA_HOME%\bin\java -classpath %CLSPATH% %CLSNAME% >> E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\logs\ke.outecho Kafka Eagle system monitor port successful...ping /n 3 127.1 >nulif exist E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\*.properties (rd /s /q E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\*.properties
)
copy E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\conf\*.properties E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\webapps\ke\WEB-INF\classes\ping /n 3 127.1 >nul
set CATALINA_HOME=E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms
call  E:\soft\ELK\kafka-eagle-bin-2.0.5\kafka-eagle-web-2.0.5\kms\bin\startup.bat:end

根据自己的ke.bat文件进行修改。

最后启动，ctrl+shift+右键，打开powerShell，输入命令ke，然后会弹出一个tomcat窗口，最后解决一下报错信息，就可以啦。

数据库文件：

SET FOREIGN_KEY_CHECKS=0;-- ----------------------------
-- Table structure for ke_alarm_clusters
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_clusters`;
CREATE TABLE `ke_alarm_clusters` (`id` int(11) NOT NULL AUTO_INCREMENT,`type` varchar(255) DEFAULT NULL,`cluster` varchar(255) DEFAULT NULL,`server` varchar(255) DEFAULT NULL,`alarm_group` varchar(255) DEFAULT NULL,`alarm_times` int(11) DEFAULT NULL,`alarm_max_times` int(11) DEFAULT NULL,`alarm_level` varchar(255) DEFAULT NULL,`is_normal` varchar(255) DEFAULT NULL,`is_enable` varchar(255) DEFAULT NULL,`created` varchar(255) DEFAULT NULL,`modify` varchar(255) DEFAULT NULL,PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_alarm_config
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_config`;
CREATE TABLE `ke_alarm_config` (`cluster` varchar(255) DEFAULT NULL,`alarm_group` varchar(255) DEFAULT NULL,`alarm_type` varchar(255) DEFAULT NULL,`alarm_url` varchar(255) DEFAULT NULL,`http_method` varchar(255) DEFAULT NULL,`alarm_address` varchar(255) DEFAULT NULL,`created` varchar(255) DEFAULT NULL,`modify` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_alarm_consumer
-- ----------------------------
DROP TABLE IF EXISTS `ke_alarm_consumer`;
CREATE TABLE `ke_alarm_consumer` (`id` int(11) NOT NULL AUTO_INCREMENT,`cluster` varchar(255) DEFAULT NULL,`group` varchar(255) DEFAULT NULL,`topic` varchar(255) DEFAULT NULL,`lag` bigint(20) DEFAULT NULL,`alarm_group` varchar(255) DEFAULT NULL,`alarm_times` int(11) DEFAULT NULL,`alarm_max_times` int(11) DEFAULT NULL,`alarm_level` varchar(255) DEFAULT NULL,`is_normal` varchar(255) DEFAULT NULL,`is_enable` varchar(255) DEFAULT NULL,`created` varchar(255) DEFAULT NULL,`modify` varchar(255) DEFAULT NULL,PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_connect_config
-- ----------------------------
DROP TABLE IF EXISTS `ke_connect_config`;
CREATE TABLE `ke_connect_config` (`id` bigint(20) NOT NULL AUTO_INCREMENT,`cluster` varchar(255) DEFAULT NULL,`connect_uri` varchar(255) DEFAULT NULL,`version` varchar(255) DEFAULT NULL,`alive` varchar(255) DEFAULT NULL,`created` varchar(255) DEFAULT NULL,`modify` varchar(255) DEFAULT NULL,PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_consumer_bscreen
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_bscreen`;
CREATE TABLE `ke_consumer_bscreen` (`cluster` varchar(255) DEFAULT NULL,`group` varchar(255) DEFAULT NULL,`topic` varchar(255) DEFAULT NULL,`logsize` bigint(20) DEFAULT NULL,`difflogsize` bigint(20) DEFAULT NULL,`offsets` bigint(255) DEFAULT NULL,`diffoffsets` bigint(255) DEFAULT NULL,`lag` bigint(255) DEFAULT NULL,`timespan` bigint(20) DEFAULT NULL,`tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_consumer_group
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_group`;
CREATE TABLE `ke_consumer_group` (`cluster` varchar(255) DEFAULT NULL,`group` varchar(255) DEFAULT NULL,`topic` varchar(255) DEFAULT NULL,`status` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_consumer_group_summary
-- ----------------------------
DROP TABLE IF EXISTS `ke_consumer_group_summary`;
CREATE TABLE `ke_consumer_group_summary` (`cluster` varchar(255) DEFAULT NULL,`group` varchar(255) DEFAULT NULL,`topic_number` int(11) DEFAULT NULL,`coordinator` varchar(255) DEFAULT NULL,`active_topic` int(11) DEFAULT NULL,`active_thread_total` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_logsize
-- ----------------------------
DROP TABLE IF EXISTS `ke_logsize`;
CREATE TABLE `ke_logsize` (`cluster` varchar(255) DEFAULT NULL,`topic` varchar(255) DEFAULT NULL,`logsize` bigint(20) DEFAULT NULL,`diffval` bigint(20) DEFAULT NULL,`timespan` bigint(20) DEFAULT NULL,`tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_metrics
-- ----------------------------
DROP TABLE IF EXISTS `ke_metrics`;
CREATE TABLE `ke_metrics` (`cluster` varchar(255) DEFAULT NULL,`broker` varchar(255) DEFAULT NULL,`type` varchar(255) DEFAULT NULL,`key` varchar(255) DEFAULT NULL,`value` varchar(255) DEFAULT NULL,`timespan` bigint(20) DEFAULT NULL,`tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_metrics_offline
-- ----------------------------
DROP TABLE IF EXISTS `ke_metrics_offline`;
CREATE TABLE `ke_metrics_offline` (`cluster` varchar(255) DEFAULT NULL,`key` varchar(255) DEFAULT NULL,`one` varchar(255) DEFAULT NULL,`mean` varchar(255) DEFAULT NULL,`five` varchar(255) DEFAULT NULL,`fifteen` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_p_role
-- ----------------------------
DROP TABLE IF EXISTS `ke_p_role`;
CREATE TABLE `ke_p_role` (`id` int(11) NOT NULL AUTO_INCREMENT,`role_name` varchar(255) DEFAULT NULL,`role_describer` varchar(255) DEFAULT NULL,PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_resources
-- ----------------------------
DROP TABLE IF EXISTS `ke_resources`;
CREATE TABLE `ke_resources` (`resource_id` int(11) NOT NULL AUTO_INCREMENT,`name` varchar(255) DEFAULT NULL,`url` varchar(255) DEFAULT NULL,`parentId` int(11) DEFAULT NULL,PRIMARY KEY (`resource_id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_role_resource
-- ----------------------------
DROP TABLE IF EXISTS `ke_role_resource`;
CREATE TABLE `ke_role_resource` (`role_id` int(11) DEFAULT NULL,`resource_id` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_sql_history
-- ----------------------------
DROP TABLE IF EXISTS `ke_sql_history`;
CREATE TABLE `ke_sql_history` (`id` int(11) NOT NULL AUTO_INCREMENT,`cluster` varchar(255) DEFAULT NULL,`username` varchar(255) DEFAULT NULL,`host` varchar(255) DEFAULT NULL,`ksql` varchar(255) DEFAULT NULL,`status` varchar(255) DEFAULT NULL,`spend_time` bigint(20) DEFAULT NULL,`created` varchar(255) DEFAULT NULL,`tm` varchar(255) DEFAULT NULL,PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_topic_offsets
-- ----------------------------
DROP TABLE IF EXISTS `ke_topic_offsets`;
CREATE TABLE `ke_topic_offsets` (`cluster` varchar(255) DEFAULT NULL,`group` varchar(255) DEFAULT NULL,`topic` varchar(255) DEFAULT NULL,`logsize` double DEFAULT NULL,`offsets` varchar(255) DEFAULT NULL,`lag` varchar(255) DEFAULT NULL,`timespan` datetime DEFAULT NULL,`tm` varchar(255) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_topic_rank
-- ----------------------------
DROP TABLE IF EXISTS `ke_topic_rank`;
CREATE TABLE `ke_topic_rank` (`cluster` varchar(255) DEFAULT NULL,`topic` varchar(255) DEFAULT NULL,`tkey` varchar(255) DEFAULT NULL,`tvalue` bigint(20) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_users
-- ----------------------------
DROP TABLE IF EXISTS `ke_users`;
CREATE TABLE `ke_users` (`id` int(11) NOT NULL AUTO_INCREMENT,`rtxno` int(11) DEFAULT NULL,`username` varchar(255) DEFAULT NULL,`password` varchar(255) DEFAULT NULL,`email` varchar(255) DEFAULT NULL,`realname` varchar(255) DEFAULT NULL,PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=2 DEFAULT CHARSET=utf8;-- ----------------------------
-- Table structure for ke_user_role
-- ----------------------------
DROP TABLE IF EXISTS `ke_user_role`;
CREATE TABLE `ke_user_role` (`user_id` int(11) DEFAULT NULL,`role_id` int(11) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;INSERT INTO `ke`.`ke_users` (`id`, `rtxno`, `username`, `password`, `email`, `realname`) VALUES ('1', '1000', 'admin', '123456', 'admin@email.com', 'Administrator');