找建设项目的网站,软文优化,做网站有哪些程序,凡客诚品vElasticSearch第四讲#xff1a;ES详解#xff1a;ElasticSearch和Kibana安装 本文是ElasticSearch第四讲#xff1a;ElasticSearch和Kibana安装#xff0c;主要介绍ElasticSearch和Kibana的安装。了解完ElasticSearch基础和Elastic Stack生态后#xff0c;我们便可以开始…ElasticSearch第四讲ES详解ElasticSearch和Kibana安装 本文是ElasticSearch第四讲ElasticSearch和Kibana安装主要介绍ElasticSearch和Kibana的安装。了解完ElasticSearch基础和Elastic Stack生态后我们便可以开始学习使用ElastiSearch了。 文章目录 ElasticSearch第四讲ES详解ElasticSearch和Kibana安装1、官网相关教程2、安装ElasticSearch3、安装Kibana4、配置密码访问 1、官网相关教程 安装ElasticSearch还是先要看下官方网站。 官方网站官方2.x中文教程中安装教程官方ElasticSearch下载地址官方Kibana下载地址
本系列教程基于ElasticSearch 7.x版本。
2、安装ElasticSearch ElasticSearch 是基于Java平台的所以先要安装Java 平台确认
这里我准备了一台Centos7虚拟机为方便选择后续安装的版本所以需要看下系统版本信息。
[rootqwj-centos ~]# uname -a
Linux qwj-centos 3.10.0-862.el7.x86_64 #1 SMP Fri Apr 20 16:44:24 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux安装Java
安装 Elasticsearch 之前你需要先安装一个较新的版本的 Java最好的选择是你可以从 www.java.com 获得官方提供的最新版本的 Java。安装以后确认是否安装成功
[rootqwj-centos ~]# java --version
openjdk 11.0.2 2019-01-15
OpenJDK Runtime Environment 20.3 (slowdebug build 11.0.212)
OpenJDK 64-Bit Server VM 20.3 (slowdebug build 11.0.212, mixed mode, sharing)下载ElasticSearch
从这里下载ElasticSearch
比如可以通过curl下载
[rootqwj-centos opt]# curl -O https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.12.0-linux-x86_64.tar.gz% Total % Received % Xferd Average Speed Time Time Time CurrentDload Upload Total Spent Left Speed解压
[rootqwj-centos opt]# tar zxvf /opt/elasticsearch-7.12.0-linux-x86_64.tar.gz
...
[rootqwj-centos opt]# ll | grep elasticsearch
drwxr-xr-x 9 root root 4096 Mar 18 14:21 elasticsearch-7.12.0
-rw-r--r-- 1 root root 327497331 Apr 5 21:05 elasticsearch-7.12.0-linux-x86_64.tar.gz增加elasticSearch用户
必须创建一个非root用户来运行 ElasticSearch (ElasticSearch5及以上版本基于安全考虑强制规定不能以root身份运行。)
如果你使用root用户来启动ElasticSearch则会有如下错误信息
[rootqwj-centos opt]# cd elasticsearch-7.12.0/
[rootqwj-centos elasticsearch-7.12.0]# ./bin/elasticsearch
[2021-04-05T21:36:46,510][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [qwj-centos] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.RuntimeException: can not run elasticsearch as rootat org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116) ~[elasticsearch-cli-7.12.0.jar:7.12.0]at org.elasticsearch.cli.Command.main(Command.java:79) ~[elasticsearch-cli-7.12.0.jar:7.12.0]at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81) ~[elasticsearch-7.12.0.jar:7.12.0]
Caused by: java.lang.RuntimeException: can not run elasticsearch as rootat org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:101) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:168) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:397) ~[elasticsearch-7.12.0.jar:7.12.0]at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.12.0.jar:7.12.0]... 6 more
uncaught exception in thread [main]
java.lang.RuntimeException: can not run elasticsearch as rootat org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:101)at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:168)at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:397)at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159)at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:75)at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:116)at org.elasticsearch.cli.Command.main(Command.java:79)at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:81)
For complete error details, refer to the log at /opt/elasticsearch-7.12.0/logs/elasticsearch.log
2021-04-05 13:36:46,979269 UTC [8846] INFO Main.cc106 Parent process died - ML controller exiting所以我们增加一个独立的elasticsearch用户来运行
# 增加elasticsearch用户
[rootqwj-centos elasticsearch-7.12.0]# useradd elasticsearch
[rootqwj-centos elasticsearch-7.12.0]# passwd elasticsearch
Changing password for user elasticsearch.
New password:
BAD PASSWORD: The password contains the user name in some form
Retype new password:
passwd: all authentication tokens updated successfully.# 修改目录权限至新增的elasticsearch用户
[rootqwj-centos elasticsearch-7.12.0]# chown -R elasticsearch /opt/elasticsearch-7.12.0
# 增加data和log存放区并赋予elasticsearch用户权限
[rootqwj-centos elasticsearch-7.12.0]# mkdir -p /data/es
[rootqwj-centos elasticsearch-7.12.0]# chown -R elasticsearch /data/es
[rootqwj-centos elasticsearch-7.12.0]# mkdir -p /var/log/es
[rootqwj-centos elasticsearch-7.12.0]# chown -R elasticsearch /var/log/es然后修改上述的data和log路径vi /opt/elasticsearch-7.12.0/config/elasticsearch.yml
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /data/es
#
# Path to log files:
#
path.logs: /var/log/es修改Linux系统的限制配置
修改系统中允许应用最多创建多少文件等的限制权限。Linux默认来说一般限制应用最多创建的文件是65535个。但是ES至少需要65536的文件创建权限。修改系统中允许用户启动的进程开启多少个线程。默认的Linux限制root用户开启的进程可以开启任意数量的线程其他用户开启的进程可以开启1024个线程。必须修改限制数为4096。因为ES至少需要4096的线程池预备。ES在5.x版本之后强制要求在linux中不能使用root用户启动ES进程。所以必须使用其他用户启动ES进程才可以。Linux低版本内核为线程分配的内存是128K。4.x版本的内核分配的内存更大。如果虚拟机的内存是1G最多只能开启3000个线程数。至少为虚拟机分配1.5G以上的内存。
修改如下配置
[rootqwj-centos elasticsearch-7.12.0]# vi /etc/security/limits.confelasticsearch soft nofile 65536
elasticsearch hard nofile 65536
elasticsearch soft nproc 4096
elasticsearch hard nproc 4096启动ElasticSearch
[rootqwj-centos elasticsearch-7.12.0]# su elasticsearch
[elasticsearchqwj-centos elasticsearch-7.12.0]$ ./bin/elasticsearch -d
[2021-04-05T22:03:38,332][INFO ][o.e.n.Node ] [qwj-centos] version[7.12.0], pid[13197], build[default/tar/78722783c38caa25a70982b5b042074cde5d3b3a/2021-03-18T06:17:15.410153305Z], OS[Linux/3.10.0-862.el7.x86_64/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.19]
[2021-04-05T22:03:38,348][INFO ][o.e.n.Node ] [qwj-centos] JVM home [/opt/elasticsearch-7.12.0/jdk], using bundled JDK [true]
[2021-04-05T22:03:38,348][INFO ][o.e.n.Node ] [qwj-centos] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl60, -Des.networkaddress.cache.negative.ttl10, -XX:AlwaysPreTouch, -Xss1m, -Djava.awt.headlesstrue, -Dfile.encodingUTF-8, -Djna.nosystrue, -XX:-OmitStackTraceInFastThrow, -XX:ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafetrue, -Dio.netty.noKeySetOptimizationtrue, -Dio.netty.recycler.maxCapacityPerThread0, -Dio.netty.allocator.numDirectArenas0, -Dlog4j.shutdownHookEnabledfalse, -Dlog4j2.disable.jmxtrue, -Djava.locale.providersSPI,COMPAT, --add-opensjava.base/java.ioALL-UNNAMED, -XX:UseG1GC, -Djava.io.tmpdir/tmp/elasticsearch-17264135248464897093, -XX:HeapDumpOnOutOfMemoryError, -XX:HeapDumpPathdata, -XX:ErrorFilelogs/hs_err_pid%p.log, -Xlog:gc*,gcagetrace,safepoint:filelogs/gc.log:utctime,pid,tags:filecount32,filesize64m, -Xms1894m, -Xmx1894m, -XX:MaxDirectMemorySize993001472, -XX:G1HeapRegionSize4m, -XX:InitiatingHeapOccupancyPercent30, -XX:G1ReservePercent15, -Des.path.home/opt/elasticsearch-7.12.0, -Des.path.conf/opt/elasticsearch-7.12.0/config, -Des.distribution.flavordefault, -Des.distribution.typetar, -Des.bundled_jdktrue]查看安装是否成功
[rootqwj-centos ~]# netstat -ntlp | grep 9200
tcp6 0 0 127.0.0.1:9200 :::* LISTEN 13549/java
tcp6 0 0 ::1:9200 :::* LISTEN 13549/java
[rootqwj-centos ~]# curl 127.0.0.1:9200
{name : qwj-centos,cluster_name : elasticsearch,cluster_uuid : ihttW8b2TfWSkwf_YgPH2Q,version : {number : 7.12.0,build_flavor : default,build_type : tar,build_hash : 78722783c38caa25a70982b5b042074cde5d3b3a,build_date : 2021-03-18T06:17:15.410153305Z,build_snapshot : false,lucene_version : 8.8.0,minimum_wire_compatibility_version : 6.8.0,minimum_index_compatibility_version : 6.0.0-beta1},tagline : You Know, for Search
}3、安装Kibana Kibana是界面化的查询数据的工具下载时尽量下载与ElasicSearch一致的版本。 下载Kibana
从这里下载Kibana
解压
[rootqwj-centos opt]# tar -vxzf kibana-7.12.0-linux-x86_64.tar.gz使用elasticsearch用户权限
[rootqwj-centos opt]# chown -R elasticsearch /opt/kibana-7.12.0-linux-x86_64
#配置Kibana的远程访问
[rootqwj-centos opt]# vi /opt/kibana-7.12.0-linux-x86_64/config/kibana.yml
server.host: 0.0.0.0启动
需要切换至elasticsearch用户
[rootqwj-centos opt]# su elasticsearch
[elasticsearchqwj-centos opt]$ cd /opt/kibana-7.12.0-linux-x86_64/
[elasticsearchqwj-centos kibana-7.12.0-linux-x86_64]$ ./bin/kibanalog [22:30:22.185] [info][plugins-service] Plugin osquery is disabled.log [22:30:22.283] [warning][config][deprecation] Config key [monitoring.cluster_alerts.email_notifications.email_address] will be required for email notifications to work in 8.0.log [22:30:22.482] [info][plugins-system] Setting up [100] plugins: [taskManager,licensing,globalSearch,globalSearchProviders,banners,code,usageCollection,xpackLegacy,telemetryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,securityOss,share,newsfeed,mapsLegacy,kibanaLegacy,translations,legacyExport,embeddable,uiActionsEnhanced,expressions,charts,esUiShared,bfetch,data,home,observability,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,indexPatternManagement,advancedSettings,fileUpload,savedObjects,visualizations,visTypeVislib,visTypeVega,visTypeTimelion,features,licenseManagement,watcher,canvas,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,tileMap,regionMap,visTypeXy,graph,timelion,dashboard,dashboardEnhanced,visualize,visTypeTimeseries,inputControlVis,discover,discoverEnhanced,savedObjectsManagement,spaces,security,savedObjectsTagging,maps,lens,reporting,lists,encryptedSavedObjects,dashboardMode,dataEnhanced,cloud,upgradeAssistant,snapshotRestore,fleet,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,beatsManagement,transform,ingestPipelines,eventLog,actions,alerts,triggersActionsUi,stackAlerts,ml,securitySolution,case,infra,monitoring,logstash,apm,uptime]log [22:30:22.483] [info][plugins][taskManager] TaskManager is identified by the Kibana UUID: xxxxxx...如果是后台启动
[elasticsearchqwj-centos kibana-7.12.0-linux-x86_64]$ nohup ./bin/kibana 界面访问 可以导入simple data 查看数据
4、配置密码访问 使用基本许可证时默认情况下禁用Elasticsearch安全功能。由于我测试环境是放在公网上的所以需要设置下密码访问。相关文档可以参考这里 停止kibana和elasticsearch服务将xpack.security.enabled设置添加到ES_PATH_CONF/elasticsearch.yml文件并将值设置为true启动elasticsearch (./bin/elasticsearch -d)执行如下密码设置器./bin/elasticsearch-setup-passwords interactive来设置各个组件的密码将elasticsearch.username设置添加到KIB_PATH_CONF/kibana.yml 文件并将值设置给elastic用户 elasticsearch.username: elastic创建kibana keystore, ./bin/kibana-keystore create在kibana keystore 中添加密码 ./bin/kibana-keystore add elasticsearch.password重启kibana 服务即可 nohup ./bin/kibana
然后就可以使用密码登录了
