下载建设银行官方网站下载,网站开发定制多少钱,十大技能培训机构排名,wordpress千位分隔符 阅卖次数目录 一.环境信息二.安装nfs供应商三.安装elasticsearch四.安装kibana组件五.安装fluentd 一.环境信息
1.服务器及k8s版本
IP地址主机名称角色版本192.168.40.180master1master节点1.27192.168.40.181node1node1节点1.27192.168.40.182node2node2节点1.27
2.部署组件版本
序… 目录 一.环境信息二.安装nfs供应商三.安装elasticsearch四.安装kibana组件五.安装fluentd 一.环境信息
1.服务器及k8s版本
IP地址主机名称角色版本192.168.40.180master1master节点1.27192.168.40.181node1node1节点1.27192.168.40.182node2node2节点1.27
2.部署组件版本
序号名称版本作用1elasticsearch7.12.1是一个实时的分布式搜索和分析引擎它可以用于全文搜索结构化搜索以及分析。2kibana7.12.1为 Elasticsearch 提供了分析和 Web 可视化界面并生成各种维度表格、图形3fluentdv1.16是一个数据收集引擎主要用于进行数据收集、解析并将数据发送给ES4nfs-client-provisionerv4.0.0nfs供应商
master1和node2节点上传fluentd组件 node1节点上传全部的组件 链接https://pan.baidu.com/s/1u2U87Jp4TzJxs7nfVqKM-w 提取码fcpp –来自百度网盘超级会员V4的分享 链接https://pan.baidu.com/s/1ttMaqmeVNpOAJD8G3-6tag 提取码qho8 –来自百度网盘超级会员V4的分享 链接https://pan.baidu.com/s/1ttMaqmeVNpOAJD8G3-6tag 提取码qho8 链接https://pan.baidu.com/s/1cQSkGz0NO_rrulas2EYv5Q 提取码rxjx –来自百度网盘超级会员V4的分享
二.安装nfs供应商
1.安装nfs服务 三个节点都操作
yum -y install nfs-utils2.启动nfs服务并设置开机自启 三个节点都操作
# 开启服务
systemctl start nfs
# 设置开机自启
systemctl enable nfs.service3.在master1上创建一个共享目录
# 创建目录
mkdir /data/v1 -p# 编辑/etc/exports文件
vim /etc/exports
/data/v1 *(rw,no_root_squash)#加载配置使文件生效
exportfs -arv
systemctl restart nfs4.创建nfs作为存储的供应商 master1上执行 4.1创建运行nfs-provisioner需要的账号
vim serviceaccount.yaml
---
apiVersion: v1
kind: ServiceAccount
metadata:name: nfs-provisioner执行配置
kubectl apply -f serviceaccount.yaml4.2对sa授权
kubectl create clusterrolebinding nfs-provisioner-clusterrolebinding --clusterrolecluster-admin --serviceaccountdefault:nfs-provisioner把nfs-subdir-external-provisioner.tar.gz上传到node1上手动解压。
ctr -nk8s.io images import nfs-subdir-external-provisioner.tar.gz4.3通过deployment创建pod用来运行nfs-provisioner
vim deployment.yaml
---
kind: Deployment
apiVersion: apps/v1
metadata:name: nfs-provisioner
spec:selector:matchLabels:app: nfs-provisionerreplicas: 1strategy:type: Recreatetemplate:metadata:labels:app: nfs-provisionerspec:serviceAccount: nfs-provisionercontainers:- name: nfs-provisionerimage: registry.cn-beijing.aliyuncs.com/mydlq/nfs-subdir-external-provisioner:v4.0.0imagePullPolicy: IfNotPresentvolumeMounts:- name: nfs-client-rootmountPath: /persistentvolumesenv:- name: PROVISIONER_NAMEvalue: example.com/nfs- name: NFS_SERVERvalue: 192.168.40.180
#这个需要写nfs服务端所在的ip地址大家需要写自己安装了nfs服务的机器ip- name: NFS_PATHvalue: /data/v1
#这个是nfs服务端共享的目录volumes:- name: nfs-client-rootnfs:server: 192.168.40.180path: /data/v1执行配置文件
kubectl apply -f deployment.yaml查看是否创建成功
kubectl get pods | grep nfs5.创建存储类storgeclass mster1上执行
vim es_class.yaml
---
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:name: do-block-storage
provisioner: example.com/nfs执行配置
kubectl apply -f es_class.yaml三.安装elasticsearch
在master1上执行 1.创建kube-logging名称空间
vim kube-logging.yaml
---
kind: Namespace
apiVersion: v1
metadata:name: kube-logging执行配置
kubectl apply -f kube-logging.yaml2.安装elasticsearch组件
vim elasticsearch_svc.yaml
---
kind: Service
apiVersion: v1
metadata:name: elasticsearchnamespace: kube-logginglabels:app: elasticsearch
spec:selector:app: elasticsearchclusterIP: Noneports:- port: 9200name: rest- port: 9300name: inter-node执行配置文件
kubectl apply -f elasticsearch_svc.yaml3.创建statefulset资源
vim elasticsearch-statefulset.yaml
---
apiVersion: apps/v1
kind: StatefulSet
metadata:name: es-clusternamespace: kube-logging
spec:serviceName: elasticsearchreplicas: 3selector:matchLabels:app: elasticsearchtemplate:metadata:labels:app: elasticsearchspec:containers:- name: elasticsearchimage: docker.io/library/elasticsearch:7.12.1imagePullPolicy: IfNotPresentresources:limits:cpu: 1000mrequests:cpu: 100mports:- containerPort: 9200name: restprotocol: TCP- containerPort: 9300name: inter-nodeprotocol: TCPvolumeMounts:- name: datamountPath: /usr/share/elasticsearch/dataenv:- name: cluster.namevalue: k8s-logs- name: node.namevalueFrom:fieldRef:fieldPath: metadata.name- name: discovery.seed_hostsvalue: es-cluster-0.elasticsearch,es-cluster-1.elasticsearch,es-cluster-2.elasticsearch- name: cluster.initial_master_nodesvalue: es-cluster-0,es-cluster-1,es-cluster-2- name: ES_JAVA_OPTSvalue: -Xms512m -Xmx512minitContainers:- name: fix-permissionsimage: busyboximagePullPolicy: IfNotPresentcommand: [sh, -c, chown -R 1000:1000 /usr/share/elasticsearch/data]securityContext:privileged: truevolumeMounts:- name: datamountPath: /usr/share/elasticsearch/data- name: increase-vm-max-mapimage: busyboximagePullPolicy: IfNotPresentcommand: [sysctl, -w, vm.max_map_count262144]securityContext:privileged: true- name: increase-fd-ulimitimage: busyboximagePullPolicy: IfNotPresentcommand: [sh, -c, ulimit -n 65536]securityContext:privileged: truevolumeClaimTemplates:- metadata:name: datalabels:app: elasticsearchspec:accessModes: [ ReadWriteOnce ]storageClassName: do-block-storageresources:requests:storage: 10Gi执行配置
kubectl apply -f elasticsearch-statefulset.yaml四.安装kibana组件
vim kibana.yaml
---
apiVersion: v1
kind: Service
metadata:name: kibananamespace: kube-logginglabels:app: kibana
spec:ports:- port: 5601type: NodePortselector:app: kibana
---
apiVersion: apps/v1
kind: Deployment
metadata:name: kibananamespace: kube-logginglabels:app: kibana
spec:replicas: 1selector:matchLabels:app: kibanatemplate:metadata:labels:app: kibanaspec:containers:- name: kibanaimage: docker.io/library/kibana:7.12.1imagePullPolicy: IfNotPresentresources:limits:cpu: 1000mrequests:cpu: 100menv:- name: ELASTICSEARCH_URLvalue: http://elasticsearch:9200ports:- containerPort: 5601执行配置
kubectl apply -f kibana.yaml在浏览器中打开http://k8s集群任意节点IP:31552即可如果看到如下欢迎界面证明 Kibana 已经成功部署到了Kubernetes集群之中。 五.安装fluentd
我们使用daemonset控制器部署fluentd组件这样可以保证集群中的每个节点都可以运行同样fluentd的pod副本这样就可以收集k8s集群中每个节点的日志在k8s集群中容器应用程序的输入输出日志会重定向到node节点里的json文件中fluentd可以tail和过滤以及把日志转换成指定的格式发送到elasticsearch集群中。除了容器日志fluentd也可以采集kubelet、kube-proxy、docker的日志。
vim fluentd.yaml
---
kind: ServiceAccount
metadata:name: fluentdnamespace: kube-logginglabels:app: fluentd
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:name: fluentdlabels:app: fluentd
rules:
- apiGroups:- resources:- pods- namespacesverbs:- get- list- watch
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:name: fluentd
roleRef:kind: ClusterRolename: fluentdapiGroup: rbac.authorization.k8s.io
subjects:
- kind: ServiceAccountname: fluentdnamespace: kube-logging
---
apiVersion: apps/v1
kind: DaemonSet
metadata:name: fluentdnamespace: kube-logginglabels:app: fluentd
spec:selector:matchLabels:app: fluentdtemplate:metadata:labels:app: fluentdspec:serviceAccount: fluentdserviceAccountName: fluentdtolerations:- key: node-role.kubernetes.io/control-planeeffect: NoSchedulecontainers:- name: fluentdimage: docker.io/fluent/fluentd-kubernetes-daemonset:v1.16-debian-elasticsearch7-1imagePullPolicy: IfNotPresentenv:- name: FLUENT_ELASTICSEARCH_HOSTvalue: elasticsearch.kube-logging.svc.cluster.local- name: FLUENT_ELASTICSEARCH_PORTvalue: 9200- name: FLUENT_ELASTICSEARCH_SCHEMEvalue: http- name: FLUENTD_SYSTEMD_CONFvalue: disable- name: FLUENT_CONTAINER_TAIL_PARSER_TYPEvalue: cri- name: FLUENT_CONTAINER_TAIL_PARSER_TIME_FORMATvalue: %Y-%m-%dT%H:%M:%S.%L%zresources:limits:memory: 512Mirequests:cpu: 100mmemory: 200MivolumeMounts:- name: varlogmountPath: /var/log- name: containersmountPath: /var/log/containersreadOnly: trueterminationGracePeriodSeconds: 30volumes:- name: varloghostPath:path: /var/log- name: containershostPath:path: /var/log/containers执行配置
kubectl apply -f fluentd.yamlFluentd 启动成功后我们可以前往 Kibana 的 Dashboard 页面中点击左侧的Discover可以看到如下配置页面
