目录

云原生监控体系构建实录从Prometheus到Grafana的观测革命

《云原生监控体系构建实录:从Prometheus到Grafana的观测革命》

Prometheus+Grafana部署配置

Prometheus安装

下载Prometheus服务端

https://i-blog.csdnimg.cn/direct/6a82fe360e92413cb66c40efec7da703.png

[Download | Prometheus

An open-source monitoring system with a dimensional data model, flexible query language, efficient time series database and modern alerting approach.

https://csdnimg.cn/release/blog_editor_html/release2.3.8/ckeditor/plugins/CsdnLink/icons/icon-default.png?t=P1C7 “Download | Prometheus”)

https://i-blog.csdnimg.cn/direct/65fb9c04a9cb43b2afd277c7b45d4b24.png

https://i-blog.csdnimg.cn/direct/0f0bda13b3494f30996625f36455ee8d.png

上传至服务器,解压

tar -zxvf prometheus-3.0.1.linux-amd64.tar.gz

https://i-blog.csdnimg.cn/direct/0385e70cf82a4132bdc6137306e94139.png

cd prometheus-3.0.1.linux-amd64

https://i-blog.csdnimg.cn/direct/aff02f4299a24009881e520bf93f826b.png

运行

./prometheus --config.file="prometheus.yml"

后台运行

nohup ./prometheus --config.file=prometheus.yml &

https://i-blog.csdnimg.cn/direct/b29c520040084b1487300a867de76bae.png

当首次访问9090端口时,时间序列数据的洪流如同宇宙背景辐射般扑面而来。

https://i-blog.csdnimg.cn/direct/17ffe1fd94c94eaeaee77cab0f80b367.png

Grafana安装

Grafana是一个可视化面板(Dashboard),有着非常漂亮的图表和布局展示,功能齐全的度量仪表盘和图形编辑器,支持Graphite、zabbix、InfluxDB、Prometheus

下载地址: [Download Grafana | Grafana Labs

Overview of how to download and install different versions of Grafana on different operating systems.

https://csdnimg.cn/release/blog_editor_html/release2.3.8/ckeditor/plugins/CsdnLink/icons/icon-default.png?t=P1C7 “Download Grafana | Grafana Labs”)

https://i-blog.csdnimg.cn/direct/4d23c7efe2b4478890bb9c897b5b97d4.png

yum localinstall -y grafana-6.5.0-1.x86_64.rpm

https://i-blog.csdnimg.cn/direct/64811a25b8b14cc6a9cc3b5a2c188fc7.png

systemctl start grafana-server

访问页面http://服务器IP:3000 ,默认账号、密码admin/admin

https://i-blog.csdnimg.cn/direct/09ba9ba65b314c22ab1be4d007b1226e.png

https://i-blog.csdnimg.cn/direct/2b873d660ee04d5fa8902ba23aab3ec0.png

Prometheus被监控端安装插件

下载插件(此处下载一个node 和 mysql插件)

[Download | Prometheus

An open-source monitoring system with a dimensional data model, flexible query language, efficient time series database and modern alerting approach.

https://csdnimg.cn/release/blog_editor_html/release2.3.8/ckeditor/plugins/CsdnLink/icons/icon-default.png?t=P1C7 “Download | Prometheus”)

https://i-blog.csdnimg.cn/direct/3a7b1c33130f474999896014aa2733d8.png

在被监控端主机解压这两个文件

tar -zxvf node_exporter-1.8.2.linux-amd64.tar.gz 
node_exporter插件可直接运行

cd node_exporter-1.8.2.linux-amd64

node_exporter插件可直接运行

cd node_exporter-1.8.2.linux-amd64

https://i-blog.csdnimg.cn/direct/cff19bc270514cae8009e42f393d432f.png

nohup ./node_exporter &

https://i-blog.csdnimg.cn/direct/42c51d41aeff43a29cb0c0afdee706bb.png

mysqld_exporter需要连接到MySQL,需要授权

mysqld_exporter插件需要创建一个用户+密码的文件

tar -zxvf mysqld_exporter-0.16.0.linux-amd64.tar.gz

https://i-blog.csdnimg.cn/direct/0b594e793ff84c5682e7a2872d339318.png

cd mysqld_exporter-0.16.0.linux-amd64

https://i-blog.csdnimg.cn/direct/9fdfadd445bc471c8cedd324b009db0a.png

mysql> use mysql;

mysql> create user dbuser;

https://i-blog.csdnimg.cn/direct/4cab73d790b846f98dc7deb3205f50ca.png

mysql> GRANT REPLICATION CLIENT, PROCESS ON *.* TO 'dbuser'@'localhost' identified by '123456';

https://i-blog.csdnimg.cn/direct/ae6cb4f8315b41bf84399e6b6bb3bd99.png

mysql> GRANT SELECT ON performance_schema.* TO 'dbuser'@'localhost';

https://i-blog.csdnimg.cn/direct/00e09861898b4e13a51bf9002f227c6b.png

创建 .my.cnf 加入以下内容

[client]

user=dbuser

password=123456

https://i-blog.csdnimg.cn/direct/f5cf451ad7a14e3eb6091e7b9123f801.png

启动mysqld_exporter

nohup ./mysqld_exporter --config.my-cnf=.my.cnf &

https://i-blog.csdnimg.cn/direct/45d5cf00f3854ab4be9a9fe146f47032.png

Prometheus服务端添加被监控端

https://i-blog.csdnimg.cn/direct/1973846fa6ff4d51af326975dd3ba0da.png

cd prometheus-3.0.1.linux-amd64
vi prometheus.yml  加入

  - job_name: system-status

    static_configs:

    - targets: ['192.168.126.50:9100']

      labels:

        instance: 7-7



  - job_name: mysql-status

    static_configs:

    - targets: ['192.168.126.40:9104']

      labels:

        instance: 7-7-mysql

https://i-blog.csdnimg.cn/direct/97b9a8764d4f424cbf297f05d66cbb11.png

​访问Prometheus   http://192.168.126.30:9090/targets

https://i-blog.csdnimg.cn/direct/84f5936e8ad049a9a9aa7adfdb566582.png

https://i-blog.csdnimg.cn/direct/224713b6bc344624a5540ef5105738e7.png

Grafana对接Prometheus

添加源数据

https://i-blog.csdnimg.cn/direct/cc93670f9593494c9abd6a9293f40fdf.png

https://i-blog.csdnimg.cn/direct/28835fbfaba14592921c18dcd69256b6.png

https://i-blog.csdnimg.cn/direct/b652cc5471dd464299a1ec514a4af221.png

https://i-blog.csdnimg.cn/direct/40dee00b7b584c7b9d8cd9ddf70907cd.png

https://i-blog.csdnimg.cn/direct/1c139add5d714e909c9ae95b95eeadf6.png

添加成功

Grafana添加图表

自带dashboard

https://i-blog.csdnimg.cn/direct/dc001574473b4f348d92acb4be30e1e6.png

https://i-blog.csdnimg.cn/direct/ea2f81bf0c704e86ad44f89e34ef0876.png

https://i-blog.csdnimg.cn/direct/c3325ad76daa48bc963d5e689dffcb69.png

https://i-blog.csdnimg.cn/direct/ee01e0383b6c44d18c42a881077a9de1.png

下载地址

[Grafana dashboards | Grafana Labs

Browse a library of official and community-built dashboards.

https://csdnimg.cn/release/blog_editor_html/release2.3.8/ckeditor/plugins/CsdnLink/icons/icon-default.png?t=P1C7 “Grafana dashboards | Grafana Labs”)

https://i-blog.csdnimg.cn/direct/32cc1f6ea0e6411f9be0f243702f6b6a.png

https://i-blog.csdnimg.cn/direct/f3fdaa9a7cb244a288453508a494fbca.png

导入

https://i-blog.csdnimg.cn/direct/b311b34697e342dda761d76b089aa48a.png

https://i-blog.csdnimg.cn/direct/f2613002195f47f7aaf14f2b648cd849.png

https://i-blog.csdnimg.cn/direct/ec205c2d31d440c193e6ce6c105de8d0.png

https://i-blog.csdnimg.cn/direct/30e1c93007ec4378bf7790cde3612be3.png

https://i-blog.csdnimg.cn/direct/756cdcf3f99d4184bf480927326244d5.png