當(dāng)前位置:首頁 > IT技術(shù) > 編程語言 > 正文

          Python采集linux服務(wù)器數(shù)據(jù)在Django Web界面展示
          2022-02-14 14:11:19


          Django顯示服務(wù)器性能監(jiān)控


          • 監(jiān)控系統(tǒng)CPU、內(nèi)存和進(jìn)程信息

          • 一、運(yùn)行環(huán)境與項目目錄
          • 二、配置文檔:Setting
          • 二、創(chuàng)建 Models,操作數(shù)據(jù)
          • 三、創(chuàng)建數(shù)據(jù)庫
          • 四、 views.py
          • 五、創(chuàng)建html模版
          • 六、urls.py添加路由
          • 七、運(yùn)行程序,顯示結(jié)果


          監(jiān)控系統(tǒng)CPU、內(nèi)存和進(jìn)程信息

          一、運(yùn)行環(huán)境與項目目錄


          1. Django 2.0.7
          2. python 3.7
          3. pymysql 0.9.3

          Python采集linux服務(wù)器數(shù)據(jù)在Django Web界面展示_zookeeper

          二、配置文檔:Setting

          1.mysql 數(shù)據(jù)庫

          # Author: Allan
          # Datetime: 2019-05-21
          import pymysql
          pymysql.install_as_MySQLdb()




          DATABASES = {
          'default': {
          # 注釋sqlite3
          # 'ENGINE': 'django.db.backends.sqlite3',
          # 'NAME': os.path.join(BASE_DIR, 'db.sqlite3'),




          # mysql
          'ENGINE': 'django.db.backends.mysql',
          'NAME': 'database',
          'USER': 'username',
          'PASSWORD': 'password',
          'HOST': 'ip',
          'PORT': 3306,
          }
          }

          2.Application definition

          INSTALLED_APPS = [
          'django.contrib.admin',
          'django.contrib.auth',
          'django.contrib.contenttypes',
          'django.contrib.sessions',
          'django.contrib.messages',
          'django.contrib.staticfiles',
          'web' #添加App,下面python3 mkmigrations web使用
          ]


          MIDDLEWARE = [
          'django.middleware.security.SecurityMiddleware',
          'django.contrib.sessions.middleware.SessionMiddleware',
          'django.middleware.common.CommonMiddleware',
          # 'django.middleware.csrf.CsrfViewMiddleware', 注釋這一行,防止403錯誤
          'django.contrib.auth.middleware.AuthenticationMiddleware',
          'django.contrib.messages.middleware.MessageMiddleware',
          'django.middleware.clickjacking.XFrameOptionsMiddleware',
          ]


          ROOT_URLCONF = 'monitor.urls'


          TEMPLATES = [
          {
          'BACKEND': 'django.template.backends.django.DjangoTemplates',
          'DIRS': [os.path.join(BASE_DIR, 'templates')], #修改模版目錄
          'APP_DIRS': True,
          'OPTIONS': {
          'context_processors': [
          'django.template.context_processors.debug',
          'django.template.context_processors.request',
          'django.contrib.auth.context_processors.auth',
          'django.contrib.messages.context_processors.messages',
          ],
          },
          },
          ]

          3.Security

          # SECURITY WARNING: don't run with debug turned on in production!
          DEBUG = True


          ALLOWED_HOSTS = ['*']

          4.Internationalization

          LANGUAGE_CODE = 'en-us'
          # 修改時區(qū)
          TIME_ZONE = 'Asia/Shanghai'


          USE_I18N = True


          USE_L10N = True
          # 修改時區(qū)
          USE_TZ = False

          二、創(chuàng)建 Models,操作數(shù)據(jù)

          from django.db import models


          # Create your models here.




          class CpuInfo(models.Model):
          # CPU信息
          time = models.DateTimeField()
          host = models.CharField(max_length=40)
          usage_system = models.FloatField(null=True)
          usage_user = models.FloatField(null=True)
          usage_softirq = models.FloatField(null=True)
          usage_iowait = models.FloatField(null=True)




          class MemoryInfo(models.Model):
          #內(nèi)存信息
          time = models.DateTimeField()
          host = models.CharField(max_length=40)
          used_percent = models.FloatField(null=True)




          class ProcstatInfo(models.Model):
          # 進(jìn)程信息
          time = models.DateTimeField()
          host = models.CharField(max_length=100)
          exe = models.CharField(max_length=40)
          pid = models.FloatField()
          cpu_usage = models.FloatField(null=True)
          memory_rss = models.FloatField(null=True)

          三、創(chuàng)建數(shù)據(jù)庫

          1.Terminal?下運(yùn)行manager.py

          # python3 manager.py mkmigrations web
          # python3 manager.py migrate

          2.查詢mysql

          mysql> show tables;
          ERROR 2006 (HY000): MySQL server has gone away
          No connection. Trying to reconnect...
          Connection id: 449745
          Current database: perf_monitor


          +----------------------------+
          | Tables_in_perf_monitor |
          +----------------------------+
          | auth_group |
          | auth_group_permissions |
          | auth_permission |
          | auth_user |
          | auth_user_groups |
          | auth_user_user_permissions |
          | django_admin_log |
          | django_content_type |
          | django_migrations |
          | django_session |
          | web_cpuinfo |
          | web_memoryinfo |
          | web_procstatinfo |
          +----------------------------+
          13 rows in set (0.51 sec)


          mysql>

          四、?views.py

          創(chuàng)建兩個views,一個顯示CPU和內(nèi)存信息;另一個現(xiàn)實進(jìn)程信息

          # Author: Allan
          # Datetime: 2019-05-21
          import time
          import json
          from django.shortcuts import render
          from web import models


          # Create your views here.




          def show_procstat(request):
          servers = ['rotestZone01', 'rotestZone02']
          procstat_ret = {}
          for server in servers:
          procstat_info = models.ProcstatInfo.objects.filter(host=server)
          procstat_exe = {}
          for row in procstat_info:
          temp_time = int(time.mktime(row.time.timetuple())) * 1000
          key = str(row.exe) + '_' + str(int(row.pid))
          if key not in procstat_exe:
          procstat_exe[key] = {}
          procstat_exe[key]['cpu_usage'] = []
          procstat_exe[key]['memory_rss'] = []
          procstat_exe[key]['cpu_usage'].append([temp_time, row.cpu_usage])
          procstat_exe[key]['memory_rss'].append([temp_time, row.memory_rss])
          procstat_ret[server] = procstat_exe


          return render(request, 'show_procstat.html', {"procstat_ret": json.dumps(procstat_ret)})




          def show_servers(request):
          servers = ['rotestZone01', 'rotestZone02']
          server_res = {}
          cpu_res = {}
          mem_res = {}
          for server in servers:
          cpu_info = models.CpuInfo.objects.filter(host=server)
          cpu_ret = {}
          usage_system = []
          usage_user = []
          usage_softirq = []
          usage_iowait = []
          for row in cpu_info:
          temp_time = int(time.mktime(row.time.timetuple())) * 1000
          usage_system.append([temp_time, row.usage_system])
          usage_user.append([temp_time, row.usage_user])
          usage_softirq.append([temp_time, row.usage_softirq])
          usage_iowait.append([temp_time, row.usage_iowait])
          cpu_ret['usage_system'] = usage_system
          cpu_ret['usage_user'] = usage_user
          cpu_ret['usage_softirq'] = usage_softirq
          cpu_ret['usage_iowait'] = usage_iowait
          cpu_res[server] = cpu_ret


          mem_info = models.MemoryInfo.objects.filter(host=server)
          mem_ret = []
          for row in mem_info:
          temp_time = int(time.mktime(row.time.timetuple()))*1000
          mem_ret.append([temp_time, row.used_percent])
          mem_res[server] = mem_ret


          server_res['cpu_res'] = cpu_res
          server_res['mem_res'] = mem_res


          return render(request, 'show_servers.html', {"server_res": json.dumps(server_res)})

          五、創(chuàng)建html模版

          創(chuàng)建兩個html模版,一個顯示CPU和內(nèi)存信息;另一個現(xiàn)實進(jìn)程信息

          <html xmlns="http://www.w3.org/1999/html">
          <head>
          <meta charset="UTF-8" />
          <title>服務(wù)器監(jiān)控信息</title>
          <script src="https://code.jquery.com/jquery-3.1.1.min.js"></script>
          <script src="https://code.highcharts.com/highcharts.js"></script>
          <script src="https://code.highcharts.com/modules/exporting.js"></script>
          <script src="https://code.highcharts.com/modules/export-data.js"></script>
          <script language="JavaScript">
          $(document).ready(function() {
          $("#servers").change(function (){
          var selected = $(this).children('option:selected').val();
          var server_res = jQuery.parseJSON('{{ server_res|safe }}');


          var cpu_res = server_res['cpu_res']
          var cpu_info = cpu_res[selected]


          Highcharts.setOptions({
          global:{
          useUTC: false
          }
          });
          Highcharts.chart('cpu', {
          chart: {
          zoomType: 'x'
          },
          title: {
          text: selected + ': CPU 信息'
          },
          subtitle: {
          text: document.ontouchstart === undefined ?
          'Click and drag in the plot area to zoom in' : 'Pinch the chart to zoom in'
          },
          xAxis: {
          type: 'datetime'
          },
          yAxis: {
          title: {
          text: '使用率 (%)'
          }
          },
          legend: {
          enabled: false
          },
          plotOptions: {
          area: {
          fillColor: {
          linearGradient: {
          x1: 0,
          y1: 0,
          x2: 0,
          y2: 1
          },
          stops: [
          [0, Highcharts.getOptions().colors[0]],
          [1, Highcharts.Color(Highcharts.getOptions().colors[0]).setOpacity(0).get('rgba')]
          ]
          },
          marker: {
          radius: 2
          },
          lineWidth: 1,
          states: {
          hover: {
          lineWidth: 1
          }
          },
          threshold: null
          }
          },


          series: [
          {
          type: 'area',
          name: 'usage_system',
          data: cpu_info['usage_system']
          },
          {
          type: 'area',
          name: 'usage_user',
          data: cpu_info['usage_user']
          },
          {
          type: 'area',
          name: 'usage_softirq',
          data: cpu_info['usage_softirq']
          },
          {
          type: 'area',
          name: 'usage_iowait',
          data: cpu_info['usage_iowait']
          }]
          });




          var mem_res = server_res['mem_res']
          var mem_info = mem_res[selected]
          Highcharts.chart('mem', {
          chart: {
          zoomType: 'x'
          },
          title: {
          text: selected + ': 內(nèi)存信息'
          },
          subtitle: {
          text: document.ontouchstart === undefined ?
          'Click and drag in the plot area to zoom in' : 'Pinch the chart to zoom in'
          },
          xAxis: {
          type: 'datetime'
          },
          yAxis: {
          title: {
          text: '使用率 (%)'
          }
          },
          legend: {
          enabled: false
          },
          plotOptions: {
          area: {
          fillColor: {
          linearGradient: {
          x1: 0,
          y1: 0,
          x2: 0,
          y2: 1
          },
          stops: [
          [0, Highcharts.getOptions().colors[0]],
          [1, Highcharts.Color(Highcharts.getOptions().colors[0]).setOpacity(0).get('rgba')]
          ]
          },
          marker: {
          radius: 2
          },
          lineWidth: 1,
          states: {
          hover: {
          lineWidth: 1
          }
          },
          threshold: null
          }
          },


          series: [{
          type: 'area',
          name: 'used_percent',
          data: mem_info
          }]
          });
          });
          });
          </script>
          </head>
          <body>
          <div><H2>服務(wù)器監(jiān)控信息</H2></div>
          <select id="servers">
          <option value="servers">請選擇要監(jiān)控的服務(wù)器</option>
          <option value="rotestZone01">rotestZone01</option>
          <option value="rotestZone02">rotestZone02</option>
          </select>


          <div id="cpu" style="width: 1560px; height: 400px; margin: 0 auto"></div>
          <div id="mem" style="width: 1560px; height: 400px; margin: 0 auto"></div>
          </body>
          </html>
          <html xmlns="http://www.w3.org/1999/html" xmlns="http://www.w3.org/1999/html">
          <head>
          <meta charset="UTF-8" />
          <title>服務(wù)器監(jiān)控信息</title>
          <script src="https://code.jquery.com/jquery-3.1.1.min.js"></script>
          <script src="https://code.highcharts.com/highcharts.js"></script>
          <script src="https://code.highcharts.com/modules/exporting.js"></script>
          <script src="https://code.highcharts.com/modules/export-data.js"></script>
          <script language="JavaScript">
          $(document).ready(function() {
          $("#servers").change(function (){
          var selected = $(this).children('option:selected').val();
          var server_res = jQuery.parseJSON('{{ procstat_ret|safe }}');
          var xServers = server_res[selected]


          var obj=document.getElementById('processes');
          if (obj.options.length != 1){
          obj.options.length=1;
          }
          for(var key in xServers)
          {
          obj.options.add(new Option(key,key));
          }


          $("#processes").change(function (){
          var procSelected = $(this).children('option:selected').val();
          var dataMem = new Array();
          var dataCpu = new Array();
          for(var key in xServers)
          {
          if (key == procSelected){
          dataCpu = xServers[key]['cpu_usage']
          dataMem = xServers[key]['memory_rss'];
          break;
          }
          }
          Highcharts.chart('cpu', {
          chart: {
          zoomType: 'x'
          },
          title: {
          text: selected + ': CPU 信息'
          },
          subtitle: {
          text: document.ontouchstart === undefined ?
          'Click and drag in the plot area to zoom in' : 'Pinch the chart to zoom in'
          },
          xAxis: {
          type: 'datetime'
          },
          yAxis: {
          title: {
          text: '使用率 (%)'
          }
          },
          legend: {
          enabled: false
          },
          plotOptions: {
          area: {
          fillColor: {
          linearGradient: {
          x1: 0,
          y1: 0,
          x2: 0,
          y2: 1
          },
          stops: [
          [0, Highcharts.getOptions().colors[0]],
          [1, Highcharts.Color(Highcharts.getOptions().colors[0]).setOpacity(0).get('rgba')]
          ]
          },
          marker: {
          radius: 2
          },
          lineWidth: 1,
          states: {
          hover: {
          lineWidth: 1
          }
          },
          threshold: null
          }
          },


          series: [
          {
          type: 'area',
          name: 'cpu_usage',
          data: dataCpu
          }]
          });


          Highcharts.chart('mem', {
          chart: {
          zoomType: 'x'
          },
          title: {
          text: selected + ': 內(nèi)存信息'
          },
          subtitle: {
          text: document.ontouchstart === undefined ?
          'Click and drag in the plot area to zoom in' : 'Pinch the chart to zoom in'
          },
          xAxis: {
          type: 'datetime'
          },
          yAxis: {
          title: {
          text: '使用率 (%)'
          }
          },
          legend: {
          enabled: false
          },
          plotOptions: {
          area: {
          fillColor: {
          linearGradient: {
          x1: 0,
          y1: 0,
          x2: 0,
          y2: 1
          },
          stops: [
          [0, Highcharts.getOptions().colors[0]],
          [1, Highcharts.Color(Highcharts.getOptions().colors[0]).setOpacity(0).get('rgba')]
          ]
          },
          marker: {
          radius: 2
          },
          lineWidth: 1,
          states: {
          hover: {
          lineWidth: 1
          }
          },
          threshold: null
          }
          },


          series: [{
          type: 'area',
          name: 'memory_rss',
          data: dataMem
          }]
          });
          });


          });
          });
          </script>
          </head>
          <body>
          <div><H2>服務(wù)器監(jiān)控信息</H2></div>


          <div id="monitor">
          <select id="servers">
          <option value="server">請選擇要監(jiān)控的服務(wù)器</option>
          <option value="rotestZone01">rotestZone01</option>
          <option value="rotestZone02">rotestZone02</option>
          </select>
          <select id="processes">
          <option value="process">請選擇要監(jiān)控的進(jìn)程</option>
          </select>
          </div>




          <div id="cpu" style="width: 1560px; height: 400px; margin: 0 auto"></div>
          <div id="mem" style="width: 1560px; height: 400px; margin: 0 auto"></div>
          </body>
          </html>

          六、urls.py添加路由

          # Author: Allan
          # Datetime: 2019-05-21
          from django.contrib import admin
          from django.urls import path
          from web import views


          urlpatterns = [
          # path('admin/', admin.site.urls),
          path('show_servers', views.show_servers),
          path('show_procstat', views.show_procstat),
          ]

          七、運(yùn)行程序,顯示結(jié)果

          # python3 manager.py runserver

          CPU和內(nèi)存信息

          Python采集linux服務(wù)器數(shù)據(jù)在Django Web界面展示_運(yùn)維_02

          進(jìn)程信息

          Python采集linux服務(wù)器數(shù)據(jù)在Django Web界面展示_zookeeper_03

          ?

          END

          Python采集linux服務(wù)器數(shù)據(jù)在Django Web界面展示_zookeeper_04

          ??Python全棧技術(shù)培訓(xùn)??

          Python采集linux服務(wù)器數(shù)據(jù)在Django Web界面展示_zabbix_05

          ??https://edu.51cto.com/sd/3a4c4??



          本文摘自 :https://blog.51cto.com/u

          開通會員,享受整站包年服務(wù)