需求构思: 在linux下常常需要查看程序的实时输出,我们用 tail -f logfile 即可在console下实现此需求。现在要拓宽应用: 想在web browser下查看程序(以及日志)的实时输出(也就是程序Log的Web实时监控)。
文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/
架构构思
因为考虑了“实时"这个需求,所以初步定位为socket架构; 再因为是构建在web之上,属于web app,所以socket进一步细分为:web socket。初步验证: web socket的 server部分: 可选: 1)自己实现 2) Node.js 3)其他框架(i.e. pywebsocketserver), web socket的client部分: 可选: 1) firefox 16 2) chrome 3)其他浏览器文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/
架构实现
- Python里的subprocess可用pipe获取数据,再开子进程获取数据行
- Server负责把上述数据行缓存后再源源不断发送到 Client
- Client负责显示接受到的实时数据
文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/
python代码
# -*- coding: utf8 -*- import sys import time import threading from pywebsocketserver.server import SocketServer from pywebsocketserver.baseio import BaseIO import subprocess def tcpdump(): global g_output_log popen=subprocess.Popen(['bash','-c',"/usr/sbin/tcpdump -i eth0 -v"],stdout=subprocess.PIPE,stderr=subprocess.PIPE) pid=popen.pid print('Popen.pid:'+str(pid)) while True: line=popen.stdout.readline().strip() #line =popen.communicate() print "output:%s" %(line) g_output_log.append(line) if subprocess.Popen.poll(popen) is not None: break print('DONE') class MyIO(BaseIO): def onData(self,uid,text): self.sendData(uid,"received the message:%s"%(text,)) def onConnect(self,uid): global g_uid g_uid=uid while True: #self.sendData(uid,"testing...") if len(g_output_log) >0: log = g_output_log.pop() self.sendData(uid,log) else: time.sleep(.01) try: g_output_log=[] g_uid=None tcpdump = threading.Thread(name='tcpdump', target=tcpdump) tcpdump.start() port = sys.argv[1] except: port = 88 port = int(port) myIo = MyIO() SocketServer(port,myIo).run()
JS代码
# -*- coding: utf8 -*- import sys import time import threading from pywebsocketserver.server import SocketServer from pywebsocketserver.baseio import BaseIO import subprocess def tcpdump(): global g_output_log popen=subprocess.Popen(['bash','-c',"/usr/sbin/tcpdump -i eth0 -v"],stdout=subprocess.PIPE,stderr=subprocess.PIPE) pid=popen.pid print('Popen.pid:'+str(pid)) while True: line=popen.stdout.readline().strip() #line =popen.communicate() print "output:%s" %(line) g_output_log.append(line) if subprocess.Popen.poll(popen) is not None: break print('DONE') class MyIO(BaseIO): def onData(self,uid,text): self.sendData(uid,"received the message:%s"%(text,)) def onConnect(self,uid): global g_uid g_uid=uid while True: #self.sendData(uid,"testing...") if len(g_output_log) >0: log = g_output_log.pop() self.sendData(uid,log) else: time.sleep(.01) try: g_output_log=[] g_uid=None tcpdump = threading.Thread(name='tcpdump', target=tcpdump) tcpdump.start() port = sys.argv[1] except: port = 88 port = int(port) myIo = MyIO() SocketServer(port,myIo).run()
html代码
<html> <head> <meta http-equiv="content-type" content="text/html; charset=UTF-8"> <script src="socketclient.js"></script> </head> <body> <script> var client = new SocketClient("192.168.199.3",88,"chat"); client.connect(); client.onData = function(text) { console.log(text); element=document.getElementById("log"); if(element){ if(element.value.length >100000) { element.value=""; } element.value += (text + "\n"); element.scrollTop = element.scrollHeight; } } client.onRegist = function() { this.sendData("I am coming!"); } </script> <textarea name="log" id="log" style="font-size:12px; width:100%; height: 600px;">Tcpdump log:</textarea> </body> </html>
演示说明
Server运行tcpdump,用户在浏览器查看运行的实时数据。文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/
项目地址
https://github.com/suxianbaozi/pywebsocketserver文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/
或者本站下载:[file:https://www.ttlsa.com/wp-content/uploads/2015/09/pywebsocketserver-master.zip]文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/ 文章源自运维生存时间-https://www.ttlsa.com/python/monitor-log-realtime-python-websocket/

4F
我喜欢代码简洁易读,服务稳定的推送服务,前段时间研究了一下goeasy,java后台推送只需要两行代码, js前端推送也只需要3,4行,而且文档齐全,还提供了后台查询信息收发情况,所以我觉得GoEasy推送服务是个不错的选择。官网: https://goeasy.io/
3F
非常好。。。
2F
这儿有个界面更好看的,原理差不多,http://logio.org/
B1
@ 无影风随 这个logio我在github上下载下来,感觉缺文件,跑不起来啊,你弄好了吗?
1F
支持白开大神,掌声 :wink: