ChatGLM-webui

Features

• Original Chat like chatglm-6b's demo, but use Gradio Chatbox for better user experience.

• One click install script (but you still must install python)

• More parameters that can be freely adjusted

• Convenient save/load dialog history, presets

• Custom maximum context length

• Save to Markdown

• Use program arguments to specify model and caculation accuracy

Install

requirements

Run

Arguments

• -model-path: specify model path. If this parameter is not specified manually, the default value is THUDM/chatglm-6b. Transformers will automatically download model from huggingface.

• -listen: launch gradio with 0.0.0.0 as server name, allowing to respond to network requests

• -port: webui port

• -share: use gradio to share

• -precision: fp32(CPU only), fp16, int4(CUDA GPU only), int8(CUDA GPU only)

• -cpu: use cpu