记录调试langchain-ChatGLM的坑

PS D:\artificialIntelligence\langchain-ChatGLM> C:/ProgramData/anaconda3/Scripts/activate
PS D:\artificialIntelligence\langchain-ChatGLM> conda activate d:\artificialIntelligence\langchain-ChatGLM\.conda
conda : 无法将“conda”项识别为 cmdlet、函数、脚本文件或可运行程序的名称。请检查名称的拼写，如果包括路径，请确保路径正确，然后再试一次。
所在位置 行:1 字符: 1
+ conda activate d:\artificialIntelligence\langchain-ChatGLM\.conda
+ ~~~~~
    + CategoryInfo          : ObjectNotFound: (conda:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException
 
PS D:\artificialIntelligence\langchain-ChatGLM> 

(d:\artificialIntelligence\langchain-ChatGLM\.conda) PS D:\artificialIntelligence\langchain-ChatGLM> & d:/artificialIntelligence/langchain-ChatGLM/.conda/python.exe d:/artificialIntelligence/langchain-ChatGLM/webui.py
INFO  2023-07-31 20:28:03,704-1d: 
loading model config
llm device: cpu
embedding device: cpu
dir: d:\artificialIntelligence\langchain-ChatGLM
flagging username: ab285827e5eb4d5ca45f7022804603eb

load_model_config THUDM/chatglm-6b...
Downloading (…)lve/main/config.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 773/773 [00:00<?, ?B/s]
D:\artificialIntelligence\langchain-ChatGLM\.conda\lib\site-packages\huggingface_hub\file_download.py:133: UserWarning: `huggingface_hub` cache-system uses symlinks by default to efficiently store duplicated files but your machine does not support them in C:\Users\jacka\.cache\huggingface\hub. Caching files will still work but in a degraded version that might require more space on your disk. This warning can be disabled by setting the `HF_HUB_DISABLE_SYMLINKS_WARNING` environment variable. For more details, see https://huggingface.co/docs/huggingface_hub/how-to-cache#limitations.
To support symlinks on Windows, you either need to activate Developer Mode or to run Python as an administrator. In order to see activate developer mode, see this article: https://docs.microsoft.com/en-us/windows/apps/get-started/enable-your-device-for-development
  warnings.warn(message)
Downloading (…)iguration_chatglm.py: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4.28k/4.28k [00:00<?, ?B/s]
A new version of the following files was downloaded from https://huggingface.co/THUDM/chatglm-6b:
- configuration_chatglm.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
Loading THUDM/chatglm-6b...
Warning: self.llm_device is False.
This means that no use GPU  bring to be load CPU mode

Downloading (…)/modeling_chatglm.py: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 57.6k/57.6k [00:00<00:00, 147kB/s]
A new version of the following files was downloaded from https://huggingface.co/THUDM/chatglm-6b:
- modeling_chatglm.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
Traceback (most recent call last):
  File "d:\artificialIntelligence\langchain-ChatGLM\webui.py", line 334, in <module>
    model_status = init_model()
  File "d:\artificialIntelligence\langchain-ChatGLM\webui.py", line 106, in init_model
    llm_model_ins = shared.loaderLLM()
  File "d:\artificialIntelligence\langchain-ChatGLM\models\shared.py", line 39, in loaderLLM
    loaderCheckPoint.reload_model()
  File "d:\artificialIntelligence\langchain-ChatGLM\models\loader\loader.py", line 453, in reload_model
    self.model, self.tokenizer = self._load_model()
  File "d:\artificialIntelligence\langchain-ChatGLM\models\loader\loader.py", line 252, in _load_model
    model = LoaderClass.from_pretrained(checkpoint, **params).to(self.llm_device, dtype=float)
  File "D:\artificialIntelligence\langchain-ChatGLM\.conda\lib\site-packages\transformers\models\auto\auto_factory.py", line 462, in from_pretrained
    return model_class.from_pretrained(
  File "D:\artificialIntelligence\langchain-ChatGLM\.conda\lib\site-packages\transformers\modeling_utils.py", line 2184, in from_pretrained
    raise ImportError(
ImportError: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate`

OSError: Consistency check failed: file should be of size 1980385902 but has size 1253815098 ((…)l-00003-of-00008.bin).

requests.exceptions.ConnectionError: (ProtocolError('Connection aborted.', ConnectionResetError(10054, '远程主机强迫关闭了一个现有的连接。', None, 10054, None)), '(Request ID: a4081b67-8dc6-4854-b815-0b9d7f72cd3a)')

RuntimeError: [enforce fail at ..\c10\core\impl\alloc_cpu.cpp:72] data. DefaultCPUAllocator: not enough memory: you tried to allocate 2138570752 bytes.

loading model config
llm device: cpu
embedding device: cpu

import torch
import torchvision

print(torch.__version__)
print(torch.cuda.is_available())

2.0.1
True