固件类型:官方提供的固件
固件文件名称:U-Boot 2021.10-g8528b7f8dd-dirty (Nov 24 2024 - 21
固件下载地址:技术资料
Log日志:log.zip
产品型号:AIBOX-1688
SDK包名称:SophonSDK(BM1688) 1.7
问题描述:在使用LLM-TPU代码仓实现deepseek蒸馏模型时,检测不到卡,出现如下错误(在此设备上可正常跑resnet/yolov5s等小模型):
Initializing devices…
Device [ 0 ] loading …
[bmlib_runtime][error] invalid chip id!
Traceback (most recent call last):
File “pipeline.py”, line 427, in
main(args)
File “pipeline.py”, line 389, in main
model = Model(args)
File “pipeline.py”, line 44, in init
self.load_model(args, read_bmodel=True)
File “pipeline.py”, line 160, in load_model
self.model.init(self.devices, model_path, read_bmodel) # when read_bmodel = false, not to load weight, reuse weight
RuntimeError: can not create handle
corrupted size vs. prev_size in fastbins
Aborted
复现步骤:
# deepseekr1-1.5b其中包含编译得到的bm1688的bmodel
python3 pipeline.py --devid 0 --dir_path /data/deepseek-r1-distill-qwen-1.5b/
tchip_askquestions
log.zip (479 Bytes)