openFyde fydeos-ai 两个模型无法正常工作

求助答疑
,
1
  • :warning: 请注意一定要按照模版填写以下信息，否则社区人员将无法了解你所遇到的问题。
  • :mag: 请在发帖前在社区中进行相关问题搜索，以避免重复提问。

:pushpin:问题描述

请详细描述您所遇到的问题：

  • 描述内容：
    模型：Qwen-1_8B-Chat_rkLLM 来自huggingface
    参数如下：
    image
    /usr/share/fydeos-ai/AI_0.1.0 /home/chronos/user/MyFiles/Downloads/qwen.rkllm rk3588 2 256 512 5 0.9 0.8 1.1 0.0 2 5.0 0.1
    启动LLM后内存占用正常
    image
    Prompt：hello
    现象：回答一串乱码
    image

再次regenerate无法回答
image

另外internlm2_rkLLM无法正常启动，内存占用为零
image
image

:computer:系统与设备信息

  • 硬件与系统配置：

    • 处理器：rk3588s
    • 显卡：（如有独立显卡，请标明）
    • RAM（运行内存）：8GB
    • 存储容量：128GB
    • FydeOS版本：
      openFyde orangepi5-openfyde,
      Platform 15662.71.18.11
      Chromium 120.0.6099.220

  • 相关系统日志：

    • 访问 Chromium 浏览器并输入 /var/log/messages 以获取日志。
    • 日志内容：
4Z NOTICE temp_logger[6928]:  soc-thermal:47C bigcore0-thermal:47C bigcore1-thermal:47C littlecore-thermal:47C center-thermal:46C gpu-thermal:46C npu-thermal:47C 
2024-06-16T06:18:25.879796Z NOTICE temp_logger[7013]:  soc-thermal:51C bigcore0-thermal:52C bigcore1-thermal:52C littlecore-thermal:52C center-thermal:52C gpu-thermal:51C npu-thermal:51C 
2024-06-16T06:19:25.965078Z NOTICE temp_logger[7391]:  soc-thermal:60C bigcore0-thermal:61C bigcore1-thermal:61C littlecore-thermal:61C center-thermal:58C gpu-thermal:58C npu-thermal:58C 

2024-06-16T06:19:14.074352Z INFO kernel: [  244.543822] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:14.101360Z INFO kernel: [  244.570666] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:14.228331Z INFO kernel: [  244.697633] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:14.254124Z INFO kernel: [  244.723765] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:14.384364Z INFO kernel: [  244.853104] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:14.415338Z INFO kernel: [  244.884209] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:14.655333Z INFO kernel: [  245.125008] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:14.681250Z INFO kernel: [  245.150338] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:14.813205Z INFO kernel: [  245.282654] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:14.841302Z INFO kernel: [  245.310711] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:15.085192Z INFO kernel: [  245.554715] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:15.163424Z INFO kernel: [  245.632182] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:15.169185Z INFO kernel: [  245.638292] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:15.249477Z INFO kernel: [  245.718491] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:25.965078Z NOTICE temp_logger[7391]:  soc-thermal:60C bigcore0-thermal:61C bigcore1-thermal:61C littlecore-thermal:61C center-thermal:58C gpu-thermal:58C npu-thermal:58C 
2024-06-16T06:19:29.320590Z ERR cryptohomed[1330]: InstallAttributesGet() failed: (null)
2024-06-16T06:19:37.869332Z INFO kernel: [  268.338439] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:40.599327Z INFO kernel: [  271.068569] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:40.799194Z INFO kernel: [  271.268202] RKNPU: switch iommu domain from 0 to 1
2024-06-16T06:19:41.200419Z INFO kernel: [  271.668318] RKNPU: switch iommu domain from 1 to 0
2024-06-16T06:19:41.332285Z INFO kernel: [  271.801255] RKNPU: switch iommu domain from 0 to 1

2024-06-16T05:26:55.058162Z ERR kernel: [ 1131.144656] RKNPU: job: 000000007ce8ba65, iommu domain id: 0, wait_count: 1, continue wait: 0, commit elapse time: 6442150us, wait time: 6442151us, timeout: 6000000us
2024-06-16T05:26:55.058197Z ERR kernel: [ 1131.144670] RKNPU: failed to wait job, task counter: 0, flags: 0x5, ret = 0, elapsed time: 6442172us
2024-06-16T05:26:55.162158Z ERR kernel: [ 1131.248640] RKNPU: job timeout, flags: 0x0:
2024-06-16T05:26:55.162188Z ERR kernel: [ 1131.248654] RKNPU:   core 1 irq status: 0x0, raw status: 0x40010000, require mask: 0x300, task counter: 0x0, elapsed time: 6546155us
2024-06-16T05:26:55.266241Z INFO kernel: [ 1131.352640] RKNPU: soft reset, num: 6

注：若丢失 FydeOS 订阅，请参考此篇 FAQ 进行处理。

1 个赞