All issues

Search results

模型分片了怎么指定load_model_path

Status: Open.

#18 In ProjectD-AI/llama_inference;

· caowenhero opened on Jul 26, 2023

你好 请问支持llama 65B了嘛

Status: Open.

#17 In ProjectD-AI/llama_inference;

· zcuuu opened on Jun 13, 2023

lora模型推理啥时候能出来啊

Status: Open.

#15 In ProjectD-AI/llama_inference;

· isaacxie41 opened on May 30, 2023

为什么LLaMa模型只有encoder没有decoder

Status: Open.

#14 In ProjectD-AI/llama_inference;

· yyqi17 opened on May 25, 2023

生成乱码

Status: Open.

#13 In ProjectD-AI/llama_inference;

· McCarrtney opened on May 24, 2023

运行多轮对话时代码报错

Status: Open.

#12 In ProjectD-AI/llama_inference;

· LJL00000 opened on May 22, 2023

RuntimeError: probability tensor contains either inf, nan or element < 0

Status: Open.

#11 In ProjectD-AI/llama_inference;

· yingzhao27 opened on May 18, 2023

fp32 精度-inference

Status: Open.

#10 In ProjectD-AI/llama_inference;

· biubiobiu opened on May 5, 2023

llama_server.py支持多卡推理吗

Status: Open.

#7 In ProjectD-AI/llama_inference;

· yuxuan2015 opened on Apr 21, 2023

求老哥搞个lora的

Status: Open.

#6 In ProjectD-AI/llama_inference;

· ze00ro opened on Apr 20, 2023

assert batch <= args.batch_size AssertionError

Status: Open.

#2 In ProjectD-AI/llama_inference;

· baketbek opened on Apr 17, 2023