openvino 大模型qwen2.5推理案例

参看：
https://github.com/openvinotoolkit/openvino.genai/releases/tag/2024.4.0.0

https://github.com/TommyZihao/openvino_tonypi/blob/main/OpenVINO-0911/AIPC%E4%BB%A3%E7%A0%81/%E3%80%90B1%E3%80%91%E4%B8%89%E8%A1%8C%E4%BB%A3%E7%A0%81%E5%BC%80%E5%90%AF%E5%A4%A7%E6%A8%A1%E5%9E%8B%E5%AF%B9%E8%AF%9D.ipynb、

安装
https://docs.openvino.ai/2024/get-started/install-openvino/install-openvino-genai.html

python -m pip install openvino-genai  optimum[openvino]

下载模型：

export HF_ENDPOINT=https://hf-mirror.comhuggingface-cli download --resume-download --local-dir-use-symlinks False Qwen/Qwen2.5-1.5B-Instruct --local-dir qwen2.5-1.5b

模型转换：
参数参看https://huggingface.co/docs/optimum/intel