想在华为昇腾NPU 910B4上用k8s环境部署paddlenlp

(base) PS C:\Users\12133> kubectl get pod -n hwei NAME READY STATUS RESTARTS AGE hwei-ocr 0/1 Completed 0 3h26m

(base) PS C:\Users\12133> kubectl describe pod hwei-ocr -n hwei Name: hwei-ocr Namespace: hwei Priority: 0 Service Account: default Node: 192.168.3.243/192.168.3.243 Start Time: Fri, 14 Jun 2024 12:50:06 +0800 Labels: Annotations: cce.kubectl.kubernetes.io/ascend-1980-configuration: {"pod_name":"hwei-ocr","server_id":"192.168.3.243","devices":[{"device_id":"1","device_ip":"29.61.179.253"}]} kubernetes.io/psp: psp-global scheduling.cce.io/gpu-topology-placement: huawei.com/ascend-1980=0x02 scheduling.k8s.io/group-name: podgroup-d3573a51-b104-4463-bc4d-ff5a5c50abaa Status: Succeeded IP: 10.0.2.118 IPs: IP: 10.0.2.118 Containers: train: Container ID: docker://5d85e5d1c4d86d137a174532c74dc626c76fd2b7458ec5d98e93770429420c85 Image: swr.cn-east-3.myhuaweicloud.com/hwei/hwei-ocr-recognition:2297af78 Image ID: docker-pullable://swr.cn-east-3.myhuaweicloud.com/hwei/hwei-ocr-recognition@sha256:d755d246df4dd4e0c3bc20e96c52098d7c897e11b8960284d24d040cdbe7ac11 Port: Host Port: Command: python Args: medical_report_ocr.py State: Terminated Reason: Completed Exit Code: 0 Started: Fri, 14 Jun 2024 12:50:21 +0800 Finished: Fri, 14 Jun 2024 14:29:52 +0800 Ready: False Restart Count: 0 Limits: cpu: 4 huawei.com/ascend-1980: 1 memory: 32G Requests: cpu: 2 huawei.com/ascend-1980: 1 memory: 16G Environment: NCCL_ASYNC_ERROR_HANDLING: 1 Mounts: /dev/shm from cache-volume (rw) /etc/hccn.conf from hccn (rw) /etc/localtime from localtime (rw) /hwei-data from data-volume (rw) /usr/local/Ascend/add-ons from ascend-add-ons (rw) /usr/local/Ascend/driver from ascend-driver (rw) /usr/local/bin/npu-smi from npu-smi (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-94w29 (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: cache-volume: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: Memory SizeLimit: 3000Mi data-volume: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: pvc-obs-hwei ReadOnly: false ascend-driver: Type: HostPath (bare host directory volume) Path: /usr/local/Ascend/driver HostPathType: ascend-add-ons: Type: HostPath (bare host directory volume) Path: /usr/local/Ascend/add-ons HostPathType: hccn: Type: HostPath (bare host directory volume) Path: /etc/hccn.conf HostPathType: npu-smi: Type: HostPath (bare host directory volume) Path: /usr/local/bin/npu-smi HostPathType: localtime: Type: HostPath (bare host directory volume) Path: /etc/localtime HostPathType: kube-api-access-94w29: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: accelerator/huawei-npu=ascend-1980 Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events:

(base) PS C:\Users\12133> kubectl logs -f hwei-ocr -n hwei /home/ma-user/anaconda3/envs/PyTorch-2.1.0/lib/python3.9/site-packages/_distutils_hack/init.py:33: UserWarning: Setuptools is replacing distutils. warnings.warn("Setuptools is replacing distutils.") [2024-06-14 12:50:30,091] [ INFO] - Downloading model_state.pdparams from https://bj.bcebos.com/paddlenlp/taskflow/information_extraction/uie_m_base_v1.1/model_state.pdparams 2.6.1.post 2.6.1.3 schema ['样本号', '姓名', '性别', '年龄', '就诊卡号', '住院号', '样本类型', '科室', '病区', '床号', '执行科室', '凝血酶原时间', 'PT国际化标准化比值', '活化部分凝血活酶时间', '纤维蛋白原', '凝血酶时间', 'D-二聚体', '申请医师', '检验者', '审核者', '采集时间', '接收时间', '报告时间', '检验门诊信息'] 检测 7.152557373046875e-07 100%|██████████| 1.04G/1.04G [01:28