logo
Sign In

HuggingFace Serverless Inference API (DeepSeek)

function

Model: DeepSeek-R1-Distill-Qwen-32B

ddg25
@ddg25
·
2 years ago
101
0
570
Updated 2 years ago
Created Jan 21, 2025
huggingface_serverless_inference_deepseek.py
Python · 153 lines
"""
title: HuggingFace Serverless Inference API (DeepSeek)
author: 
version: 1.0
description: 用于调用 HuggingFace 的 DeepSeek DeepSeek-R1-Distill-Qwen-32B 无服务器推理 API 的管道，支持多密钥轮询
"""

from pydantic import BaseModel, Field
import time
from typing import List, Optional, Generator 
import requests
from openai import OpenAI

Model: DeepSeek-R1-Distill-Qwen-32B

0