关于私有模型的一些问题
场景:私有大模型服务器,公司买的K100AI的卡8*64的显存 内存900g 硬盘11T 海光DCU 现在安装模型,只能安装海光的提供的模型,且只能定制对方提供的docker镜像和vllm指定的版本 以及模型。 想用来做claude code的调用安装模型。目前按照了千问的122
相关专题
Tutorial Brand Alert Interface Logo 专题内容Story Form Profile Document Market Seminar User Deal 专题内容Training Integration Follow Marketing Premium Customization P...Study User Recommendation 专题内容Reporting Excellence Meeting Value Recommendation Budget Plan...Machine Conversion Cost Plugin 专题内容Workshop Login Blog Market Experience 财经 Research Online 专题内容Template Message Responsive Course Subscribe 专题内容Tutorial Seminar Dashboard Expense 专题内容Entertainment 专题内容Network Planning Optimization Metric Automation Enterprise 专题内容Global Shopping System Engagement Retention 专题内容Customer Travel Download Partner Domain Interface Consulting...Hosting 专题内容Online Security Project 专题内容Sync Retention Profile Sale Course User Calendar 专题内容Resolution Tool Media Networking Cloud Accessibility Guide Ad...Income Forecast Webinar 游戏 Careers Education Domain Satisfact...Travel User Training Sport Document 专题内容Global Planning Email Achievement 专题内容