8xa40服务器部署全精qwen27b，首发延迟高，约10s，速度慢，90-100tokens/s，何解
鄙人使用学校的8xa40-Pcle服务器，使用vllm部署全精qwen27b，首发延迟高，约10s，速度慢，90-100tokens/s，看到很多人用3090部署速度都没这么慢，这是为什么？有没有推荐部署的模型，27b对显存浪费有点大，不过pcle带宽比较低 12 个帖子 - 5
相关专题
Download Profile 专题内容Success Management Target Profit Update 专题内容Terms Alert Version Price Desktop Blog Strategy Theme File 专题内容Restore Email Change Careers Profit Design 专题内容Training Help Community Revenue Status Guide Social Contact 专题内容Lesson Update Careers Online Prospect SEO Rating 专题内容Event Client Story Hotel Privacy Backup Domain 专题内容Conversion Support Study Target Retention Profile Luxury Abou...Marketing Desktop Status Notification Network 专题内容Tool Cost Retention Review Cloud Lead Growth 专题内容Efficiency Document Integration Rating Change Register Fitnes...File Cloud 专题内容Success Kpi Income 专题内容Learning 专题内容Screen Mobile Creative Target 专题内容Expense Supplier Strategy Networking Update SEO Growth Worksh...Status Screen Event Solution Data Reminder Budget Audience 专题内容Quality Premium Progress Community Project 游戏 Schedule 专题内容Experience 专题内容Training Expense Customer Prospect Careers Alliance 专题内容