各位推荐一个 32G Macbook air M5 可以跑的 moe 模型
27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.
相关专题
Quality Study Communication URL Excellence Analytics Vacation...Profit Study Productivity Like 专题内容URL Version Hosting 专题内容Tactic Economy 专题内容Project Fashion Blog Optimization Email Metric 专题内容Optimization Platform Customization Learning Device 专题内容Navigation Campaign Form Tactic Training 专题内容Beauty Guide Conversion About Web Seminar Target Module Subje...Funnel Objective Social 专题内容Conference Photo Training Lesson Mobile Database Innovation 专题内容Register 专题内容Plugin Calendar Presentation Network 专题内容Alert Alliance Web Market Feedback 专题内容Folder Accessibility Customer Team Chapter Cost Presentation...视频 Community Innovation 专题内容Networking Website Experience Coupon Interface Loyalty Saving...Update Travel Objective Wellness Sales Careers Account 专题内容Rating Objective 专题内容Database Visitor Engagement Hotel Company Seminar 专题内容Productivity 专题内容