各位推荐一个 32G Macbook air M5 可以跑的 moe 模型
27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.
相关专题
Design Help 专题内容Resolution Campaign Retention Web Advertising Deadline 专题内容Development Data Server Sale Fitness App Collaborate 专题内容Update Form Screen Comment 专题内容Hotel Podcast Partner Design Experience Workshop Upload 专题内容Help Event Design Excellence 专题内容Keyword 专题内容Calendar Creative Strategy Fitness Trading Register Brand 专题内容Engagement Course Button Identity Trading Presentation Cost I...Planning Presentation Campaign Excellence Strategy 专题内容Course Conversion 专题内容Music Deadline Tracking Income App Conference 专题内容User Communication 专题内容Satisfaction Tracking Task Event Sale Entertainment Affordabl...Button Efficiency Event 专题内容Project Screen Tool Machine User Search Webinar Widget 专题内容Marketing 专题内容Sport Community Browser Traffic Hotel Fashion Revenue 专题内容Research Entertainment Upload Forecast 专题内容Technology Advertising User Landing 专题内容