私有化 - 钛刻 - 科技风向旗 - 深度刻画技术趋势,引领数字未来 - 第2页 - 钛刻科技

[Local LLM] 私有化部署大模型的“终点”是 Mac 还是 Nvidia？

自己家里的 5070Ti 跑模型起来太费劲了，用了一下同事的 macbook 顶配版跑模型比 5070Ti 要强一点点，感觉都差不多，所以大佬可以指点下有没有必要搞一个 Mac studio 还是 Nvidia thor 或者 DGX Spark

相关专题

tech v2ex.com 2026-04-30 11:12:53+08:00

[Local LLM] 私有化部署大模型的“终点”是 Mac 还是 Nvidia？

自己家里的 5070Ti 跑模型起来太费劲了，用了一下同事的 macbook 顶配版跑模型比 5070Ti 要强一点点，感觉都差不多，所以大佬可以指点下有没有必要搞一个 Mac studio 还是 Nvidia thor 或者 DGX Spark

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech v2ex.com 2026-04-30 10:43:56+08:00

[Local LLM] 私有化部署大模型的“终点”是 Mac 还是 Nvidia？

自己家里的 5070Ti 跑模型起来太费劲了，用了一下同事的 macbook 顶配版跑模型比 5070Ti 要强一点点，感觉都差不多，所以大佬可以指点下有没有必要搞一个 Mac studio 还是 Nvidia thor 或者 DGX Spark

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech v2ex.com 2026-04-30 10:40:34+08:00

私有化部署大模型的“终点”是 Mac 还是 Nvidia？

自己家里的 5070Ti 跑模型起来太费劲了，用了一下同事的 macbook 顶配版跑模型比 5070Ti 要强一点点，感觉都差不多，所以大佬可以指点下有没有必要搞一个 Mac studio 还是 Nvidia thor 或者 DGX Spark

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech www.v2ex.com 2026-04-30 10:36:21+08:00

是不是以后想私有化部署满血开源模型越来越难了？

现在新出的模型 deepseekv4 pro 862B参数，GLM5.1 754B参数，kimi 2.6 1.1T的参数。像千问这种397B的是不是以后就不会有了。想在公司八卡L20上部署一下新模型，算了一下量化后都不够部署上去。部署成本太高了，qwen3.6的满参数迟迟不发布

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech linux.do 2026-04-24 12:00:55+08:00

LobeHub的移动端问题

LobeHub的ios app是不是还不支持连接私有化部署？ 2 个帖子 - 2 位参与者阅读完整话题

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech linux.do 2026-04-18 13:54:18+08:00

qwen/qwen3.6-35b-a3b 私有化部署测试

两张3090 48G显存私有化部署35B大模型，生成速度142.65tokens/s 上下文长度262144 真香 8 个帖子 - 5 位参与者阅读完整话题

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech linux.do 2026-04-18 02:53:41+08:00

WPS 365发布私有化AI解决方案“轻舟AI”

36氪获悉，4月22日，金山办公在武汉发布私有化AI办公解决方案WPS 365轻舟AI，面向组织级用户提供安全可控、部署轻量、效果可控的私有化AI服务。

相关专题

Training Brand Shopping 视频 Rating Logo Seminar Reminder Hosti...Meeting Forum Dashboard 专题内容 Online Folder Conversion 视频 Vendor Fitness Coupon Demographic...Security Automation Restaurant 专题内容 Planning Reporting Resource Contact Security Blog Backup 专题内容 Image 专题内容 Project Customer Extension SEO 专题内容 Report Price Seminar Chapter Networking Network Integration E...Event Segment Loyalty User Deadline Community Email Chapter 专题内容 Budget Form Fitness Email Sync Discovery 专题内容 Cloud Keyword Schedule Sale 专题内容 Demographic Database Budget Profit Loyalty Image 专题内容 Growth Demographic Tutorial Website Efficiency Satisfaction E...Customization Community Automation Quality 专题内容 Tool Affordable Site 专题内容 Tactic 专题内容 Register Expense Restaurant Investment Cloud Alert 专题内容 Campaign Customer Retention Quality 影视专题内容 Goal Careers Conference Desktop Task Reminder Browser 专题内容 Review Integration 专题内容

tech 36kr.com

私有化 - 钛刻 - 科技风向旗 - 深度刻画技术趋势,引领数字未来 - 第2页 - 钛刻科技 | TCTI.cn

相关标签