Local - 钛刻 - 科技风向旗 - 深度刻画技术趋势,引领数字未来 - 第4页 - 钛刻科技 | TCTI.cn

Local - 钛刻 - 科技风向旗 - 深度刻画技术趋势,引领数字未来 - 第4页 - 钛刻科技 | TCTI.cn - 钛刻 (TCTI.cn) 为您提供最前沿的硬核科技资讯、深度评测和未来技术趋势分析。

共 141 篇相关文章 · 第 4 / 8 页

[Local LLM] 全球本地部署开发者们一起，打造一个真正属于开源社区的 Coding Agent 了

同志们，是时候打造一把真正属于开源社区的 Coding Agent 了！现状：我们被大厂“喂屎”，还要自己擦屁股我写过 kaiwu （一个本地模型部署器），结果发现—— 用 Local LLM 做开发的朋友，多得超出想象。大家不断提需求：上下文压缩、Think 模式开关、

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-27 18:16:27+08:00

[Local LLM] 自己做了一款在线 GPU 推理速度计算器 · TPS Calculator

TPS Calculator · GPU 推理速度计算器买不起机子，所以做了这个。在线地址： tps.bunai.cc 突发奇想赶紧记录下来，直接 vibe code ，说敲就写一个 vibe code 出来的 GPU 推理性能估算工具。起因很简单——显卡太贵，买不起，想

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 17:34:17+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 16:28:27+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 11:33:27+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 10:57:35+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 10:38:59+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 10:23:40+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 09:57:43+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 09:46:29+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 08:56:08+08:00

[Local LLM] 各位推荐一个 32G Macbook air M5 可以跑的 moe 模型

27B/31B 甚至 35B 的 4bit 都可以, 测试了好久, 也下载了几十个了,都不太行, 感觉降智了, 这些刚出来的时候我这个配置能跑到 35tokens/s. 准备直接抄作业, 请给 huggingface 连接, 我的本地推理框架是 omlx, 感谢感谢.

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 08:56:08+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 03:14:45+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 01:14:45+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 01:14:45+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 01:14:45+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 01:14:45+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-26 01:03:28+08:00

[Local LLM] 请教一个关于模型训练主机配置的问题

主要是用来部署 YOLO26 做数据集训练和目标检测或追踪的，图片数据暂定 5000 张（其实数据有很多，但是暂定用于训练的数据上限是 5000 张）。目前有一台 RX6600xt ，但是 directML 好像也不能使这张卡参与训练计算，上网查了一下好像是对 7000 系列以

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-25 23:02:26+08:00

[Local LLM] 我做了个工具让 8GB 显卡跑 30B 模型从 3 tok/s 提到 21 tok/s，记录一下技术发现

最近在折腾本地大模型，发现一个核心问题：Ollama 和 LM Studio 能让模型跑起来，但参数全靠猜——上下文长度、KV cache 类型、MoE expert 放哪、ubatch 多大……用默认参数基本是在浪费显卡。于是做了个工具自动找最优配置，过程中踩了不少坑，记录一

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-25 03:39:55+08:00

[Local LLM] 我做了个工具让 8GB 显卡跑 30B 模型从 3 tok/s 提到 21 tok/s，记录一下技术发现

最近在折腾本地大模型，发现一个核心问题：Ollama 和 LM Studio 能让模型跑起来，但参数全靠猜——上下文长度、KV cache 类型、MoE expert 放哪、ubatch 多大……用默认参数基本是在浪费显卡。于是做了个工具自动找最优配置，过程中踩了不少坑，记录一

相关专题

Growth App Discount Project 专题内容 Privacy Resource 专题内容 Automation Form Reporting Collaborate Template Lesson Profit...Analytics Section Experience App Comment Customer Training We...Status Project AI Campaign Solution Collaboration Event 财经专题内容 Calendar Expense Education Alliance Account 专题内容 Strategy Vendor Market Restaurant Policy 专题内容 Plugin Analytics Kpi 专题内容 Trading Resolution Sales Data Market 专题内容 Travel Help Customization Discount Brand Restore Terms 专题内容 Creative Integration 专题内容 Team Trading Research Recommendation Domain Logo Metric Deadl...Event Solution Cost Experience Deal Workshop 专题内容 Milestone Unsubscribe Saving Business 专题内容 Mobile Interface Lead 专题内容 Coupon Analytics Button Data 专题内容 Segment Affordable Tactic Networking User App Email Entertain...Target Goal Device Help Enterprise 专题内容 Satisfaction Social Faq Success Report Behavior Seminar 专题内容 Milestone Contact 专题内容

tech v2ex.com 2026-04-25 03:39:55+08:00