EcoCompute Should-I-Quantize Estimator
Energy impact of LLM quantization, calibrated to measured GPU data. Every answer states its basis.
我该使用它吗
质量与安全性
基于对工具定义和协议合规性的自动分析。
上下文开销
这是每次将服务器的工具加载到模型上下文窗口时所消耗的大致 token 数。数值越高，可用于其他任务的注意力就越少。
安装
一键安装
将以下内容添加到你的 `claude_desktop_config.json` 文件中：
{
"mcpServers": {
"ecocompute-estimator": {
"url": "https://ecocompute-estimator.zhanghongping1982.workers.dev/mcp"
}
}
}远程端点
https://ecocompute-estimator.zhanghongping1982.workers.dev/mcpstreamable-http它能做什么
工具清单
工具（4）
🟡estimate_quantization_energy(params_b, arch, precision, batch, ctx, ...)
Estimate the task-level energy change (ΔE% vs FP16) of weight-only quantization (NF4 or INT8) for a model of a given size on a GPU architecture class, from measured-anchored curves. The answer carries basis (measured/interpolated/estimated), confidence and evidence boundaries.
输入模式
{
"type": "object",
"properties": {
"params_b": {
"type": "number",
"description": "model size in billions of parameters, e.g. 7"
},
"arch": {
"type": "string",
"enum": [
"turing",
"ada",
"blackwell",
"ampere",
"hopper"
],
"description": "GPU architecture class"
},
"precision": {
"type": "string",
"enum": [
"NF4",
"INT8"
],
"description": "quantization format (default NF4)"
},
"batch": {
"type": "integer",
"description": "batch size (default 1; >1 shrinks savings — modelled, not measured)"
},
"ctx": {
"type": "integer",
"description": "context length (default 2048)"
},
"q": {
"type": "string",
"description": "alternative: plain-English query, e.g. '13B on A100 int8 batch 32'"
}
}
}🟢get_quantization_crossover(arch)
Get the model-size crossover for NF4/INT8 per architecture: below it quantization costs energy, above it saves. Crossovers belong to a card + software stack, not an architecture — the answer says so.
输入模式
{
"type": "object",
"properties": {
"arch": {
"type": "string",
"enum": [
"turing",
"ada",
"blackwell",
"ampere",
"hopper"
],
"description": "optional: limit to one architecture"
}
}
}🟢list_data_coverage
List what is actually measured (GPU architecture × precision × size range, NVML direct), what is borrowed/estimated, and where the gaps are. Use this before trusting an estimate at the edges of coverage, and to answer 'is there data for my GPU?' honestly.
输入模式
{
"type": "object",
"properties": {}
}🟢search_measurements(query)
Search the measured anchors by model name, GPU name, architecture or size. Returns ΔE% vs FP16 per anchor with run counts — the raw evidence behind the curves.
输入模式
{
"type": "object",
"properties": {
"query": {
"type": "string",
"description": "model ('TinyLlama'), GPU ('4090'), architecture ('ampere') or size ('7')"
}
},
"required": [
"query"
]
}社区
证据