RemoveDuplicates.org
Remove duplicate lines or CSV/TSV rows from text. Stateless: processed per call, never stored.
我該用這個嗎
品質與安全性
A
根據工具定義與協定合規性的自動化分析。
上下文成本
~630Token（工具定義）
~6.9 KB典型回應大小
極小的注意力影響（128k 上下文的 0.49%）
這是每次將伺服器的工具載入模型上下文時所消耗的約略 token 數量。數量越高，可用於其他工作的注意力就越少。
安裝
一鍵安裝
將以下內容加入你的 `claude_desktop_config.json` 檔案：
{
"mcpServers": {
"remove-duplicates": {
"url": "https://removeduplicates.org/mcp"
}
}
}遠端端點
https://removeduplicates.org/mcpstreamable-http它能做什麼
工具清單
工具（1）
🟢 唯讀🟡 寫入🔴 刪除⚪ 未知
🟢remove_duplicates(text, format, ignoreCase, trim, removeEmpty, ...)
Remove duplicate lines from a text list, or duplicate rows from CSV/TSV text such as rows copied from Excel or Google Sheets. Uses the same engine as removeduplicates.org and returns the cleaned text with counts. Stateless: the text is processed in memory for this call only and is never stored.
輸入結構描述
{
"type": "object",
"properties": {
"text": {
"type": "string",
"description": "The list or table text: one item per line, or CSV/tab-separated rows. Up to 131072 UTF-8 bytes."
},
"format": {
"type": "string",
"enum": [
"auto",
"lines",
"table"
],
"default": "auto",
"description": "auto detects CSV/TSV tables; lines compares whole lines; table forces CSV/TSV parsing."
},
"ignoreCase": {
"type": "boolean",
"default": false,
"description": "Treat values such as Apple and apple as duplicates."
},
"trim": {
"type": "boolean",
"default": false,
"description": "Ignore surrounding spaces when comparing and return trimmed values."
},
"removeEmpty": {
"type": "boolean",
"default": true,
"description": "Drop blank lines or all-blank rows."
},
"keep": {
"type": "string",
"enum": [
"first",
"last"
],
"default": "first",
"description": "Which occurrence of a duplicate survives."
},
"order": {
"type": "string",
"enum": [
"preserve",
"sort"
],
"default": "preserve",
"description": "preserve keeps the original order; sort returns a natural (numeric-aware) sort."
},
"compare": {
"anyOf": [
{
"type": "string",
"enum": [
"row"
]
},
{
"type": "integer",
"minimum": 0
},
{
"type": "array",
"items": {
"type": "integer",
"minimum": 0
},
"minItems": 1,
"uniqueItems": true
}
],
"default": "row",
"description": "Tables only: \"row\" compares entire rows; a zero-based column index or an array of indices compares only those columns."
},
"header": {
"type": "boolean",
"default": false,
"description": "Tables only: keep the first row as a header outside duplicate checks and counts."
}
},
"required": [
"text"
],
"additionalProperties": false
}輸出結構描述
{
"type": "object",
"properties": {
"text": {
"type": "string",
"description": "The cleaned text, rows joined with \\n."
},
"format": {
"type": "object",
"properties": {
"kind": {
"type": "string",
"enum": [
"lines",
"csv",
"tsv"
]
},
"columns": {
"type": "integer"
},
"header": {
"type": "boolean"
}
},
"required": [
"kind",
"columns",
"header"
]
},
"stats": {
"type": "object",
"properties": {
"total": {
"type": "integer",
"description": "Input lines or data rows (header excluded)."
},
"unique": {
"type": "integer",
"description": "Lines or data rows kept."
},
"removed": {
"type": "integer",
"description": "duplicates + emptyRemoved."
},
"duplicates": {
"type": "integer"
},
"emptyRemoved": {
"type": "integer"
},
"reduction": {
"type": "number",
"description": "Percent of input removed, one decimal."
}
},
"required": [
"total",
"unique",
"removed",
"duplicates",
"emptyRemoved",
"reduction"
]
}
},
"required": [
"text",
"format",
"stats"
]
}社群
證據
近期觀測
已驗證未記錄版本1 個工具
已驗證未記錄版本1 個工具