ã€ã³ã¹ããŒã«äžèŠã2å以å ã«åããŸãã
cloud.anythingmcp.com ã§ç¡æãã©ã€ã¢ã«ãéå§ããDiffbot ãã¯ã³ã¯ãªãã¯ã§è¿œå ããŠãAI ã¯ã©ã€ã¢ã³ãïŒClaudeãChatGPTãCopilotãCursorïŒãçæããã MCP ãšã³ããã€ã³ãã«åããã ããDocker ã git clone ããéçºçµéšãäžèŠã§ãã
æŠèŠ
AI ãã Diffbot ã®æ§é å Web ããŒã¿ãå©çšïŒä»»æã®ããŒãžãåé¡ããŠèšäºãååããã£ã¹ã«ãã·ã§ã³ãç»åãåç»ãåä»ã JSON ãŸã㯠Markdown ãšããŠæœåºããDQL ã§ Diffbot Knowledge Graph ãæ€çŽ¢ããEnhance ã§äŒæ¥ã人ç©ã 1 ä»¶ç §åããããã¹ããããšã³ãã£ãã£ãšææ ãèŠã€ããDiffbot ã® Web ã€ã³ããã¯ã¹ãæ€çŽ¢ã§ããŸããã¢ã«ãŠã³ã確èªä»¥å€ã®ããŒã«ã¯ãã¹ãŠ Diffbot ã®ã¯ã¬ãžãããæ¶è²»ããKnowledge Graph ã®çµæã¯ 1 ä»¶ 25 ã¯ã¬ãžããã§ãã
ããèããŠã¿ãã
Diffbot ã®ãµã³ãã«ããã³ãã
ããã³ãããã¯ãªãã¯ã§ã³ããŒãClaude / ChatGPT / Cursor / Gemini / Copilot / OpenClaw ã«è²Œãä»ããŠããã®ã³ãã¯ã¿ãŒã§å®è¡ã§ããŸãã
Claude 㯠AI ã®ãã誀ãããšããããŸããåçãã確èªãã ããã
ð¡ ã€ã³ã¹ããŒã«äžèŠ? cloud.anythingmcp.com ãçŽæ¥å©çšããŠãã ããã ãµã€ã³ã€ã³ããConnectors â Diffbot ãã¯ãªãã¯ãèªèšŒæ å ±ã貌ãä»ããMCP API ããŒãçºè¡ããã°å®äºã§ããDocker ã
git cloneãããŒã«ã«ãµãŒããŒãäžèŠã
Diffbot
AI ãã Diffbot ã®æ§é å Web ããŒã¿ãå©çšïŒä»»æã®ããŒãžãåé¡ããŠèšäºãååããã£ã¹ã«ãã·ã§ã³ãç»åãåç»ãåä»ã JSON ãŸã㯠Markdown ãšããŠæœåºããDQL ã§ Diffbot Knowledge Graph ãæ€çŽ¢ããEnhance ã§äŒæ¥ã人ç©ã 1 ä»¶ç §åããããã¹ããããšã³ãã£ãã£ãšææ ãèŠã€ããDiffbot ã® Web ã€ã³ããã¯ã¹ãæ€çŽ¢ã§ããŸããã¢ã«ãŠã³ã確èªä»¥å€ã®ããŒã«ã¯ãã¹ãŠ Diffbot ã®ã¯ã¬ãžãããæ¶è²»ããKnowledge Graph ã®çµæã¯ 1 ä»¶ 25 ã¯ã¬ãžããã§ãã
ã»ããã¢ãã
èšå®ã¯çŽ 2 åã§ããDiffbot ã¢ã«ãŠã³ããå¿ èŠã§ãæ¯æã®ã¯ã¬ãžãããä»ãç¡æãã©ã³ããããŸãã
- https://app.diffbot.com/get-started/ ã§ç»é²ããŸãã
- ããã·ã¥ããŒãïŒhttps://app.diffbot.comïŒãéããå³äžã®ããŒã¯ã³ã®ãªã³ã¯ãã API token ãã³ããŒããŸãã
- ããŒã¯ã³ã
DIFFBOT_TOKENã«è²Œãä»ããŸããDiffbot ã¯ã¯ãšãªãã©ã¡ãŒã¿tokenãšããŠåãåãïŒWeb æ€çŽ¢ã¯ Bearer ããããŒïŒãdiffbot.com ã®ãã¹ãã«ã ãéä¿¡ãããŸãã - ã³ãã¯ã¿ãã€ã³ã¹ããŒã«ãã
diffbot_get_accountãå®è¡ããŸãããã©ã³ãæéã¯ã¬ãžãããæ¥ããšã®äœ¿çšéã衚瀺ãããããŒã¯ã³ã確èªã§ããŸãã
ã¯ã¬ãžãããæ¶è²»ããããŒã«: diffbot_get_account 以å€ã®ãã¹ãŠã®ããŒã«ã Diffbot ã®ã¯ã¬ãžãããæ¶è²»ããŸããããŒãžã®æœåºã¯ 1 ã¯ã¬ãžãããDiffbot ã®ãããã·çµç±ã§ 2 ã¯ã¬ãžããã§ãïŒdiffbot_analyzeãdiffbot_extract_articleãdiffbot_extract_productãdiffbot_extract_discussionãdiffbot_extract_imageãdiffbot_extract_videoïŒãpaging ã䜿ããšãèšäºãã¹ã¬ããã®è¿œå ããŒãžããšã«ããã« 1 ã¯ã¬ãžããããããŸããdiffbot_analyze_text 㯠10,000 æåããšã« 1 ã¯ã¬ãžããã§ããKnowledge Graph ã¯é«é¡ã§ããdiffbot_search_kg ã¯è¿ããããšã³ãã£ã㣠1 ä»¶ããšã« 25 ã¯ã¬ãžããããã¡ã»ããã¯ãšãªã¯ 100 ã¯ã¬ãžãããdiffbot_enhance ã¯äžèŽ 1 ä»¶ããšã« 25ãrefresh ä»ãã§ 100 ã¯ã¬ãžããã§ããäœãèŠã€ãããªãæ€çŽ¢ãç
§åã¯ç¡æã§ããdiffbot_search_web ãææã§ãããã©ã³ã®æ ãè¶
ããã¯ã¬ãžããã¯ãã©ã³ã®æéã§è«æ±ãããŸããAI 㯠size ãå°ããä¿ã¡ïŒããã§ã®æ¢å®ã¯ 5 ä»¶ãã€ãŸãæå€§ 125 ã¯ã¬ãžããïŒãå€ãã®ãšã³ãã£ãã£ãè¿ããã Knowledge Graph ã®åŒã³åºãã®åã«ã¯ã¬ãžããè²»çšãäŒããŸãã
ããŒãžãèªã: diffbot_analyze ã¯ä»»æã® URL ãåé¡ãïŒèšäºãååããã£ã¹ã«ãã·ã§ã³ãç»åãåç»ããªã¹ããã€ãã³ãããã®ä»ïŒãé©å㪠API ã§æœåºããŸããå
容㯠objects[] ã«å
¥ããŸããmode: llm ãæå®ãããšã¡ã€ã³ã³ã³ãã³ãã® Markdown ãè¿ããmode ã«ããŒãžã®çš®é¡ãæå®ãããšãã®æœåºã匷å¶ããŸãïŒãã®ä»ã«åé¡ãããããŒãžã«ã¯ fallback ã§çš®é¡ãéžã¹ãŸãïŒãçš®é¡ãåãã£ãŠããã°ãAI ã¯å¯Ÿå¿ããããŒã«ã䜿ããŸãã
diffbot_extract_article: ã¿ã€ãã«ãæ¬æãèè ãæ¥ä»ããµã€ããèšèªãKnowledge Graph ãžã®ãªã³ã¯ä»ãã¿ã°ãã«ããŽãªãææ ãç»åãnatural_languageã§èŠçŽããšã³ãã£ãã£ãäºå®ã远å ã§ããpagingã§è€æ°ããŒãžã®èšäºãã€ãªããŸããdiffbot_extract_product: ã¿ã€ãã«ããã©ã³ããè²©å£²äŸ¡æ ŒãšéåžžäŸ¡æ Œãåšåº«ç¶æ³ãSKUãGTINã仿§ãç»åãã«ããŽãªãã¬ãã¥ãŒãdiffbot_extract_discussion: ãã©ãŒã©ã ã®ã¹ã¬ãããã³ã¡ã³ãæ¬ãã¬ãã¥ãŒããŒãžã®æçš¿ããèè ãæ¥ä»ãæ¬æãæç¥šãææ ä»ãã§æœåºããŸããpagingã§æ¬¡ã®ããŒãžããã©ããŸãïŒmax_pagesã¯æ¢å® 20ïŒãdiffbot_extract_imageãšdiffbot_extract_video: ç»å㯠URLããµã€ãºããã£ãã·ã§ã³ã代æ¿ããã¹ããåç»ã¯ã¿ã€ãã«ã説æãé·ããåçåæ°ãåã蟌㿠URLããµã ãã€ã« URLã
Knowledge Graph: diffbot_search_kg ã¯æ°ååä»¶ã®çµç¹ã人ç©ãèšäºãååãã€ãã³ãã DQL ã§æ€çŽ¢ããŸããäŸ: type:Organization industries:"Software Companies" location.country.name:"Japan" nbEmployees>500 sortBy:nbEmployeesãtype:Person employments.employer.name:"Diffbot" employments.isCurrent:trueãfilterïŒäŸ: name;homepageUri;nbEmployeesïŒã§å¿
èŠãªãã£ãŒã«ãã ããè¿ããfilter_exclude ã§äžéšãé€å€ããŸããcluster ã¯èšäºãã°ã«ãŒãåãŸãã¯éè€é€å»ããŸããdiffbot_enhance ã¯åãã£ãŠããæ
å ±ïŒååãš URLãæåšå°ãé»è©±ãã¡ãŒã«ãå€åå
ã圹è·ãåŠæ ¡ïŒãã Organization ãŸã㯠Person ã 1 ä»¶ç
§åããæãè¿ãäžèŽã score ä»ãã§è¿ããŸããthreshold ã§æäœã¹ã³ã¢ãæå®ããŸãã
ããã¹ããš Web æ€çŽ¢: diffbot_analyze_text ã¯æå€§ 100,000 æåãèªã¿ãKnowledge Graph ã® ID ãšéèŠåºŠä»ãã®ãšã³ãã£ãã£ã-1 ãã 1 ã®ææ
ãè¿ããå¿
èŠã«å¿ããŠäºå®ãã¬ã³ãŒããã«ããŽãªãæãèŠçŽãè¿ããŸããdiffbot_search_web 㯠Diffbot ç¬èªã®ã€ã³ããã¯ã¹ã®ããŒãžããURLãã¿ã€ãã«ãæ¥ä»ãã¹ã³ã¢ãåŒçšçšã®ã³ã³ãã³ãæçä»ãã§é äœä»ãããŸããtext ã®äžã§ site:ãurl:ãafter:ãbefore: ã䜿ããmax_tokens ã§å¿çãçãã§ããŸãã
倿Žããããš: ãããŸããããã¹ãŠã®ããŒã«ã¯èªã¿åãå°çšã§ãã€ã³ã¹ããŒã«æã«ç¡å¹ãªããŒã«ããããŸãããè²»çšã¯ã¯ã¬ãžããã ãã§ãã
ããŒã¿åœ¢åŒ: æœåºãªããžã§ã¯ãã®æ¥ä»ã¯ RFC 1123 圢åŒã®ããã¹ãã§ãïŒFri, 04 Sep 2020 00:00:00 GMTïŒãdiffbotUri ãš id 㯠Knowledge Graph ã®ãšã³ãã£ãã£ãèå¥ããŸããäŸ¡æ Œã¯ããã¹ãïŒofferPriceïŒãšãé貚èšå·ä»ãã® offerPriceDetails.amount ã§è¿ããŸããKnowledge Graph ã®çµæã¯ data[].entity ã«ãããhits ã¯äžèŽã®ç·æ°ã§ããå¿çã¯çŽ 100 KB ã«å¶éãããæœåºã®å¿çããã¯ããŒãžã® HTML å
šäœãé€ãããŸãïŒå
容㯠text ãã£ãŒã«ãã«æ®ããŸãïŒã
ããŒãžã³ã°: diffbot_search_kg 㯠from ãš size ã§ããŒãžã³ã°ããŸãïŒArticle ã®ã¯ãšãªã¯å¯Ÿè±¡å€ïŒããšã³ãã£ãã£ã®ããŒãžããšã«æ¹ããŠèª²éãããŸããdiffbot_search_web 㯠size ä»¶ïŒæ¢å® 10ïŒã®çµæãè¿ããŸãã
ä¿¡é Œã§ããªãã³ã³ãã³ã: æœåºããããŒãžãæ€çŽ¢çµæãKnowledge Graph ã®ã¬ã³ãŒãã¯ç¬¬äžè ã®ãµã€ãããæ¥ãŸããAI ã¯ãã®äžã®æç€ºãããŒã¿ãšããŠæ±ããåœä»€ãšããŠã¯æ±ããŸããã
ãããããšã©ãŒ: 401 Not authorized API token ã¯ããŒã¯ã³ãééã£ãŠãããç¡å¹ã§ããããšãæå³ããŸããããã·ã¥ããŒãããã³ããŒãçŽããŠãã ããã404 Could not download page 㯠URL ã«å°éã§ããªãããããã¯ãããŠããããŸãã¯ãã°ã€ã³ãå¿
èŠã§ããããšã瀺ããŸããuse_proxy: defaultïŒ2 ã¯ã¬ãžããïŒã詊ããŠãã ããã429 ã¯åæãªã¯ãšã¹ããå€ãããããKnowledge Graph ã®åŒã³åºãã«å¿
èŠãªã¯ã¬ãžãããè¶³ããªãããšãæå³ããŸããåŸ
ã€ããã©ã³ã確èªããŠãã ãããDQL ã§ã® 400 㯠query ã®æ§æãšã©ãŒã§ããã¹ããŒã¹ãå«ãå€ã¯åŒçšç¬Šã§å²ã¿ããªã³ãããžãŒã®ãã£ãŒã«ãåïŒhttps://www.diffbot.com/docs/dql/referenceïŒã䜿ã£ãŠãã ãããæ¬æã« errorCode ãå«ãæœåºã®å¿çã¯ãDiffbot ã®ã¡ãã»ãŒãžä»ãã®å€±æããåŒã³åºããšããŠå ±åãããŸãã
ãã®ã³ãã¯ã¿ã¯ãCrawl ã Bulk ã®ãžã§ããã«ã¹ã¿ã æœåºã«ãŒã«ãKnowledge Graph ã® CSV ã Excel ãžã®ãšã¯ã¹ããŒããäžæ¬ Enhance ãžã§ããDiffbot ã® LLM ãã£ããã¯æ±ããŸããã
åææ¡ä»¶: DIFFBOT_TOKEN
ããŒã«ã«ã§ã³ãã¯ã¿ãã€ã³ã¹ããŒã«
curl -fsSL https://raw.githubusercontent.com/HelpCode-ai/anythingmcp/main/docker-compose.quickstart.yml -o docker-compose.yml
printf 'JWT_SECRET=%s\nENCRYPTION_KEY=%s\n' "$(openssl rand -hex 32)" "$(openssl rand -hex 32)" > .env
docker compose up -d
http://localhost:3000/connectors/store ãéãã Diffbot ãéžæããåææ¡ä»¶ã«èšèŒãããç°å¢å€æ°ãå
¥åããŸãã
å©çšå¯èœãªããŒã«
| Tool | What it does |
|---|---|
diffbot_get_account | Read the Diffbot account behind the token: name, plan, monthly plan credits, status and daily usage (credits, extractions, Natural Language⊠|
diffbot_analyze | PAID (1 credit, 2 with proxy): read any web page, classify it (article, product, discussion, image, video, list, event or other) and return⊠|
diffbot_extract_article | PAID (1 credit, 2 with proxy): extract a news or blog article: title, text, author, date, site, language, tags with Knowledge Graph links⊠|
diffbot_extract_product | PAID (1 credit, 2 with proxy): extract a shop product page: title, brand, offer and regular price, availability, SKU, GTIN, specifications⊠|
diffbot_extract_discussion | PAID (1 credit per page, 2 with proxy): extract a forum thread, comment section or review page: posts with author, date, text, votes and⊠|
diffbot_extract_image | PAID (1 credit, 2 with proxy): extract the main images of a page with URL, title, size, caption and alt text, or describe an image URL⊠|
diffbot_extract_video | PAID (1 credit, 2 with proxy): extract a video page: title, description, author, date, duration, view count, embed and thumbnail URLs |
diffbot_search_kg | PAID (25 credits per entity returned, 100 per facet query, nothing when no match): search the Diffbot Knowledge Graph with DQL, e.g.⊠|
diffbot_enhance | PAID (25 credits per match, 100 with refresh, nothing when no match): find the Knowledge Graph record of one organization or person from⊠|
diffbot_analyze_text | PAID (1 credit per 10,000 characters): run Diffbot Natural Language on a text: entities with Knowledge Graph ids and salience, sentiment⊠|
diffbot_search_web | PAID: search Diffbot's web index and get ranked pages (URL, title, date, score) with content chunks for citation |
ããã³ããã®äŸ
- ããã®ãã¥ãŒã¹èšäºãæœåºããèè ãæ¥ä»ã3 æã®èŠçŽãææ ãæããŠãã ãããã
- ããã®ååããŒãžãèªã¿ãè²©å£²äŸ¡æ ŒãéåžžäŸ¡æ Œãåšåº«ãããããæããŠãã ãããã
- ãKnowledge Graph ã§åŸæ¥å¡ 500 äººè¶ ã®æ¥æ¬ã®ãœãããŠã§ã¢äŒæ¥ã 5 瀟æ¢ããWeb ãµã€ããšåŸæ¥å¡æ°ã ãã衚瀺ããŠãã ãããå ã«ã¯ã¬ãžããè²»çšãæããŠãã ãããã
- ãdiffbot.com ã®éå¶äŒæ¥ã Knowledge Graph ã§ç §åããæ¥çš®ãæåšå°ãåŸæ¥å¡æ°ãèŠããŠãã ãããã
- ãä»æäœ¿ã£ã Diffbot ã®ã¯ã¬ãžããã¯ã©ããããã§ãã©ã®è£œåãäžçªå€ã䜿ããŸãããïŒã
次ã®ã¹ããã
ãã®ã¬ã€ãã¯åœ¹ã«ç«ã¡ãŸããã?