æŠèŠ
AI ãã ScrapingBee ã§ Web ã¹ã¯ã¬ã€ãã³ã°ïŒããŒããŒã·ã§ã³ããã¬ãã¢ã ãã¹ãã«ã¹ã®ãããã·çµç±ã§ä»»æã®ããŒãžãæç»æžã¿ HTMLãMarkdownãããã¹ããšããŠååŸããCSSãXPathãAI ã®ã«ãŒã«ã§æ§é åããŒã¿ãæœåºããã¹ã¯ãªãŒã³ã·ã§ãããæ®ããè§£ææžã¿ã® Google ãš Amazon ã®çµæãååŸãããã©ã³ã®æ®ãã¯ã¬ãžããã確èªã§ããŸãã䜿çšéã®ç¢ºèªä»¥å€ã®ããŒã«ã¯ãã¹ãŠ ScrapingBee ã®ã¯ã¬ãžãããæ¶è²»ããŸãã
ã¬ã€ãä»ãã»ããã¢ãã
ScrapingBee ã Microsoft Copilot ã« 2 åã§æ¥ç¶
AnythingMCP Cloud ã®ç¡æãã©ã€ã¢ã«ãå§ããã¬ã€ãä»ãã»ããã¢ããã§ ScrapingBee ãæ¥ç¶ããŠãMCP URL ã Microsoft Copilot ã«è¿œå ããŸããã³ãŒãããµãŒããŒã®éçšãäžèŠã§ãã
ã¯ã¬ãžããã«ãŒãäžèŠ Â· 7æ¥éã®è©Šçš · ã»ã«ããã¹ãã®éžæè¢ãã
ããèããŠã¿ãã
ScrapingBee ã®ãµã³ãã«ããã³ãã
ããã³ãããã¯ãªãã¯ã§ã³ããŒãClaude / ChatGPT / Cursor / Gemini / Copilot / OpenClaw ã«è²Œãä»ããŠããã®ã³ãã¯ã¿ãŒã§å®è¡ã§ããŸãã
Claude 㯠AI ã®ãã誀ãããšããããŸããåçãã確èªãã ããã
ð¡ ã€ã³ã¹ããŒã«äžèŠ? cloud.anythingmcp.com ãçŽæ¥å©çšããŠãã ããã ãµã€ã³ã€ã³ããConnectors â ScrapingBee ãã¯ãªãã¯ãèªèšŒæ å ±ã貌ãä»ããMCP API ããŒãçºè¡ããã°å®äºã§ããDocker ã
git cloneãããŒã«ã«ãµãŒããŒãäžèŠã
ScrapingBee + Microsoft Copilot
AI ãã ScrapingBee ã§ Web ã¹ã¯ã¬ã€ãã³ã°ïŒããŒããŒã·ã§ã³ããã¬ãã¢ã ãã¹ãã«ã¹ã®ãããã·çµç±ã§ä»»æã®ããŒãžãæç»æžã¿ HTMLãMarkdownãããã¹ããšããŠååŸããCSSãXPathãAI ã®ã«ãŒã«ã§æ§é åããŒã¿ãæœåºããã¹ã¯ãªãŒã³ã·ã§ãããæ®ããè§£ææžã¿ã® Google ãš Amazon ã®çµæãååŸãããã©ã³ã®æ®ãã¯ã¬ãžããã確èªã§ããŸãã䜿çšéã®ç¢ºèªä»¥å€ã®ããŒã«ã¯ãã¹ãŠ ScrapingBee ã®ã¯ã¬ãžãããæ¶è²»ããŸãã
åææ¡ä»¶
å®å šãªã»ããã¢ããæé ã¯ã³ãã¯ã¿èªäœã«çµã¿èŸŒãŸããŠããŸã (ã¹ãã¢ã§ã³ãã¯ã¿ãéžæãããšè¡šç€º)ãå¿ èŠãªç°å¢å€æ°:
SCRAPINGBEE_API_KEY
ã¹ããã 1 â èªèšŒæ å ±ãååŸ
èšå®ã¯çŽ 2 åã§ããScrapingBee ã¢ã«ãŠã³ããå¿ èŠã§ãç¡æãã©ã€ã¢ã«ã«ã¯ 1,000 ã¯ã¬ãžãããå«ãŸããŸãã
- https://dashboard.scrapingbee.com ã«ãµã€ã³ã€ã³ããŸãã
- ããã·ã¥ããŒãïŒhttps://dashboard.scrapingbee.com/account/manage/api_keyïŒãã API key ãã³ããŒããŸãã
- ããŒã
SCRAPINGBEE_API_KEYã«è²Œãä»ããŸããBearer ããŒã¯ã³ãšããŠapp.scrapingbee.comã«ã ãéä¿¡ãããŸãã - ã³ãã¯ã¿ãã€ã³ã¹ããŒã«ãã
scrapingbee_get_usageãå®è¡ããŸããäœ¿çšæžã¿ãšä»äžæžã¿ã®ã¯ã¬ãžããã衚瀺ãããããŒã確èªã§ããŸãã
ã¯ã¬ãžãããæ¶è²»ããããŒã«: scrapingbee_get_usage 以å€ã®ãã¹ãŠã®ããŒã«ããã©ã³ã® API ã¯ã¬ãžãããæ¶è²»ãã課éã¯æåããåŒã³åºãã«å¯ŸããŠã ãçºçããŸãïŒ404 ãš 410 ã®å¿çã察象ïŒãscrapingbee_scrape_page ãš scrapingbee_extract_data ã®ããŒãžååŸã¯ãJavaScript ãªãã§ 1 ã¯ã¬ãžãããJavaScript ããïŒæ¢å®ïŒã§ 5ãpremium_proxy ã§ 10 ãŸã㯠25ïŒJavaScript ãªãïŒããïŒãstealth_proxy ã§ 75 ã§ããAI æœåºã¯ 5 ãå ç®ãããŸããscrapingbee_take_screenshot ã¯åžžã« JavaScript ãæç»ãããã 5 ã¯ã¬ãžããããã¬ãã¢ã ãããã·ã§ 25ãã¹ãã«ã¹ãããã·ã§ 75 ã§ããscrapingbee_google_search 㯠10 ã¯ã¬ãžããïŒlight_request: false ã§ 15ïŒãscrapingbee_fast_search 㯠10 ã§ããscrapingbee_amazon_search ãš scrapingbee_amazon_product ã¯è»œéããŒãž 1 æ 5ãæç»ããŒãž 1 æ 15 ã§ãpages ã®æ°ã ãè²»çšãå¢ããŸããAI ã¯ææã®åŒã³åºãããŸãšããŠè¡ãåã«ç¢ºèªãåããŸãã
ããŒãžãèªã: scrapingbee_scrape_page 㯠HTMLããŸãã¯ã¡ã€ã³ã³ã³ãã³ãã MarkdownïŒreturn_page_markdownïŒããã¬ãŒã³ããã¹ãïŒreturn_page_textïŒã§è¿ããŸããéçãªããŒãžã§ã¯ AI ã render_js: falseïŒ5 ã§ã¯ãªã 1 ã¯ã¬ãžããïŒãæå®ããŸãããããã¯ãããããŒãžã«ã¯ mode: auto ã䜿ããŸããæãå®ãæ§æãã詊ããæåããæ§æã ãã課éãããŸãïŒmax_cost ã§äžéãèšå®ã§ããäŸãã° 25 ãªãã¹ãã«ã¹ãããã·ã¯äœ¿ããŸããïŒãããã㯠premium_proxyãæ¬¡ã« stealth_proxy ã§å詊è¡ããŸããã»ãã®ãªãã·ã§ã³: ãããã·ã®åœãæå®ãã country_codeãwaitïŒæå€§ 35,000 msïŒãCSS ã»ã¬ã¯ã¿ãåŸ
〠wait_forãwait_browserãblock_adsãblock_resourcesïŒæ¢å®ã§ãªã³ïŒãdeviceãcookiesãsession_idïŒ5 åéåã IPïŒãtimeoutããããŠããŒãžååŸåã«ã¯ãªãã¯ãã¹ã¯ããŒã«ããã©ãŒã å
¥åãè¡ã js_scenarioãjson_response ã¯ããããŒãCookieãè²»çšãæçµ URL ãå«ãã JSON ã§å¿çãå
ã¿ãŸãã
ããŒã¿ãæœåºãã: scrapingbee_extract_data ã¯ããŒãžã®ä»£ããã« JSON ãè¿ããŸããæ§é ãåãã£ãŠããã°ãAI 㯠extract_rulesïŒCSS ãŸã㯠XPath ã»ã¬ã¯ã¿ã JSON ããã¹ãã§èšè¿°ãåºå㯠textãhtmlã@hrefãtable_jsonãtable_array ãªã©ïŒãæžããŸããæ§é ãåãããªããã° ai_queryïŒããŒãžã«ã€ããŠã®è³ªåïŒã ai_extract_rulesïŒãã£ãŒã«ããèšèã§èª¬æïŒã䜿ããå¿
èŠãªã ai_selector ã§ããŒãžã®äžéšã«éå®ããŸãã
ã¹ã¯ãªãŒã³ã·ã§ãã: scrapingbee_take_screenshot ã¯è¡šç€ºé åïŒæ¢å® 1920 x 1080ïŒãããŒãžå
šäœïŒscreenshot_full_pageïŒããŸã㯠1 ã€ã®èŠçŽ ïŒscreenshot_selectorïŒã® PNG ãããã¹ã¯ããããŸãã¯ã¢ãã€ã«ã§è¿ããŸãã
æ€çŽ¢: scrapingbee_fast_search 㯠Google ã®ãªãŒã¬ããã¯çµæïŒé äœãã¿ã€ãã«ããªã³ã¯ã説æïŒãšããããã¥ãŒã¹ãçŽ æ©ãäžèЧã«ããŸããscrapingbee_google_search ã¯ãªãŒã¬ããã¯çµæãåºåããã¬ããžã°ã©ããããŒã«ã«ãšå°å³ã®çµæãããããã¥ãŒã¹ãé¢é£ãã質åãå«ãè§£ææžã¿ã®çµæããŒãžãè¿ããŸããsearch_type ã§ newsãmapsãimagesãshoppingãlensãai_modeãads ãéžã³ãŸããAI ã«ããæŠèŠã«ã¯ light_request: false ãå¿
èŠã§ãããã£ã«ã¿: country_codeãlanguageãdeviceãdate_rangeãã·ã§ããã³ã°ã§ã¯ sort_byãmin_priceãmax_priceã
Amazon: scrapingbee_amazon_search ã¯ãéžãã ããŒã±ãããã¬ã€ã¹ïŒdomainãäŸ: comãco.jpãdeïŒã§ã®æ€çŽ¢ã«å¯ŸããååïŒASINãã¿ã€ãã«ãäŸ¡æ Œãé貚ãè©äŸ¡ãã¹ãã³ãµãŒè¡šç€ºãæ²èŒé äœïŒãè¿ããäžŠã¹æ¿ããã«ããŽãªãåºåè
ã§ã®çµã蟌ã¿ãã§ããŸããscrapingbee_amazon_product 㯠ASIN ã§ 1 ã€ã®ååãèªã¿ãäŸ¡æ Œãã«ãŒãç²åŸæ
å ±ãè©äŸ¡ãšã¬ãã¥ãŒæ°ããã©ã³ããç®æ¡æžããç»åãããªãšãŒã·ã§ã³ã詳现ãé
éãåšåº«ã売ãçã©ã³ãã³ã°ãè¿ããŸããzip_code ã§å°åã®äŸ¡æ Œãšé
éããcurrency ã§è¡šç€ºé貚ãæå®ã§ããŸãã
倿Žããããš: ScrapingBee ã¢ã«ãŠã³ãå ã®ãã®ã¯äœã倿ŽããŸããããã¹ãŠã®ããŒã«ã¯èªã¿åãå°çšã§ããã€ã³ã¹ããŒã«æã«ç¡å¹ãªããŒã«ã¯ãããŸãããã䜿çšéã®ç¢ºèªä»¥å€ã®åŒã³åºãã«ã¯ã¯ã¬ãžãããããããŸãã
ããŒã¿åœ¢åŒ: JSON ã®ãªãã·ã§ã³ extract_rulesãai_extract_rulesãjs_scenario 㯠JSON ããã¹ãã§æž¡ããŸããcountry_code ã¯å°æåã® ISO 3166-1 ã³ãŒãã§ããã¬ãã¢ã ãã¹ãã«ã¹ã®ãããã·ãªãã§ã¯ãæªå¯Ÿå¿ã®åœã¯èŠåãªãã« us ã«ãªããŸããAmazon ã§ã¯ããŒã±ãããã¬ã€ã¹èªèº«ã®åœã country ã«æå®ãããzip_code ã䜿ããŸããäŸ¡æ Œã¯ currency ãæå®ããªãéãããŒã±ãããã¬ã€ã¹ã®é貚ã§ãã
ããŒãžã³ã°ãšäžé: scrapingbee_google_search 㯠page ãš pagesïŒ1 ãã 10 ããŒãžããŸãšããŠååŸã3 ããŒãžä»¥äžãæšå¥šïŒãscrapingbee_amazon_search 㯠start_page ãš pagesïŒããŒãžããšã«èª²éïŒãscrapingbee_fast_search 㯠page ãåãåããŸããå¿çã¯çŽ 100 KB ã«å¶éããããããé·ãããŒãžã§ã¯ AI ã Markdownãããã¹ããæœåºã«ãŒã«ã䜿ããŸããscrapingbee_get_usage 㯠1 åã« 6 åãŸã§ã§ã䞊åãªã¯ãšã¹ãã¯ãã©ã³ã®åæå®è¡æ°ã§å¶éãããŸãã
ä¿¡é Œã§ããªãã³ã³ãã³ã: ååŸããããŒãžãæ€çŽ¢çµæã¯ç¬¬äžè ã®ãµã€ãããæ¥ãŸããAI ã¯ãã®äžã®æç€ºãããŒã¿ãšããŠæ±ããåœä»€ãšããŠã¯æ±ããŸããã
ãããããšã©ãŒ: 401 Invalid api key ãŸãã¯ã¯ã¬ãžããåãã®å Žåã¯ãããŒãã³ããŒãçŽãããããã·ã¥ããŒãã§ãã©ã³ã確èªããŠãã ããã400 ã¯äžæ£ãªãã©ã¡ãŒã¿ã®çµã¿åããã§ããäŸãã° mode: auto ãš render_jsãpremium_proxyãstealth_proxy ã®äœµçšããAmazon ãã¡ã€ã³ãšåãåœã® country æå®ãªã©ã§ã課éãããŸããã429 ã¯ãã©ã³ã®åæå®è¡æ°ã®äžéã«éããããšãæå³ããŸããå°ãåŸ
ã£ãŠäžåºŠã ãå詊è¡ããŠãã ããã課éãããŸããã500 ã¯ããŒãžãååŸã§ããªãã£ãããšïŒå¯Ÿè±¡ãµã€ãã®ãšã©ãŒããããã¯ãã¿ã€ã ã¢ãŠãïŒãæå³ãã課éãããŸãããpremium_proxy ã stealth_proxy ã§ã®å詊è¡ãããå¹ããŸãã
ãã®ã³ãã¯ã¿ã¯ãããã·ã¢ãŒãã䜿ãããPOST ã PUT ã®ãªã¯ãšã¹ãã察象ãµã€ãã«è»¢éããã2 MB ãè¶ ãããã¡ã€ã«ãããŠã³ããŒããããWalmartãYouTubeãChatGPTãGemini ã®ãšã³ããã€ã³ãã CLI ã«ã察å¿ããŠããŸããã
ã¹ããã 2 â ã¢ããã¿ãŒãã€ã³ã¹ããŒã«
curl -fsSL https://raw.githubusercontent.com/HelpCode-ai/anythingmcp/main/docker-compose.quickstart.yml -o docker-compose.yml
printf 'JWT_SECRET=%s\nENCRYPTION_KEY=%s\n' "$(openssl rand -hex 32)" "$(openssl rand -hex 32)" > .env
docker compose up -d
ã¹ããã 3 â Microsoft Copilot ã«ã³ãã¯ã¿ã远å
ãµãŒããŒURL: AnythingMCP ã§ MCP Servers ãéãããã®ã³ãã¯ã¿ããããµãŒããŒãéžãã§ URLïŒ
https://cloud.anythingmcp.com/mcp/âŠïŒãã³ããŒããŸãããã®ã¬ã€ãã§YOUR_SERVER_IDãšè¡šç€ºãããŠããç®æã«äœ¿ã£ãŠãã ããã
Microsoft Copilot ã¯ãCopilot Studio ã§äœæãããšãŒãžã§ã³ããéã㊠MCP ãµãŒããŒã䜿ããŸããAnythingMCP ãããŒã«ãšããŠãšãŒãžã§ã³ãã«è¿œå ãããã®ãšãŒãžã§ã³ãã Microsoft 365 Copilot ãš Teams ã«å ¬éããŸããCopilot Studio 㯠Microsoft ã®ã¯ã©ãŠããã Streamable HTTP ã§æ¥ç¶ããAnythingMCP ã¯ããã«å¯Ÿå¿ããŠããŸãã
- Copilot Studio ã§ãšãŒãžã§ã³ããéãïŒãŸãã¯æ°èŠäœæãïŒãTools ã§ Add a tool â New tool â Model Context Protocol ãéžã³ãŸãã
- Server nameïŒäŸ:
AnythingMCPïŒãã³ãã¯ã¿ã§ã§ããããšã説æãã Server descriptionãServer URLhttps://cloud.anythingmcp.com/mcp/YOUR_SERVER_IDãå ¥åããŸããCopilot Studio ã¯ãã®èª¬æãããšã«ããã€ãµãŒããŒãåŒã³åºããã倿ããŸãã - èªèšŒã§ API key ãéžã³ãType ã HeaderãããããŒåã
X-API-Keyã«ã㊠Create ãéžã³ãŸãã - Add tool ã§ Create a new connection ãéžã³ãAnythingMCP ã® MCP API ããŒïŒMCP Servers â 察象ã®ãµãŒã㌠â API keysïŒã貌ãä»ã㊠Add to agent ãéžã³ãŸãã
- ãšãŒãžã§ã³ãã® Test ãŠã£ã³ããŠã§è©ŠããŸãã
ScrapingBeeã®ããŒã«ãå¿ èŠã«ãªãäŸé ŒãããŠã¿ãŸãããã - Publish ãéžã³ãChannels â Microsoft 365 and Microsoft Teams ã§ Make agent available in Microsoft Copilot ãéžæãããŸãŸ Add channel ãéžã³ãŸããSee agent in Teams ã§èªåçšã«ã€ã³ã¹ããŒã«ãããŸããMicrosoft 365 Copilot ã§ã¯ @ ãå ¥åããŠãšãŒãžã§ã³ããéžã³ãŸãã
ãŠãŒã¶ãŒããšã«ãµã€ã³ã€ã³ããããå Žåã¯ãAPI ããŒã®ä»£ããã« OAuth 2.0 â Dynamic discovery ãéžã³ãŸããåãŠãŒã¶ãŒã¯ããšãŒãžã§ã³ããåããŠåŒã³åºããšãã« AnythingMCP ã«ãµã€ã³ã€ã³ããŸãã
ã»ã«ããã¹ãã®å Žåã¯ãhttps://cloud.anythingmcp.com ã®ä»£ããã«ã€ã³ã¹ã¿ã³ã¹ã®å
¬é HTTPS ã¢ãã¬ã¹ã䜿ã£ãŠãã ãããCopilot Studio 㯠Microsoft ã®ã¯ã©ãŠãããæ¥ç¶ãããããlocalhost ã¯äœ¿ããŸããã
å©çšå¯èœãªããŒã«
| Tool | What it does |
|---|---|
scrapingbee_get_usage | Read the ScrapingBee plan usage: credits used and included this period, current and maximum concurrency, and the renewal date |
scrapingbee_scrape_page | PAID: fetch one web page through ScrapingBee and return its HTML, markdown (return_page_markdown) or text (return_page_text) |
scrapingbee_extract_data | PAID: extract structured JSON from one web page instead of returning the page |
scrapingbee_take_screenshot | PAID: take a PNG screenshot of a web page: the viewport (default), the full page or one element |
scrapingbee_google_search | PAID: run a Google search and get the parsed result page: organic results, ads, knowledge graph, local and map results, top stories⊠|
scrapingbee_fast_search | PAID: quick Google search returning a light list of organic results (rank, title, link, description) and top stories, usually in under a⊠|
scrapingbee_amazon_search | PAID: search Amazon and get structured products (ASIN, title, price, currency, rating, sponsored flag, position) for a query on a chosen⊠|
scrapingbee_amazon_product | PAID: read one Amazon product by ASIN: title, price, buy box, rating and reviews count, brand, bullet points, images, variations, product⊠|
ããã³ããã®äŸ
- ãä»æã® ScrapingBee ã¯ã¬ãžããã¯ããšã©ããããæ®ã£ãŠããŸããïŒ ãã©ã³ã¯ãã€æŽæ°ãããŸããïŒã
- ãhttps://example.com/blog/launch ã JavaScript ãªãã§ Markdown ãšããŠååŸããèšäºãèŠçŽããŠãã ãããã
- ããã®ã·ã§ããã®ããŒãžãããåååãäŸ¡æ Œãåšåº«ç¶æ³ã AI æœåºã«ãŒã«ã§åãåºããŠãã ãããã
- ãhttps://example.com ã®ããŒãžå šäœãã¢ãã€ã«ã§ã¹ã¯ãªãŒã³ã·ã§ããããã¹ã¯ããŒã«ããã«èŠããå 容ãæããŠãã ãããã
- ãAmazon.co.jp ã§ 65 W ã® USB-C å é»åšãè©äŸ¡é ã«æ€çŽ¢ããäžäœ 10 ä»¶ã ASIN ãšäŸ¡æ Œä»ãã§äžèЧã«ããŠãã ãããã
FAQ
ã©ã® Copilot ã察象ã§ãã? è·å Žã§äœ¿ã Microsoft 365 Copilot ã§ãCopilot Studio ã®ãšãŒãžã§ã³ããéããŠå©çšããŸããå人ã¢ã«ãŠã³ãåãã® Microsoft Copilot ã¢ããªã§ã¯ãç¬èªã® MCP ãµãŒããŒã远å ã§ããŸããã
äœãå¿ èŠã§ãã? ãšãŒãžã§ã³ããäœæããããã«ãCopilot Studio ãå©çšã§ããè·å Žã¢ã«ãŠã³ãïŒã©ã€ã»ã³ã¹ãŸãã¯è©ŠçšçïŒãå¿ èŠã§ããMicrosoft 365 Copilot ã Teams ã§ãšãŒãžã§ã³ãã䜿ã人ã«ã¯ããšãŒãžã§ã³ããžã®ã¢ã¯ã»ã¹æš©ãå¿ èŠã§ããå ±æãããã管çè ã«çµç¹åãã«å ¬éããŠããã£ãŠãã ãããçµç¹ã Power Platform ã³ãã¯ã¿ã«ããŒã¿ ããªã·ãŒãé©çšããŠããå Žåã¯ãMCP ãµãŒããŒã«ãé©çšãããŸãã
ãšãŒãžã§ã³ããããŒã«ãåŒã³åºããŸããã ããããŒåãæ£ç¢ºã« X-API-Key ã§ããããšãããŒã URL ãšåã MCP ãµãŒããŒã®ãã®ã§ããããšã確èªããServer description ãå
·äœçã«æžããŠãã ãããCopilot Studio ã¯ãã®èª¬æãããšã«ãµãŒããŒãåŒã³åºããã©ããã倿ããŸãã倿Žã®ãã³ã«ãšãŒãžã§ã³ããåå
¬éããéããŠãããã£ããã§ã¯ "start over" ãšå
¥åãããšæ°ããããŒãžã§ã³ã«ãªããŸãã
次ã®ã¹ããã
- ã³ãã¯ã¿ã®ã©ã³ãã£ã³ã°
- Claude ã«æ¥ç¶
- ChatGPT ã«æ¥ç¶
- Cursor ã«æ¥ç¶
- Gemini ã«æ¥ç¶
- Meta Muse ã«æ¥ç¶
ãã®ã¬ã€ãã¯åœ¹ã«ç«ã¡ãŸããã?