Skip to main content

What is Diffbot?

Diffbot uses computer vision and machine learning to analyze and extract data from web pages at scale. With APIs such as Article, Product, Organization, and Knowledge Graph, it delivers ready-to-use structured data in seconds. When combined with Toolip, you can rotate IPs, bypass geo-blocks, avoid rate limits, and ensure high success rates—even on protected or region-locked sites.
Targeting search engines like Google, Bing, or Yandex requires a specialized proxy to ensure stable access and avoid blocks. Toolip’s Search Engine ISP Proxies are designed specifically for this, providing reliable performance where standard proxies may fail. If your proxy test isn’t working on search engines, switching to Search Engine ISP Proxies can resolve the issue.

Step-by-Step: Integrating Toolip with Diffbot

1

Sign Up and Acquire a Diffbot API Key

Head over to Diffbot and create your free account. After registration, obtain your API key from the dashboard’s top-right corner.
2

Get Your Toolip Proxy Details

Prepare your Toolip HTTP/SOCKS5 proxy (residential, ISP, or datacenter) in the expected format: http://username:password@host:port.
3

Connect to Diffbot Using Toolip Proxy

Here’s a sample cURL call using your Toolip Proxy (replace placeholders with your actual details):
  • Host: proxy.toolip.io
  • Port: The port assigned in your Toolip Dashboard
  • Username & Password: Your Toolip credentials
  • Token: Your Diffbot API key
curl "https://api.diffbot.com/v3/article?token=YOUR_TOKEN&url=https://example.com/article" --proxy http://[username]:[password]@[host]:[port]
4

Make API Calls in Your Application Code

Below are sample code snippets for integrating Toolip Proxies with Diffbot in both JavaScript and Python. Update them with your actual proxy credentials:
const options = { method: 'GET', headers: { accept: 'application/json' } };

const apiUrl =
  "https://api.diffbot.com/v3/article?" +
  "url=https%3A%2F%2Fwww.amazon.com%2Fs%3Fk%3Dgaming%26_encoding%3DUTF8%26content-id%3Damzn1.sym.edf433e2-b6d4-408e-986d-75239a5ced10%26pd_rd_r%3Dd782a9fe-5930-442a-b9ff-b43594099714%26pd_rd_w%3DuZEDx%26pd_rd_wg%3DMzL55%26pf_rd_p%3Dedf433e2-b6d4-408e-986d-75239a5ced10%26pf_rd_r%3D0MCKXWVTYPQPSJS79SB7%26ref%3Dpd_hp_d_atf_unk" +
  "&token=your_token" +
  "&proxy=[host]:[port]" +
  "&proxyAuth=[username]:[password]";

fetch(apiUrl, options)
  .then(res => res.json())
  .then(res => console.log(res))
  .catch(err => console.error(err));
5

Explore More Resources

You’re ready to get started! For further details and advanced usage, check out the official Diffbot documentation.