Proxies

The proxy feature allows you to route your scraping requests through a specified HTTP(S) proxy. This can be useful for bypassing IP-based rate limits or accessing region-restricted content.

export const config = {
    // Specify a single HTTP(S) proxy URL.
    proxy: "http://someproxy.com:8043",
};

In the above example, all scraping requests will be routed through the proxy at http://someproxy.com:8043.

Multiple Proxies

You can also specify multiple proxy URLs. The scraper will rotate between these proxies for each request.

export const config = {
    // Specify multiple HTTP(S) proxy URLs.
    proxies: [
      "http://someproxy.com:8043",
      "http://someotherproxy.com:8043",
    ],                     
};

In this example, the scraper will randomly pick between the proxies at http://someproxy.com:8043 and http://someotherproxy.com:8043.

Note: If both proxy and proxies are specified, all proxies will be respected.