How to integrate Screaming Frog with DataImpulse
What is Screaming Frog?
Screaming Frog is a software that helps with SEO (Search Engine Optimization) tasks by collecting data from websites. It can be used on macOS, Linux, and Windows devices. The tool allows you to scrape public data from up to 500 URLs. If you need to scrape more URLs, you will need to upgrade to a larger plan.
Some common SEO tasks that professionals use Screaming Frog for include:
- Searching for redirects
- Finding broken links
- Identifying duplicate content
- Analyzing metadata
- Evaluating site architecture
- And much more!
Screaming Frog SEO Spider proxy integration
In this tutorial, we will be using macOS 12.6.1.
Before we begin t he integration process, make sure to download and install the program. If you have the paid version, you can find the “Enter License” option in the menu bar at the top.
A window will appear, prompting you to enter your username and license key. Simply input the required information and click on the OK and Restart button. You should have received these details in an email after completing the registration process.
- Click on the Configuration menu > select System > select Proxy.
- Enter the required proxy details.
A new window will appear, prompting you to enter the necessary proxy information. Make sure to check the “Use Proxy Server” option.
Residential Proxies
If you are using DataImpulse’ Residential Proxies, enter “gw.dataimpulse.com” in the Address field and “823” in the Port field. Afterward, click on the OK and Restart button to finalize the connection.
- When you begin scraping of public SEO data, the final step requires entering your username and password, and then clicking the “OK” button.
That’s all there is to it! Now you can begin scraping public SEO data without any concerns about getting blocked.