Do you know when to use Python and when to use a tool?
I didn't. 😳
Yesterday, I wanted to pull some information from a website so I built a #python script to crawl a set of pages and extract the information into a spreadsheet for me. It wasn't too hard but it took a little time, much more than using a tool like ScreamingFrog.
ScreamingFrog has a custom extraction tool which allows you to pull data from a page using just the XPath. 🤯 That might sound hard but anyone can do this! (see the video)
Here's a few questions❓ to ask yourself (self notes from yesterday) for you to know when to use a tool vs when to build something. These rules aren't hard and fast, but just some notes I took. Had I known to use ScreamingFrog, I'd have saved myself a few hours.
Python (my choice)
🐍 Am I doing something else with the data? (Like rewriting a description with #openai )
🐍 Am I trying to extra data that is in groups and isn't easily got by simple Xpath (like a list of products vs getting the product page)
🐍 Am I trying to extra data from a SPA or a heavy js site?
Use a tool (Screaming Frog)
🐸 Is the data I want on templated pages? (like product pages)
🐸 Am I only using the data for research or some other implementation?
Негізгі бет How to use Screaming Frog Keyword Extraction | Python vs Screaming Frog?
Пікірлер: 3