Skip to main content
Solved

Need help with this webscraper challenge

  • September 11, 2025
  • 4 replies
  • 56 views
S
Forum|alt.badge.img+1

There is this site

https://webscraper.io/test-sites/e-commerce/allinone

I need to scrap out the information of all the products into a excel sheet and send it on email.But the site is changing every new tab and the name is halway in main page. does anyone have idea how to do this?

 

Best answer by Aaron.Gleason

​@shubam.gaonkar At a basic level, the site just has six static pages, organised on two levels of menus. I would personally have one loop for the top-level menu items (Home, Computers, Phones) and an inner loop that handles any sub-menu items (Computers > Laptops, Computers > Tablets, Phones > Touch). 

Once you have the loops set up and clicking on the menu items appropriately, you can then loop through the items in the list. The items are organised in <DIV> tags, which means they won’t resize or change DOM XPATH much if at all. (Many sites like this use a CSS-stylised <UL><LI> tag combination.) 

Once you have the counter loop for the items on the page, you can use Recorder: Capture with a counter to extract all the items on the page.

The other test sites should have a similar challenge. https://webscraper.io/test-sites Have fun!

4 replies

Padmakumar
Premier Pathfinder | Tier 7
Forum|alt.badge.img+15
  • Padmakumar
  • Premier Pathfinder | Tier 7
  • September 11, 2025

Hi ​@shubam.gaonkar,

 

What do you mean by

  1. “Site is changing every new tab”  - Is it creating pop-up windows automatically without any interaction?
  2. "Name is changing halfway in main page” - Is the window title changing automatically?
Padmakumar
S
Forum|alt.badge.img+1
  • shubam.gaonkar
  • Author
  • Cadet | Tier 2
  • September 11, 2025

open the site you will get it . if you have any idea?

 

Padmakumar
Premier Pathfinder | Tier 7
Forum|alt.badge.img+15
  • Padmakumar
  • Premier Pathfinder | Tier 7
  • September 11, 2025

open the site you will get it . can you please help on shubamsg20@gmail.com if you have any idea?

 

I had opened it already. I couldn't find anything specific to your query there. Which is why I asked you to provide a bit more clarity.

Padmakumar
Shreya.Kumar
Aaron.Gleason
Automation Anywhere Team
Forum|alt.badge.img+14
  • Aaron.Gleason
  • Automation Anywhere Team
  • Answer
  • September 11, 2025

​@shubam.gaonkar At a basic level, the site just has six static pages, organised on two levels of menus. I would personally have one loop for the top-level menu items (Home, Computers, Phones) and an inner loop that handles any sub-menu items (Computers > Laptops, Computers > Tablets, Phones > Touch). 

Once you have the loops set up and clicking on the menu items appropriately, you can then loop through the items in the list. The items are organised in <DIV> tags, which means they won’t resize or change DOM XPATH much if at all. (Many sites like this use a CSS-stylised <UL><LI> tag combination.) 

Once you have the counter loop for the items on the page, you can use Recorder: Capture with a counter to extract all the items on the page.

The other test sites should have a similar challenge. https://webscraper.io/test-sites Have fun!

Shreya.Kumar
Terms & ConditionsCookie settingsAccessibility statement