Skip to main content

There is this site

https://webscraper.io/test-sites/e-commerce/allinone

I need to scrap out the information of all the products into a excel sheet and send it on email.But the site is changing every new tab and the name is halway in main page. does anyone have idea how to do this?

 

Hi ​@shubam.gaonkar,

 

What do you mean by

  1. “Site is changing every new tab”  - Is it creating pop-up windows automatically without any interaction?
  2. "Name is changing halfway in main page” - Is the window title changing automatically?

open the site you will get it . if you have any idea?

 


open the site you will get it . can you please help on shubamsg20@gmail.com if you have any idea?

 

I had opened it already. I couldn't find anything specific to your query there. Which is why I asked you to provide a bit more clarity.


@shubam.gaonkar At a basic level, the site just has six static pages, organised on two levels of menus. I would personally have one loop for the top-level menu items (Home, Computers, Phones) and an inner loop that handles any sub-menu items (Computers > Laptops, Computers > Tablets, Phones > Touch). 

Once you have the loops set up and clicking on the menu items appropriately, you can then loop through the items in the list. The items are organised in <DIV> tags, which means they won’t resize or change DOM XPATH much if at all. (Many sites like this use a CSS-stylised <UL><LI> tag combination.) 

Once you have the counter loop for the items on the page, you can use Recorder: Capture with a counter to extract all the items on the page.

The other test sites should have a similar challenge. https://webscraper.io/test-sites Have fun!


Reply