Scraping getyourguide.com

questions
1

Hi everyone,

I hope you’re all doing well!

I’m new to this community and still learning the ropes. I was wondering if someone could kindly help me out with a video tutorial or some guidance on how to scrape content from GetYourGuide.com. Specifically, I’m looking to scrape photos and descriptions from multiple pages within the same category.

My goal is to use this content on my website as part of an affiliate program. I’m a bit lost on where to start and would greatly appreciate any assistance or advice you could offer.

Thanks so much for your time and help!

1 Like
2

Thankyou for the post, let me see the site,

Scrape these results right?

image
image1282×487 471 KB

Did you play around with it in the dynamic scraper?

3

yes, but i try to pin the photos and don´t grab.

4

Are you able to load the picker?

I can’t get it to show up even on the site

5

nop i can´t load the picker to scrape

6

Ill try and figure out why

However, the work around is to open the site in Google Chrome etc and use developer mode (F12) picker

image
image1325×568 225 KB

I can then add rules manually to select data

image
image1267×571 30.9 KB

Add empty rule button is added in next update

image
image1273×239 5.99 KB

Ill push update now, so that at least you can add rules while I figure out a solution for the picker

7

Thank you so much, amazing suporte Tim :muscle:

8

The problem is that this site has some restrictive Content-Security-Policy blocking injection of scripts.

So the picker is unable to load.

Looking to see if I can disable it.

9

Took some playing around, but I was finally able to over ride the CSP and get the picker to load

image
image1154×552 485 KB

Will upload the new patch.

Hopefully I didn’t break something else with the picker change

1 Like
10

Thank you so much you are amazing!! :muscle:

11

You’re welcome,

Its working now?

12

yeah the picker works perfect, i´m not usual scraper, and i don´t know how i can scrape in bulk one categorie, do you you have some video explain how i do that?

13

How far did you get?

I can write it up first, then a video comes later.

14

I can identify all the items I want to extract with the picker, but I don’t know how to select them so that it scraps my data onto the next pages.

15

Understood

OK I’ll focus on paging issue.

Feature will be added here →