Quantcast
Channel: Active questions tagged html - Stack Overflow
Viewing all articles
Browse latest Browse all 72416

How to scrape info from a specific page of a website that has a single URL for multiple pages?

$
0
0

I am trying to write a program that automatically clicks on certain places based on what is displayed. The website I am trying to do this on is Gimkit. I am using a python web-scraper and auto-clicker to perform this task. The problem I am running into is that the player side URL is the same, no matter what html is loaded. This leads to the scraper only getting the html for the first page, which is the game PIN page. This means that my scraper is getting no useful information and is simply stuck. When I fill out the information on my device and check the URL, it is the same. There is no difference in the URL when I am entering the PIN or playing the game, but when I inspect element, it obviously is different html. Right now, I am using BeautifulSoup4 and lxml to get the html from the site. How can I access the html for the gameplay page instead of the PIN page?

Related: How can I keep the same url in the address bar for every page?


Viewing all articles
Browse latest Browse all 72416

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>