How to load all entries in an infinite scroll at once to parse the HTML in python

I am trying to extract information from this page. The page loads 10 items at a time, and I need to scroll to load all entries (for a total of 100). I am able to parse the HTML and get the information that I need for the first 10 entries, but I want to fully load all entries before parsing the HTML.

.aspx site Web scraping using python

I am attempting to scrape locations from here: https://ukcareers.northropgrumman.com/vacancies/vacancy-search-results.aspx I found similar thread (match my case) from here: Web scraping from .aspx site using python using python by Andrej Kesely, wolf7687. I’ve followed the same for my case. Actually the site which I am attempting contains 5Pages. During scraping I supposed to get locations from … Read more