Skip to content

Magenaut

  • Home
  • Topics
    • Notes
    • Tutorial
    • Bug fixing
    • Extension
    • Server
  • Q&A
  • Privacy Policy
  • About

web-scraping

Difficulty scraping data with python requests from an asp.net form on a webpage (.aspx)

September 4, 2022 by Magenaut

I’m trying to scrape data from a multi-page table that is returned after filling out a form.
The URL of the original form in question is https://ndber.seai.ie/Pass/assessors/search.aspx

Categories ASP.NET, Q&A Tags asp.net, python, python-requests, web-scraping Leave a comment

Scraping in R, aspx form don’t know how to get data

September 4, 2022 by Magenaut

Hello Im traying to scrape data from https://eservicios2.aguascalientes.gob.mx/sop/geobras/UI/frmObrasTodas.aspx

Categories ASP.NET, Q&A Tags asp.net, r, web-scraping Leave a comment

pull data with HtmlAgilityPack Web Scraping c#

September 4, 2022 by Magenaut

What could be the reason that it returns null in selectnodes?

Categories ASP.NET, Q&A Tags .net, asp.net, html-agility-pack, web-scraping Leave a comment

Scrapy crawling not working on ASPX website

August 28, 2022 by Magenaut

I’m scraping the Madrid Assembly’s website, built in aspx, and I have no idea how to simulate clicks on the links where I need to get the corresponding politicians from. I tried this:

Categories ASP.NET, Q&A Tags asp.net, javascript, python, scrapy, web-scraping Leave a comment

Sending an ASP.net POST with Python’s Requests

August 27, 2022 by Magenaut

I’m scraping an old ASP.net website using Python’s requests module.

Categories ASP.NET, Q&A Tags asp.net, python, python-requests, web-scraping Leave a comment

Crawling through pages with PostBack data javascript Python Scrapy

August 27, 2022 by Magenaut

I’m crawling through some directories with ASP.NET programming via Scrapy.

Categories ASP.NET, Q&A Tags asp.net, javascript, python, scrapy, web-scraping Leave a comment

web-scrape asp.net web-site with r

August 25, 2022 by Magenaut

I’d like to web-scrape the html as seen in the source code of the web-browser, for this url “https://portal.tirol.gv.at/wisPvpSrv/wisSrv/wis/wbo_wis_auszug.aspx?ATTR=Y&TREE=N&ANL_ID=T20889658R3&TYPE=0”.

Categories ASP.NET, Q&A Tags asp.net, r, web-scraping Leave a comment

Css selector returns blank list

August 22, 2022 by Magenaut

Hi there I am new to scrapy and web scraping in general and I am having a hard time with trying to scrape from this website: https://www.webuycars.co.za/buy-a-car

Categories Python, Q&A Tags javascript, python, scrapy, scrapy-splash, web-scraping Leave a comment

Web scraping pagination with scrapy

August 22, 2022 by Magenaut

I’m trying web scraping with scrapy. But I got “duplicates” warning. Can’t jump next page.

Categories Python, Q&A Tags python, scrapy, web-scraping Leave a comment

How to scrape Trusted Shops?

August 22, 2022 by Magenaut

I would appreciate your help on this scraping problem.

Categories Python, Q&A Tags beautifulsoup, python, web-scraping Leave a comment
Older posts
Page1 Page2 … Page6 Next →
  1. michealSmith07 on Is there a way to dynamically refresh the less command?August 21, 2022

    That is a very nice post. I like this post.

  2. anonymous on Fix libwacom9 dependency issue when upgrade DebianJune 27, 2022

    saved my day!! Thanks for the help…

  3. sreedhar on Fix libwacom9 dependency issue when upgrade DebianMay 10, 2022

    Thanks its working

  4. saintnick on Fix libwacom9 dependency issue when upgrade DebianMay 10, 2022

    remove libwacom2 worked for me as well

  5. ranafoul on Fix libwacom9 dependency issue when upgrade DebianApril 22, 2022

    apt remove libwacom2 helped on kali 2022.01. gr8

.net ajax asp.net asp.net-core asp.net-mvc asp.net-mvc-3 asp.net-mvc-4 asp.net-web-api bash c# command-line css custom-post-types custom-taxonomy dataframe dictionary django entity-framework functions gridview html iis javascript jquery json linux list matplotlib numpy pandas php plugin-development plugins posts python python-2.7 python-3.x security shell shell-script sql string vb.net webforms wp-query

© 2026 Magenaut • Built with GeneratePress