Skip to content

Magenaut

  • Home
  • Topics
    • Notes
    • Tutorial
    • Bug fixing
    • Extension
    • Server
  • Q&A
  • Privacy Policy
  • About

python-requests

Difficulty scraping data with python requests from an asp.net form on a webpage (.aspx)

September 4, 2022 by Magenaut

I’m trying to scrape data from a multi-page table that is returned after filling out a form.
The URL of the original form in question is https://ndber.seai.ie/Pass/assessors/search.aspx

Categories ASP.NET, Q&A Tags asp.net, python, python-requests, web-scraping Leave a comment

Unable to log in to ASP.NET website with requests module of Python

August 29, 2022 by Magenaut

I am trying to log in to an ASP.NET website using the requests module in Python.

Categories ASP.NET, Q&A Tags asp.net, cookies, django, python, python-requests Leave a comment

Sending an ASP.net POST with Python’s Requests

August 27, 2022 by Magenaut

I’m scraping an old ASP.net website using Python’s requests module.

Categories ASP.NET, Q&A Tags asp.net, python, python-requests, web-scraping Leave a comment

making multiple request at the same time with the module requests and print the output on excel(python)

August 22, 2022 by Magenaut

Hi this is quite a complicated question
From this script:

Categories Python, Q&A Tags excel, json, optimization, python, python-requests Leave a comment

Iteratively create a list of URLS from a list and call each for a request

August 22, 2022 by Magenaut

I’m trying to iteratively create urls combining two url variables and a list of unique uuids that need to be added to the url like so .com/{test_adv_uuid}/. My current code looks like this:

Categories Python, Q&A Tags list, loops, python, python-requests, url Leave a comment

Python Web Scrape Query DIV data-brand

August 22, 2022 by Magenaut

I’m trying to grab a div tag in an html page, but the result is showing an empty list. I’ve provided the code and a picture of the html. The page_text variable is an empty list.

Categories Python, Q&A Tags beautifulsoup, html, python, python-requests Leave a comment

Download large file in python with requests

August 22, 2022 by Magenaut

Requests is a really nice library. I’d like to use it for downloading big files (>1GB).
The problem is it’s not possible to keep whole file in memory; I need to read it in chunks. And this is a problem with the following code:

Categories Python, Q&A Tags download, python, python-requests, stream Leave a comment

How to download image using requests

August 22, 2022 by Magenaut

I’m trying to download and save an image from the web using python’s requests module.

Categories Python, Q&A Tags python, python-requests, urllib2 Leave a comment

How to install packages offline?

August 21, 2022 by Magenaut

What’s the best way to download a python package and it’s dependencies from pypi for offline installation on another machine? Is there any easy way to do this with pip or easy_install? I’m trying to install the requests library on a FreeBSD box that is not connected to the internet.

Categories Python, Q&A Tags easy-install, freebsd, pip, python, python-requests Leave a comment

How to “log in” to a website using Python’s Requests module?

August 21, 2022 by Magenaut

I am trying to post a request to log in to a website using the Requests module in Python but its not really working. I’m new to this…so I can’t figure out if I should make my Username and Password cookies or some type of HTTP authorization thing I found (??).

Categories Python, Q&A Tags pyquery, python, python-requests Leave a comment
Older posts
Page1 Page2 … Page8 Next →
  1. michealSmith07 on Is there a way to dynamically refresh the less command?August 21, 2022

    That is a very nice post. I like this post.

  2. anonymous on Fix libwacom9 dependency issue when upgrade DebianJune 27, 2022

    saved my day!! Thanks for the help…

  3. sreedhar on Fix libwacom9 dependency issue when upgrade DebianMay 10, 2022

    Thanks its working

  4. saintnick on Fix libwacom9 dependency issue when upgrade DebianMay 10, 2022

    remove libwacom2 worked for me as well

  5. ranafoul on Fix libwacom9 dependency issue when upgrade DebianApril 22, 2022

    apt remove libwacom2 helped on kali 2022.01. gr8

.net ajax asp.net asp.net-core asp.net-mvc asp.net-mvc-3 asp.net-mvc-4 asp.net-web-api bash c# command-line css custom-post-types custom-taxonomy dataframe dictionary django entity-framework functions gridview html iis javascript jquery json linux list matplotlib numpy pandas php plugin-development plugins posts python python-2.7 python-3.x security shell shell-script sql string vb.net webforms wp-query

© 2026 Magenaut • Built with GeneratePress