HTTP is called a stateless protocol because each transaction (request/response) is independent. Then the server answers with a response (the HTML code for example) and closes the connection. An HTTP client (a browser, your Python program, cURL, libraries such as Requests.) opens a connection and sends a message (“I want to see that page : /product”) to an HTTP server (Nginx, Apache.). HyperText Transfer Protocol (HTTP) uses a client/server model. The goal of this article is not to go into excruciating detail on every single of those aspects, but to provide you with the most important parts for extracting data from the web with Python. The Internet is complex: there are many underlying technologies and concepts involved to view a simple web page in your browser. Note: When I talk about Python in this blog post, you should assume that I talk about Python3. Of course, we won't be able to cover every aspect of every tool we discuss, but this post should give you a good idea of what each tool does and when to use one. We will go from the basic to advanced ones, covering the pros and cons of each.
In this post, which can be read as a follow-up to our guide about web scraping without getting blocked, we will cover almost all of the tools to do web scraping in Python.
0 kommentar(er)
