Learn HTTP The Right Way

Akram MECHERI
Akram MECHERI
Technical Leader | Blogger | Freelancer

As a passionate technical leader, I am skilled in FullStack Java development and have a strong background in DevOps, Cloud, and Kubernetes. I have a track record of delivering high-quality software, and I am always seeking to improve my knowledge and skills through continuing education and hands-on experience.

Get in Touch
Learn HTTP The Right Way

HTTP stands for Hypertext Transfer Protocol, initially created for web browser/server communication, it has many more use cases today.

In the last few years, I’ve observed many junior developers having a hard time creating and maintaining REST and SOAP services, after a short discussion with them, I often realized that the main reason was the lack of knowledge of the HTTP protocol.
So in this article, I’ll briefly explain the fundamentals of the HTTP protocol.

Client/Server Architecture

The HTTP protocol is a request/response protocol based on the client/server based architecture where web browsers, robots, and search engines, etc. act like HTTP clients, and the Web server acts as a server.

1 - HTTP REQUEST 💻 ➡ 🌎 :

Example of HTTP Request

1–1 Request-Line:

An HTTP request must at least have a Request-Line:

$METHOD $PATH $HTTP_VERSION

E.g:

GET /posts/post-1.html HTTP/1.1

1-1-1 Request-Methods:

Most used HTTP Methods :

Other HTTP Methods exists like : HEAD, CONNECT, PATCH… we will not cover them in this article because they are rarely used in API design.

1–1–2: Request-URI (Path):

The Request-URI is a Uniform Resource Identifier and identifies the resource on the server upon which to apply the request.

1-2 Request-Headers:

The Request-header fields allow the client to pass additional information about the request, and about the client itself, to the server. this information is exploited by the server in different ways such as Authentication, Routing, Analytics, and so on.

E.g:

User-Agent: Used to identify the HTTP client
Authorization: Used for authentication purpose
Host: Identifies the server being requested
Content-Type: Identifies the MIME type of the entity-body carried in HTTP Request or Response

1–3 Request-Body:

The Request-Body of an HTTP Request is used to carry the entity-body associated with the request, A Request-Body MUST NOT be included in a request if the specification of the request method does not allow sending an entity-body in requests.

2. HTTP RESPONSE 💻 ⬅🌎

HTTP/1.1 200 OK
Connection: keep-alive
Last-Modified: Tue, 17 Nov 2020 22:31: 08 GMT
Content-Type: text/html; charset=UTF-8
Content-Length: 97

<html>
  <head>
    <title>Post 1</title>
  </head>
  <body>
    <h1>Example post< h1>
  </body>
</html>

2–1 Status-Line:

The first line of a Response message is the Status-Line, consisting of the protocol version followed by a numeric status code and its associated textual phrase, E.g :

HTTP/1.1 200 OK

You can find the exhaustive list of status codes in the official RFC of HTTP.

2–2 Response-Headers:

The Response-Header fields allow the server to pass additional information about the response which cannot be placed in the Status-Line. These header fields give information about the server and about further access to the resource identified by the Request-URI, E.g:

Content-Type: Indicates the media type of the entity-body 
Content-Length: Indicates the size of the entity-body, in decimal number of bytes

2–3 Response-Body:

The Response-Body is N bytes of content with N specified in the Content-Length header, some of the most used types of content are: Image/jpg, Text/plain, Text/html.

Now that we understand the basics of HTTP, let’s see now how to establish a TCP connexion to an HTTP server and send/receive some bytes to/from it using Python.

import socket

client = socket.socket(socket.AF_INET, socket.SOCK_STREAM)  
 
# Establishing the TCP connection between the python client and the server
# which is listening on port 80.
client.connect(("o1o.herokuapp.com", 80))  
 
# Constructing the HTTP GET request.
request_line_1 = "GET /posts/post-1.html HTTP/1.1\r\n"
request_line_2 = "Host:o1o.herokuapp.com\r\n"
request_line_3 = "\r\n"
request_string = request_line_1 + request_line_2 + request_line_3
print("===================HTTP Request string===============================")
print(request_string)

print("===================HTTP Request bytes===============================")
request_bytes = request_string.encode("utf-8")
print(request_bytes)

# Sending the request bytes.
client.send(request_bytes)  
 
# Receiving the response bytes.
response_bytes = client.recv(500)
print("===================HTTP Response bytes===============================")
print(response_bytes)

# Decoding the request bytes.
response_str = response_bytes.decode("utf-8")
print("===================HTTP Response string==============================")
print(response_str)

Running this Python code will render the following output :

Example of HTTP Request

A Web browser works exactly the same as the previous python program :

Final thoughts,

In this article, we have learned the basics of HTTP, and how to use it to send and receive bytes from an HTTP server.
If you find this article useful, please share it with your friends.

✤ ✤ ✤ ✤ ✤

Support my work 🐶

If you like my content and/or you love dogs, you might want to buy me a ☕

"Buy Me A Coffee"
;