How to calculate correlation in python

Posted On April 2, 2023

Correlation is a statistical technique that measures the relationship between two variables. In Python, there are several libraries that provide functions to calculate correlation, including numpy, pandas, and scipy. In this blog post, we’ll go over how to use these libraries to calculate the correlation between two variables.

1. Using numpy:

The numpy library provides a function called corrcoef that calculates the correlation coefficient between two variables. The correlation coefficient is a value between -1 and 1 that indicates the strength and direction of the relationship between the variables. Here’s an example:

import numpy as np

x = [1, 2, 3, 4, 5]
y = [2, 4, 6, 8, 10]

correlation = np.corrcoef(x, y)[0, 1]
print("Correlation coefficient:", correlation)

This will output the correlation coefficient between the x and y variables, which is 1.0 in this case, indicating a strong positive relationship between the variables.

2. Using pandas:

The pandas library provides a convenient way to calculate the correlation between two variables. You can create a pandas DataFrame with the two variables and then use the corr method to calculate the correlation. Here’s an example:

import pandas as pd

x = [1, 2, 3, 4, 5]
y = [2, 4, 6, 8, 10]

data = {"x": x, "y": y}
df = pd.DataFrame(data)

correlation = df["x"].corr(df["y"])
print("Correlation coefficient:", correlation)

This will give you the same result as before.

3. Using scipy:

The scipy library provides a function called pearsonr that calculates the Pearson correlation coefficient between two variables. The Pearson correlation coefficient is a commonly used measure of the linear relationship between two variables. Here’s an example:

from scipy.stats import pearsonr

x = [1, 2, 3, 4, 5]
y = [2, 4, 6, 8, 10]

correlation, p_value = pearsonr(x, y)
print("Correlation coefficient:", correlation)

This will output the Pearson correlation coefficient between the x and y variables, which is 1.0 in this case.

In conclusion, these are some of the ways you can calculate the correlation between two variables in Python. Depending on your needs, you can choose the library and method that works best for you.