nalepae/pandarallel

A simple and efficient tool to parallelize Pandas operations on all available CPUs

Python

3,796

193 commits

updated Jul 9, 2024

nalepae.github.io/pandarallel

See the code

README

Pandaral·lel

Without parallelization
With parallelization

Pandaral.lel provides a simple way to parallelize your pandas operations on all your CPUs by changing only one line of code. It also displays progress bars.

⚠️ Pandaral·lel is looking for a maintainer! ⚠️

If you are interested, please contact me or open a GitHub issue.

Maintainers

Manu NALEPA

Former maintainers (thanks a lot for your work!)

till-m

Installation

pip install pandarallel [--upgrade] [--user]

Quickstart

from pandarallel import pandarallel

pandarallel.initialize(progress_bar=True)

# df.apply(func)
df.parallel_apply(func)

Usage

Be sure to check out the documentation.

Examples

An example of each available pandas API is available:

For Mac & Linux
For Windows

pandas

parallel

python

Project health

Overall

4.2/10

Maintained

0/10

Code review

4/10

OpenSSF Scorecard

PyPI

pandarallel

Latest release

1.6.5 · May 2, 2023

Releases this year

Significant stargazers

Joshua Carp

326 followers · starred Mar 2022

Junu Kim

37 followers · starred Nov 2022

Thien Tran

376 followers · starred Jun 2024

sileod

42 followers · starred Mar 2022

Similar repos

jmcarpenter2/swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest…

2,630

sybrenjansen/mpire

A Python package for easy multiprocessing, but faster than multiprocessing

2,064

modin-project/modin

Modin: Scale your Pandas workflows by changing a single line of code

10,392

wolph/python-progressbar

Progressbar 2 - A progress bar for Python 2 and Python 3 - "pip install progressbar2"

881

haskell/parallel

a library for parallel programming

pyper-dev/pyper

Concurrent Python made simple

1,518

kevlened/pytest-parallel

A pytest plugin for parallel and concurrent testing

320

pandas-dev/pandas

Flexible and powerful data analysis / manipulation library for Python, providing labeled data…

50,024