Apache Spark
Apache Software Foundation · Analytical engines & OLAP
Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib
4 tools
Apache Software Foundation · Analytical engines & OLAP
Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
Polars (Ritchie Vink and contributors) · DataFrames & array computing
Rust-based DataFrame library with Python, Rust, Node and R bindings offering lazy query optimization, multithreading and Arrow-native memory
Python Software Foundation · Programming languages & runtimes
General-purpose, dynamically typed programming language with a large standard library and the dominant ecosystem for data science and machine learning
Page 1 of 1
Share this view: /tools?use=query-parquet-files&os=windows&exec=cloud