Apache Arrow
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
19 tools
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
Apache Software Foundation · Messaging & queues
Distributed event streaming platform with durable, partitioned, replayable logs, Kafka Connect connectors and Kafka Streams processing
Apache Software Foundation · Data catalogs & formats
Open columnar file format for analytical data with compression, encodings and statistics, readable by nearly every data engine and library
ClickHouse, Inc. · Analytical engines & OLAP
Open-source columnar OLAP database server for fast aggregations over billions of rows, with MergeTree storage, SQL and a managed ClickHouse Cloud
DuckDB Foundation / DuckDB Labs · Analytical engines & OLAP
In-process analytical SQL database that queries Parquet, CSV and Arrow data directly from Python, R, Node or the CLI
GeoPandas developers (NumFOCUS affiliated) · GIS & mapping
Python library extending pandas with geometry columns, spatial operations, reprojection, spatial joins and file I/O for vector geodata
Kùzu Inc. (company acquired; project archived) · NoSQL & key-value stores
Embedded property-graph database with Cypher, vector and full-text search; MIT-licensed but archived in October 2025 after the company was acquired
pandas development team (NumFOCUS) · DataFrames & array computing
The standard Python DataFrame library for labeled tabular data, time series and I/O to CSV, Excel, SQL, Parquet and more
Andrew Kane (pgvector project) · Vector databases
PostgreSQL extension adding vector types, distance operators and HNSW/IVFFlat indexes for similarity search inside the database
Microsoft · Testing & QA
Microsoft's browser automation and end-to-end testing framework driving Chromium, Firefox and WebKit from one API in TypeScript, Python, Java and .NET
Polars (Ritchie Vink and contributors) · DataFrames & array computing
Rust-based DataFrame library with Python, Rust, Node and R bindings offering lazy query optimization, multithreading and Arrow-native memory
PostGIS Project Steering Committee (OSGeo) · GIS & mapping
Spatial extension for PostgreSQL adding geometry, geography and raster types with indexing and hundreds of SQL functions
PostgreSQL Global Development Group · Relational databases
Open-source object-relational database server with a large extension ecosystem (PostGIS, pgvector, TimescaleDB) and broad SQL coverage
Project Jupyter (NumFOCUS) · Notebooks & interactive computing
Open-source computational notebook ecosystem: the .ipynb format, kernels for Python, R and Julia, JupyterLab and Notebook interfaces and JupyterHub
Google (Chrome DevTools team) · Data collection & crawling
Node.js library from the Chrome team for controlling Chrome and Firefox over the DevTools Protocol or WebDriver BiDi, used for scraping, screenshots, PDFs and testing
Qdrant Solutions GmbH · Vector databases
Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud
Posit Software, PBC · Academic writing & publishing
Open-source scientific publishing system from Posit that renders Markdown with executable Python, R, Julia or Observable code to HTML, PDF, Word, slides, websites and books via Pandoc
Scrapy developers (maintained with Zyte) · Data collection & crawling
Mature open-source Python framework for writing crawlers (spiders) that fetch pages asynchronously, extract structured items and export them through pipelines
SQLite Consortium / Hipp, Wyrick & Company · Relational databases
Public-domain embedded SQL database engine that stores a whole database in one file and ships inside most operating systems and browsers
Page 1 of 1
Share this view: /tools?category=data&source=open-source&depth=deep