The streaming database: redefining stream processing 🌊. PostgreSQL-compatible, highly performant, scalable, elastic, and reliable ☁️.

YTsaurus is a scalable and fault-tolerant open-source big data platform.

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries. InfoWorld’s 2023 BOSSIE Award for best open source software.

TuGraph Analytics is an OLAP graph database.

Apache Spark - A unified analytics engine for large-scale data processing

Apache Flink

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

Apache Parquet

ClickHouse® is a free analytics DBMS for big data

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

VerticaPy is a Python library that exposes sci-kit like functionality to conduct data science projects on data stored in Vertica, thus taking advantage Vertica’s speed and built-in analytics and machine learning capabilities.

Sub-second search & analytics engine on cloud storage

A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)

Seamless multi-master syncing database with an intuitive HTTP/JSON API, designed for reliability

This application predicts whether a past event was a success or a failure

swissgeol.ch gives you insight in geoscientific data - above and below the surface.

Apache Flink Website

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

Apache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads

Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨

Apache Calcite Website

Mirror of Apache Calcite - Avatica Go SQL Driver

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

MalwareDB: bookkeeping for malware, goodware, and unknown files with relationship discovery

Apache IoTDB

DS5110 Big Data Systems

A distributed block-based data storage and compute engine

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Java library that sorts very large files of records by splitting into smaller sorted files and merging

🚄 FASTJSON2 is a Java JSON library with excellent performance.