Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.

Upserts, Deletes And Incremental Processing on Big Data.

Apache Doris Website

lakeFS - Data version control for your data lake | Git for data

Arctic is a streaming lake warehouse service open sourced by NetEase

Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets. Stream data real-time to PyTorch/TensorFlow. https://activeloop.ai

A Data Platform built for AWS, powered by Kubernetes.

Repository intended to upload the codes challenges and notes, through the path of the bootcamp

Poor mans simple python api for creating a local or remote datalake based on several (pyarrow) datasets using duckdb

Ballerina Websub module.

Awesome list for datapipeline

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

汇总Apache Hudi相关资料

Segundo bootcamp da dados do curso da Blue Edtech

Companion to my Linked In Learning 'Serverless Architecture' course

Dynamic Conformance Engine

Self-managed thirdparty dependencies for Apache Doris

on demand databases deployment, varuios kinds, adding more as i use them!

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Genomic BigData Warehousing with Apache Spark and LakeHouse Architecture

Datalake

Creating a Simple Data Lakehouse using Delta Lake on Databricks. My 1st Data Engineering Project.

A Capstone Project that covers several aspects of Data Engineering (Data Exploration, Cleaning, Modeling, Pipelining, Processing)

Collection of data on Formula One Racing

Data Pipeline from the Global Historical Climatology Network DataSet

Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.

The project aims at developing a traveller insight dashboard that can help Swiss Online Travel Agencies(OTAs) to improve conversion cross traveller’s digital decision making process