YTsaurus is a scalable and fault-tolerant open-source big data platform.

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Gateway into the John Snow Labs Ecosystem

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Official code repository for GATK versions 4 and up

This repo contains the Data Engineering exercises I took in Datacamp.

some personal code snippet to learn new programming skill

Compile-time Language Integrated Queries for Scala

Apache Spark - A unified analytics engine for large-scale data processing

Includes notes on Apache Spark, Spark for Physics, Jupyter notebook examples for Spark, Oracle and other DB systems.

Lecture: Big Data

Quill for Scala 3

State of the Art Natural Language Processing

Data Lake project using AWS Services for a Data Engineering bootcamp

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

spark - unified analytics engine for large-scale data processing

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

Spark vs. MongoDB Atlas

Spark data source for Cognite Data Fusion

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

Apache Doris is an easy-to-use, high performance and unified analytics database.

REST API for Apache Spark on K8S or YARN

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

A real-time cryptocurrency data streaming pipeline.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Vijayaraaghavan Manoharan Website

Code Library for My Blog

🏆 Spark4You Design patterns

SageWorks: An easy to use Python API for creating and deploying SageMaker Models