Python SQL Parser and Transpiler

Apache Spark - A unified analytics engine for large-scale data processing

Apache Doris is an easy-to-use, high performance and unified analytics database.

Implementation of "Colossal Trajectory Mining: A Unifying Approach to Mine Behavioral Mobility Patterns." Expert Systems with Applications.

XL-LightHouse是一套支持超大数据量、支持超高并发的通用型流式大数据统计系统。常见的应用场景包括：PV、UV统计；电商销售额、下单用户数统计；日志量统计；接口调用量、异常量、耗时情况统计；服务器运维指标监控等功能。系统支持多维度统计，支持各种复杂的条件筛选和逻辑判断，一键部署，一行代码接入，轻松实现各种海量数据实时统计，帮助企业以更低的成本快速搭建起数据指标体系，是企业降本增效的好帮手！

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

🏆 Spark4You Design patterns

智元 Fast API 是一站式API管理系统，将各类大模型API进行统一格式、统一规范、统一管理，使其在功能、性能和用户体验上达到极致。

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Apache DataFusion Comet Spark Accelerator

Official code repository for GATK versions 4 and up

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Uniffle is a high performance, general purpose Remote Shuffle Service.

Final project for the course 'Architecture for Large Data Volumes', taught in the Bachelor's program in Data Science at ITAM

This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you could also launch an EMR notebook via cluster template to check the outcome from the EMR Serverless application.

New generation decentralized data lake and a streaming data pipeline

Host a Docker container for the Spark history server / Spark UI of AWS Glue jobs

In this project, we focusing on generating an orders fact table from the dataset provided by Olist in order to analyze the sales performance of the company.

YTsaurus is a scalable and fault-tolerant open-source big data platform.