Repositories list

• jupyterlab-pipelines

  Public
  Export Jupyter notebooks to Airflow DAGs and Ilum Spark jobs - build, run, and schedule pipelines from the JupyterLab sidebar.

  airflowapache-sparkjupyter+ 8

  airflowapache-sparkjupyteretljupyter-notebookdata-engineeringdbtdata-pipelinesapache-airflowjupyterlab-extension+ 1

  Python

  •

  Apache License 2.0

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 8, 2026Jun 8, 2026

• duck_lineage

  Public
  A extension for DuckDB, which captures lineage events for executed queries

  data-managementdata-lineageduckdb+ 1

  data-managementdata-lineageduckdbduckdb-extension

  Python

  •

  MIT License

  •33 forks•7878 stars•00 issues•00 pull requests•Updated May 26, 2026May 26, 2026

• duckdb-community-extensions

  Public
  Python

  •216216 forks•00 stars•00 issues•00 pull requests•Updated May 26, 2026May 26, 2026

• duckdb-quack

  Public
  C++

  •

  MIT License

  •2929 forks•00 stars•00 issues•00 pull requests•Updated May 25, 2026May 25, 2026

• duckdb-hive-metastore

  Public
  DuckDB extension allowing to connect to Apache Hive Metastore and query the data inside, like a native DuckDB catalog.

  C++

  •

  MIT License

  •11 fork•44 stars•11 issue•00 pull requests•Updated May 22, 2026May 22, 2026

• duckdb

  Public
  DuckDB is an analytical in-process SQL database management system

  C++

  •

  MIT License

  •3.4k3.4k forks•00 stars•00 issues•00 pull requests•Updated May 22, 2026May 22, 2026

• ambari

  Public
  Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.

  Java

  •

  Apache License 2.0

  •1.7k1.7k forks•00 stars•00 issues•00 pull requests•Updated May 15, 2026May 15, 2026

• hive

  Public
  Apache Hive

  Java

  •

  Apache License 2.0

  •4.8k4.8k forks•00 stars•00 issues•00 pull requests•Updated May 11, 2026May 11, 2026

• marquez

  Public
  Collect, aggregate, and visualize a data ecosystem's metadata

  metadatadata-sciencedata-catalog+ 9

  metadatadata-sciencedata-catalogdata-discoverydata-dictionarydata-governancedata-lineagedata-opsdata-provenancemetadata-service+ 2

  Java

  •

  Apache License 2.0

  •404404 forks•1616 stars•22 issues•00 pull requests•Updated May 6, 2026May 6, 2026

• console

  Public
  A modern, responsive web management console for RustFS distributed file system, built with Next.js 16 (App Router) + React 19 + TypeScript + Tailwind CSS v4 + s…

  TypeScript

  •

  Apache License 2.0

  •6060 forks•00 stars•00 issues•00 pull requests•Updated May 6, 2026May 6, 2026

• OpenLineage

  Public
  An Open Standard for lineage metadata collection

  Java

  •

  Apache License 2.0

  •483483 forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• spark

  Public
  Apache Spark - A unified analytics engine for large-scale data processing

  Scala

  •

  Apache License 2.0

  •29k29k forks•22 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• hadoop

  Public
  Apache Hadoop

  Java

  •

  Apache License 2.0

  •9.2k9.2k forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• ClickHouse

  Public
  ClickHouse

  C++

  •

  Apache License 2.0

  •8.6k8.6k forks•00 stars•00 issues•00 pull requests•Updated Apr 11, 2026Apr 11, 2026

• ilum-tilt

  Public
  Tilt-based local development setup for the Ilum data lakehouse platform

  Starlark

  •00 forks•11 star•22 issues•00 pull requests•Updated Mar 31, 2026Mar 31, 2026

• bigtop-manager

  Public
  Bigtop Manager is a modern, AI-driven web application designed to simplify the complexity of bigdata cluster management.

  Java

  •

  Apache License 2.0

  •4848 forks•00 stars•00 issues•00 pull requests•Updated Mar 30, 2026Mar 30, 2026

• ilum-cli

  Public
  00 forks•11 star•00 issues•00 pull requests•Updated Mar 12, 2026Mar 12, 2026

• doc

  Public
  Ilum - Apache Spark cluster on Kubernetes

  kubernetessparkmanager+ 2

  kubernetessparkmanagerolapobject-storage

  11 fork•77 stars•11 issue•00 pull requests•Updated Feb 13, 2026Feb 13, 2026

• duckdb-java

  Public
  DuckDB JDBC Driver

  C++

  •

  MIT License

  •7676 forks•00 stars•00 issues•00 pull requests•Updated Feb 13, 2026Feb 13, 2026

• bigtop

  Public
  Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the l…

  Groovy

  •

  Apache License 2.0

  •527527 forks•00 stars•00 issues•00 pull requests•Updated Jan 30, 2026Jan 30, 2026

• jupyterlab-bucket-explorer

  Public
  A modern, multi-cloud object storage browser for JupyterLab 4. Unified interface to browse, manage, and edit files across AWS S3, MinIO, and S3-compatible stora…

  pythonproductivitydata-science+ 8

  pythonproductivitydata-sciencejupyters3cloud-storageminiofile-browserjupyterlabobject-storage+ 1

  TypeScript

  •

  Apache License 2.0

  •00 forks•44 stars•00 issues•00 pull requests•Updated Jan 22, 2026Jan 22, 2026

• airflow

  Public
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  Python

  •

  Apache License 2.0

  •17k17k forks•00 stars•00 issues•00 pull requests•Updated Jan 2, 2026Jan 2, 2026

• gravitino

  Public
  World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

  Java

  •

  Apache License 2.0

  •886886 forks•00 stars•00 issues•00 pull requests•Updated Jan 1, 2026Jan 1, 2026

• unitycatalog

  Public
  Open, Multi-modal Catalog for Data & AI

  Java

  •

  Apache License 2.0

  •643643 forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• delta

  Public
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

  Scala

  •

  Apache License 2.0

  •2.1k2.1k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• minio

  Public
  High Performance, Kubernetes Native Object Storage

  Go

  •

  GNU Affero General Public License v3.0

  •7.7k7.7k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• druid

  Public
  Apache Druid: a high performance real-time analytics database.

  Java

  •

  Apache License 2.0

  •3.8k3.8k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• sparkmagic

  Public
  Jupyter magics and kernels for working with remote Spark clusters

  Python

  •

  Other

  •443443 forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• bitnami-charts

  Public
  Bitnami Helm Charts

  Smarty

  •

  Other

  •10k10k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025

• bitnami-containers

  Public
  Bitnami container images

  Shell

  •

  Other

  •6.8k6.8k forks•00 stars•00 issues•00 pull requests•Updated Dec 24, 2025Dec 24, 2025