Open Source Infrastructure

The fundamental package for scientific computing with Python. - GitHub - numpy/numpy: The fundamental package for scientific computing with Python.

Scala 2 compiler and standard library. For bugs, see scala/bug - GitHub - scala/scala: Scala 2 compiler and standard library. For bugs, see scala/bug

null

The Python programming language. Contribute to python/cpython development by creating an account on GitHub.

Python Stream Processing. Contribute to bytewax/bytewax development by creating an account on GitHub.

Next-Generation Real-Time Data Processing Platform - GitHub - memphisdev/memphis-broker: Next-Generation Real-Time Data Processing Platform

Build platforms that flexibly mix SQL, batch, and stream processing paradigms - GitHub - gazette/core: Build platforms that flexibly mix SQL, batch, and stream processing paradigms

🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, with Estuary Flow. 🌊 - GitHub - estuary/flow: 🌊 Continuously synchronize the systems where...

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ. - GitHub - debezium/debezium: Change data capture for a variety of databases. Please log i...

Apache NiFi. Contribute to apache/nifi development by creating an account on GitHub.

Mirror of Apache Samza. Contribute to apache/samza development by creating an account on GitHub.

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications. - GitHub - apache/rocketmq: Apache RocketMQ is a cloud native messaging and ...

Open source RabbitMQ: core server and tier 1 (built-in) plugins - GitHub - rabbitmq/rabbitmq-server: Open source RabbitMQ: core server and tier 1 (built-in) plugins

Mirror of Apache Storm. Contribute to apache/storm development by creating an account on GitHub.

Apache Flink. Contribute to apache/flink development by creating an account on GitHub.

Apache Pulsar - distributed pub-sub messaging system - GitHub - apache/pulsar: Apache Pulsar - distributed pub-sub messaging system

Apache Beam is a unified programming model for Batch and Streaming data processing. - GitHub - apache/beam: Apache Beam is a unified programming model for Batch and Streaming data processing.

Mirror of Apache Kafka. Contribute to apache/kafka development by creating an account on GitHub.

Spark Streaming programming guide and tutorial for Spark 3.3.1

Nessie: Transactional Catalog for Data Lakes with Git-like semantics - GitHub - projectnessie/nessie: Nessie: Transactional Catalog for Data Lakes with Git-like semantics

lakeFS - Data version control for your data lake | Git for data - GitHub - treeverse/lakeFS: lakeFS - Data version control for your data lake | Git for data

An Open Standard for lineage metadata collection. Contribute to OpenLineage/OpenLineage development by creating an account on GitHub.

Always know what to expect from your data. Contribute to great-expectations/great_expectations development by creating an account on GitHub.

Collect, aggregate, and visualize a data ecosystem's metadata - GitHub - MarquezProject/marquez: Collect, aggregate, and visualize a data ecosystem's metadata

Apache Mesos. Contribute to apache/mesos development by creating an account on GitHub.

Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters. - GitHub - apache/ambari: Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop...

Apache ZooKeeper. Contribute to apache/zookeeper development by creating an account on GitHub.

Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines. - GitHub - kestra-io/kestra: Kestra is an infini...

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data. - GitHub - mage-ai/mage-ai: 🧙 The modern replacement for Airflow. Build, run, and ...

Workflow engine for Kubernetes. Contribute to argoproj/argo-workflows development by creating an account on GitHub.