Skip to content
@DataSysResearch

DataSys

Open-source data systems for continuously evolving data: streams, graphs, vectors, indexes, and benchmarks.

DataSys

DataSys builds open-source data management and processing systems for continuously evolving data.

Our work spans stream processing, dynamic graph systems, vector search and indexing, online data maintenance, and reproducible data-system benchmarks.

Website: datasys.sage.org.ai

Ecosystem

  • IntelliStream incubates early research ideas.
  • DataSys develops framework-neutral data systems and benchmarks.
  • SAGE uses these capabilities in agent, RAG, workflow, and service orchestration.
  • vLLM-HUST develops model execution, scheduling, and hardware acceleration.

Projects

Stream Processing

  • MorphStream - transactional stream-processing engine for ACID transactions over streaming data.
  • BriskFlow - vector-native stream processing engine for join-backed semantic windows and continuously evolving data.

Achievements

  • Complete publication timeline - papers, demos, authors, DOI records, official acceptance evidence, and corresponding DataSys repositories.
  • CANDOR-Bench - SIGMOD 2026 continuous ANNS benchmark for dynamic open-world streams.
  • StreamFP - WWW 2026 fingerprint-guided data selection for efficient stream learning.
  • GRACE - accepted ICDE 2026 work on reconstruction cost in dynamic graph processing.
  • BriskSnapshot - join-backed semantic windows demonstration reported by its authors as accepted to the ICPP 2026 demo track; the public conference record is pending.

Dynamic Graphs

  • GRACE - dynamic graph processing for continuously evolving graph data.

Vector Search and ANNS

  • CANDOR-Bench - continuous ANNS evaluation under dynamic, open-world streams.
  • vasg - DataSys-maintained VSAG derivative used by CANDOR-Bench for reproducible vector-index evaluation.

Streaming Data Analysis

  • Sesame - data-stream clustering system and benchmark.

Approximate Computing

  • AMM-Algorithms - framework-neutral C++ implementations of approximate matrix multiplication algorithms with Python bindings.
  • LibAMM - reproducible benchmark suite for approximate matrix multiplication systems.

Supporting Systems

Benchmarks and Research Resources

ANNS Baseline Forks

These repositories preserve upstream algorithms and benchmark baselines used in DataSys evaluation. DataSys ownership does not replace or imply authorship of the upstream projects.

  • Parlay-HNSW - ParlayANN-derived HNSW concurrency baseline.
  • Concurrent-HNSW - concurrent HNSW evaluation baseline in the hnswlib fork network.
  • hnswlib - pinned hnswlib baseline snapshot.
  • cufe - DiskANN-network research fork used by CANDOR-Bench.
  • IP-DiskANN - pinned CANDOR-Bench IP-DiskANN baseline.
  • big-ann-benchmarks - billion-scale ANNS benchmark fork.

Project Graduation

Projects graduate from IntelliStream when they have a clear public abstraction, named maintainers, reproducible evaluation, documentation, tests, licensing, and a sustainable release path.

DataSys is not a catch-all state-management umbrella. It owns framework-neutral data systems, indexes, benchmarks, and data lifecycle infrastructure.

See our contribution guide, security policy, and support guide.

Popular repositories Loading

  1. MorphStream MorphStream Public

    This project aims at building a scalable transactional stream processing engine on modern hardware. It allows ACID transactions to be run directly on streaming data. It shares similar project visio…

    C 143 8

  2. StreamProcessing_ReadingList StreamProcessing_ReadingList Public

    stream processing reading list

    69 10

  3. Sesame Sesame Public

    [SIGMOD'23] Data Stream Clustering: An In-depth Empirical Study [ICDM'24] MOStream: A Modular and Self-Optimizing Data Stream Clustering Algorithm

    C++ 26 7

  4. AllianceDB AllianceDB Public

    Adaptive stream-processing research system for workload-aware window joins and execution.

    C++ 16 8

  5. SentiStream SentiStream Public

    Co-training framework for adaptive online sentiment analysis over evolving data streams.

    Python 7 6

  6. LibAMM LibAMM Public

    Benchmark suite for reproducible evaluation of approximate matrix multiplication algorithms.

    Python 6

Repositories

Showing 10 of 27 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…