Open Project & Benchmarks

Open-source frameworks, tools, benchmarks, and datasets for LLM reasoning and AI agents, time-series intelligence, and science intelligence.

Systems Product

Open Project

LLMs and Agentic AI

Agent-R1
2025.04 CIKM 2026 GitHub Website Docs 1661
Agent-R1 is a unified, modular training framework for Agentic RL. It models each round of agent interaction as a step-level RL transition and decouples trajectory representation, context construction, environment interfaces, and optimization algorithms. This allows GRPO, PPO, and other algorithms to be compared and extended on a shared foundation for multi-turn agent training.
Claw-R1
Claw-R1 provides the Data Foundation for Agentic RL, enabling the systematic collection, evaluation, and curation of high-quality training data from diverse agent interactions. It introduces a middleware layer (Gateway + DataPool) between the Agent Side and the Training Side, focusing on data infrastructure rather than training algorithms themselves.

Time Series Intelligence(科语)

CastClaw(观星阁)
CastClaw(观星阁) is an agent framework for human–AI collaboration in time series forecasting research. It uses three specialized agents, Planner, Forecaster, and Critic, to orchestrate the complete forecasting workflow and incorporates human confirmation at key stages. It packages data analysis, feature engineering, and classical time series model capabilities into an extensible runtime toolbox.
CastMind(星思)
CastMind(星思) is a large model for time series projection in complex systems, driven by contextual reasoning. It integrates historical time series, external context, and domain knowledge and follows an extrapolate → understand → project → revise process for extended cognitive reasoning. Under specific conditions, it assesses whether future trends will persist, strengthen, weaken, shift, or reverse, enabling forecast revision and explanations of the underlying mechanisms.
CastFactory(炼星坊)
2026.05 GitHub Website 3
CastFactory(炼星坊) is an open-source framework for LLM-driven time series forecasting model training, designed to make it extremely easy for users to build and adapt TSF models with modern large-model pipelines. It provides a unified and practical workflow for continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL), helping researchers and practitioners develop, optimize, and evaluate LLM-based forecasting systems with much lower engineering overhead.

Science Intelligence(Scientific Tool and Knowledge)

PaperScout(科言乐问)
2026.01 EMNLP 2026 GitHub Website Paper 9
PaperScout is an autonomous scientific literature retrieval agent for complex research queries. It treats paper discovery as multi-turn decision-making, using accumulated retrieval context to choose between Search for new candidates and Expand for following paper references. With process-aware, sequence-level reinforcement learning (PSPO), it learns to refine its retrieval strategy from intermediate feedback and identify papers that match the research topic and query constraints.
Academic Search
2026.04 GitHub 616
Academic Search is a scientific literature retrieval and metadata skill for Codex, Claude Code, and other AI agents. It brings together sources including arXiv, Semantic Scholar, OpenAlex, Google Scholar, and CNKI, supporting query expansion, citation tracing, record validation, cross-source deduplication, and BibTeX export, as well as open-access full-text retrieval. It adapts search strategies to the discipline and records source provenance and access status to support literature reviews and research surveys.

Benchmarks & Datasets

Time Series Intelligence(科语)

Time Series Intelligence · Context-aware Forecasting
FutureCast(天星台)
2026.05 GitHub Website 2
FutureCast(天星台) is a multi-domain benchmark for context-aware time series forecasting. It pairs historical observations with numerical covariates, textual descriptions, and event context, and centers its evaluation design on context–sequence alignment, contextual reasoning, and adaptation to new evidence. Designed for time series foundation models and forecasting agents, it examines how external evidence informs trend judgments and forecast revision, with emphasis on forecast accuracy, reasoning quality, and evidence-based explanations.

Science Intelligence(Scientific Tool and Knowledge)

Scientific Literature · Agentic Evaluation
PaperArena Scientific Literature Mining Paper
PaperArena: An Evaluation Benchmark for Tool-Augmented Agentic Reasoning on Scientific Literature benchmarks agentic systems on scientific reading and reasoning with tool use. It targets literature understanding, tool-augmented reasoning, and evidence-grounded evaluation over scientific papers and related scholarly workflows.
AI for Science · Chemical Tables
ChemTable Scientific Literature Mining Paper
2025.06 KDD 2026 GitHub 8
Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables introduces ChemTable, a real-world benchmark curated from chemical literature. It supports two core tasks: table recognition and table understanding, with expert annotations over cell polygons, logical layouts, and chemistry-specific semantic labels such as reagents, catalysts, yields, and graphical components.

Retrieval & Recommendation

E-Commerce Search · Recall to Relevance
KuaiSearch Search-based Recommendation Paper
KuaiSearch: A Large-Scale E-Commerce Search Dataset for Recall, Ranking, and Relevance is built from real user search interactions on Kuaishou. It preserves authentic user queries and natural-language product texts, covers cold-start users and long-tail products, and spans the three key stages of modern search systems: recall, ranking, and relevance judgment.
RAG Evaluation · Dynamic Benchmark
HoH Retrieval-Augmented Generation Paper
2025.06 ACL 2025 GitHub 7
HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on RAG studies how retrieval-augmented generation systems fail when knowledge becomes stale. It provides a dynamic evaluation setting for measuring temporal robustness, outdated-information sensitivity, and the impact of knowledge freshness in modern RAG pipelines.