HUATUO is a cloud-native operating system observability project open-sourced by DIDI and incubated under the China Computer Federation (CCF). It combines Linux kernel dynamic tracing technologies—including kprobe, tracepoint, ftrace, and eBPF—to provide kernel-level observability for general-purpose computing, cloud-native systems, AI infrastructure, and bare-metal services.
Key features
- Kernel-wide insight: Observes Linux kernel subsystems such as memory management, CPU scheduling, networking, and block I/O with fine-grained data and low performance overhead.
- Instant observability: Captures kernel runtime context when slow-path events such as page faults and scheduling delays occur.
- AutoTracing: Retains automatic snapshots of intermittent performance jitter, helping diagnose CPU idle drops, system CPU spikes, I/O surges, and Load Average spikes.
- Continuous profiling: Continuously profiles CPU, memory, I/O, and locks across the operating system and applications to support performance, reliability, and high-availability engineering.
- Distributed tracing: Reconstructs system-call hierarchies and node relationships around network requests for end-to-end visibility into large-scale microservices.
Ecosystem integration
HUATUO integrates with established observability systems including Prometheus, Grafana, Pyroscope, and Elasticsearch, and automatically associates Kubernetes container labels and annotations. Its kernel-level eBPF instrumentation provides system insights without modifying application code.
Use cases
- Cloud Native
- AI Computing
- General Computing
- Cloud Computing
- Intelligent Sandbox
- Bare Metal Services
- Chaos Engineering
- Autonomous Driving
Get involved
See the HUATUO documentation for deployment, configuration, and development guidance. We welcome every form of participation, including filing issues, contributing code, and joining technical discussions. The main project is licensed under Apache License 2.0, while its BPF code uses the GPL.
GitHub
Submit issues and pull requests, contribute code, and join feature discussions.
github.com/ccfos/huatuoWeChat User Group
Add WeChat HAO022 with your name and organization to join the user group.
WeChat Official Account
Follow the HUATUO official account for project updates, technical articles, and community events.
