Arcana Real-time data, infinite loop.
An open-source Python library for real-time trading data ingestion. Currently processing live market data and historical backfill from the Coinbase API into structured feeds for automated trading algorithms.
Arcana is live and currently processing its first large batch of historical backfill and real-time market data, demonstrating production-grade data processing with consistency, error handling, and data quality at scale.
What it does
A data pipeline built to handle the hard parts of real-time market data processing.
Real-Time Ingestion
Connects to the Coinbase API to stream live trading data with minimal latency.
Data Processing
Transforms raw market data into structured, enriched feeds ready for algorithmic consumption.
Extensible Architecture
Designed so the community can extend support to additional centralized exchanges, and potentially DEXs.
Error Handling & Consistency
Built to showcase production-grade patterns for data quality, fault tolerance, and recovery.
Algorithm-Ready Output
Produces clean, consistent data structures that automated trading algorithms can consume directly.
Open Source
Full source available. Learn from it, extend it, or use it as a foundation for your own pipeline.
The story
Arcana was built to demonstrate what large-scale real-time data processing looks like when you take consistency and error handling seriously. The trading data domain is unforgiving. Data arrives fast, needs to be processed faster, and errors compound quickly.
The library connects to the Coinbase API as its primary data source, processing raw market data into more complex, enriched structures that automated trading algorithms can consume. The architecture is designed to be extended to additional centralized exchanges, and potentially even decentralized ones.
As an open-source project, Arcana is an invitation: here's how we think about data pipelines. Extend it, fork it, learn from it.
Language
Python
Data Source
Coinbase API
Focus Areas
Data quality, consistency, fault tolerance, real-time processing