f6cb1485b1
- Introduced a comprehensive data collection framework, including `CollectorServiceConfig`, `BaseDataCollector`, and `CollectorManager`, enhancing modularity and maintainability. - Developed `CollectorFactory` for streamlined collector creation, promoting separation of concerns and improved configuration handling. - Enhanced `DataCollectionService` to utilize the new architecture, ensuring robust error handling and logging practices. - Added `TaskManager` for efficient management of asynchronous tasks, improving performance and resource management. - Implemented health monitoring and auto-recovery features in `CollectorManager`, ensuring reliable operation of data collectors. - Updated imports across the codebase to reflect the new structure, ensuring consistent access to components. These changes significantly improve the architecture and maintainability of the data collection service, aligning with project standards for modularity, performance, and error handling.
28 lines
871 B
Python
28 lines
871 B
Python
"""
|
|
Data collection and processing package for the Crypto Trading Bot Platform.
|
|
|
|
This package contains modules for collecting market data from various exchanges,
|
|
processing and validating the data, and storing it in the database.
|
|
"""
|
|
|
|
from .collector.base_collector import (
|
|
BaseDataCollector, DataCollectorError
|
|
)
|
|
from .collector.collector_state_telemetry import CollectorStatus
|
|
from .common.ohlcv_data import OHLCVData, DataValidationError
|
|
from .common.data_types import DataType, MarketDataPoint
|
|
from .collector.collector_manager import CollectorManager
|
|
from .collector.collector_types import ManagerStatus, CollectorConfig
|
|
|
|
__all__ = [
|
|
'BaseDataCollector',
|
|
'DataCollectorError',
|
|
'DataValidationError',
|
|
'DataType',
|
|
'CollectorStatus',
|
|
'MarketDataPoint',
|
|
'OHLCVData',
|
|
'CollectorManager',
|
|
'ManagerStatus',
|
|
'CollectorConfig'
|
|
] |