commit
45653bb6e4
@ -0,0 +1,33 @@
|
||||
# 应用配置
|
||||
DEBUG=false
|
||||
APP_NAME=期货股票数据统一平台
|
||||
APP_VERSION=1.0.0
|
||||
|
||||
# 安全配置
|
||||
SECRET_KEY=your-secret-key-change-in-production
|
||||
ALGORITHM=HS256
|
||||
ACCESS_TOKEN_EXPIRE_MINUTES=60
|
||||
REFRESH_TOKEN_EXPIRE_DAYS=7
|
||||
|
||||
# 数据库配置
|
||||
TIMESCALE_DB_URL=postgresql://postgres:postgres@timescaledb:5432/kline_data
|
||||
SQLITE_DB_PATH=/app/data/config.db
|
||||
|
||||
# Redis 配置
|
||||
REDIS_URL=redis://redis:6379/0
|
||||
REDIS_HOST=redis
|
||||
REDIS_PORT=6379
|
||||
|
||||
# amazingData SDK 配置 (可选)
|
||||
AMAZING_DATA_API_KEY=
|
||||
AMAZING_DATA_SECRET=
|
||||
AMAZING_DATA_ENV=simulation
|
||||
|
||||
# 日志配置
|
||||
LOG_LEVEL=INFO
|
||||
|
||||
# 限流配置
|
||||
RATE_LIMIT_PER_MINUTE=60
|
||||
|
||||
# WebSocket 配置
|
||||
WS_HEARTBEAT_INTERVAL=30
|
||||
@ -0,0 +1,78 @@
|
||||
# Python
|
||||
__pycache__/
|
||||
*.py[cod]
|
||||
*$py.class
|
||||
*.so
|
||||
.Python
|
||||
env/
|
||||
venv/
|
||||
.venv/
|
||||
ENV/
|
||||
build/
|
||||
develop-eggs/
|
||||
dist/
|
||||
downloads/
|
||||
eggs/
|
||||
.eggs/
|
||||
lib/
|
||||
lib64/
|
||||
parts/
|
||||
sdist/
|
||||
var/
|
||||
wheels/
|
||||
*.egg-info/
|
||||
.installed.cfg
|
||||
*.egg
|
||||
|
||||
# IDE
|
||||
.idea/
|
||||
.vscode/
|
||||
*.swp
|
||||
*.swo
|
||||
*~
|
||||
|
||||
# Environment
|
||||
.env
|
||||
.env.local
|
||||
.env.*.local
|
||||
|
||||
# Database
|
||||
*.db
|
||||
*.sqlite
|
||||
*.sqlite3
|
||||
data/
|
||||
|
||||
# Logs
|
||||
*.log
|
||||
logs/
|
||||
|
||||
# Testing
|
||||
.pytest_cache/
|
||||
.coverage
|
||||
htmlcov/
|
||||
.tox/
|
||||
.nox/
|
||||
|
||||
# Node
|
||||
node_modules/
|
||||
npm-debug.log*
|
||||
yarn-debug.log*
|
||||
yarn-error.log*
|
||||
pnpm-debug.log*
|
||||
|
||||
# Frontend build
|
||||
dist/
|
||||
dist-ssr/
|
||||
*.local
|
||||
|
||||
# Editor
|
||||
.DS_Store
|
||||
*.pem
|
||||
|
||||
# Docker
|
||||
docker-compose.override.yml
|
||||
|
||||
# Temporary files
|
||||
tmp/
|
||||
temp/
|
||||
*.tmp
|
||||
@ -0,0 +1,144 @@
|
||||
# amazingData SDK 集成任务
|
||||
|
||||
**项目**: 期货股票数据统一平台 (20260330_kline_system)
|
||||
**创建时间**: 2026-04-03
|
||||
**协调者**: coordinator
|
||||
**优先级**: 🔴 高
|
||||
|
||||
---
|
||||
|
||||
## 📋 任务概述
|
||||
|
||||
将银河证券星耀数智量化平台 SDK (amazingData) 集成到项目中，实现真实的期货/股票数据接入。
|
||||
|
||||
---
|
||||
|
||||
## 🔐 账号配置信息
|
||||
|
||||
| 配置项 | 值 |
|
||||
|--------|-----|
|
||||
| 账号 | 11200008169 |
|
||||
| 密码 | 11200008169@2026 |
|
||||
| Host | 140.206.44.234 |
|
||||
| 端口 | 8600 |
|
||||
| 环境 | production |
|
||||
|
||||
**配置文件已更新**:
|
||||
- `.env` - 环境变量
|
||||
- `backend/app/config.py` - 应用配置
|
||||
|
||||
---
|
||||
|
||||
## 📁 SDK 位置
|
||||
|
||||
**SDK 目录**: `/app/share_data/xysz/`
|
||||
|
||||
**核心文件**:
|
||||
- `AmazingData/` - SDK 主目录
|
||||
- `amazing_data_adapter.py` - 数据适配器封装
|
||||
- `amazing_data_examples.py` - 使用示例
|
||||
- `tgw-1.0.8.5-py3-none-any.whl` - SDK wheel 包
|
||||
|
||||
**参考文档**:
|
||||
- `AmazingData_SDK 接口调用说明.md`
|
||||
- `AmazingData 开发手册.md`
|
||||
- `接口文档.md`
|
||||
|
||||
---
|
||||
|
||||
## ✅ 集成任务清单
|
||||
|
||||
### 1. SDK 安装与导入
|
||||
- [ ] 安装 SDK: `pip install /app/share_data/xysz/tgw-1.0.8.5-py3-none-any.whl`
|
||||
- [ ] 复制 adapter 到项目：`backend/app/services/amazing_data_adapter.py`
|
||||
- [ ] 更新 requirements.txt
|
||||
|
||||
### 2. 数据服务层开发
|
||||
- [ ] 创建 `backend/app/services/amazing_data_service.py`
|
||||
- [ ] 登录/登出管理（⚠️ 必须调用 logout 避免连接数超限）
|
||||
- [ ] K 线数据获取（股票/期货）
|
||||
- [ ] 实时行情订阅
|
||||
- [ ] 交易日历查询
|
||||
- [ ] 证券代码列表
|
||||
|
||||
### 3. API 接口对接
|
||||
- [ ] 更新 `backend/app/api/kline.py` - 接入真实数据源
|
||||
- [ ] 更新 `backend/app/api/realtime.py` - 接入实时行情
|
||||
- [ ] 新增 `backend/app/api/market.py` - 市场数据接口
|
||||
|
||||
### 4. 数据同步任务
|
||||
- [ ] 创建 `backend/app/tasks/sync_kline_data.py`
|
||||
- [ ] 定时同步 K 线数据
|
||||
- [ ] 缓存到 TimescaleDB
|
||||
- [ ] 错误重试机制
|
||||
|
||||
### 5. 前端对接
|
||||
- [ ] 更新前端 API 调用
|
||||
- [ ] 测试真实数据显示
|
||||
|
||||
### 6. 测试与验证
|
||||
- [ ] 单元测试
|
||||
- [ ] 连接测试
|
||||
- [ ] 数据准确性验证
|
||||
|
||||
---
|
||||
|
||||
## 🔧 SDK 使用示例
|
||||
|
||||
```python
|
||||
from AmazingData import login, logout, BaseData, MarketData
|
||||
|
||||
# 登录
|
||||
ret = login(
|
||||
username='11200008169',
|
||||
password='11200008169@2026',
|
||||
host='140.206.44.234',
|
||||
port=8600
|
||||
)
|
||||
|
||||
if ret:
|
||||
# 获取数据
|
||||
base = BaseData()
|
||||
codes = base.get_code_list('EXTRA_FUTURE') # 期货代码列表
|
||||
|
||||
# 获取 K 线数据
|
||||
market = MarketData()
|
||||
kline = market.get_kline_data(
|
||||
code_list=['AG2605.SHF'],
|
||||
period='min5',
|
||||
start_time=20260326090000,
|
||||
end_time=20260326150000
|
||||
)
|
||||
|
||||
# ⚠️ 重要：必须登出
|
||||
logout('11200008169')
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## ⚠️ 注意事项
|
||||
|
||||
1. **必须调用 logout()** - 否则会导致 -98 连接数超限错误
|
||||
2. **连接管理** - 使用连接池或单例模式管理连接
|
||||
3. **错误处理** - 处理网络异常、登录失败等情况
|
||||
4. **数据缓存** - 建议缓存到 TimescaleDB 减少 API 调用
|
||||
5. **限流** - 注意 API 调用频率限制
|
||||
|
||||
---
|
||||
|
||||
## 📊 验收标准
|
||||
|
||||
- [ ] SDK 正常登录/登出
|
||||
- [ ] K 线数据可正常获取
|
||||
- [ ] 实时行情可正常订阅
|
||||
- [ ] 数据存入 TimescaleDB
|
||||
- [ ] 前端可显示真实数据
|
||||
- [ ] 单元测试通过率 100%
|
||||
|
||||
---
|
||||
|
||||
## 📝 完成后的操作
|
||||
|
||||
1. 更新此文件，标记完成状态
|
||||
2. 通知协调者进行验证测试
|
||||
3. 更新项目文档
|
||||
@ -0,0 +1,97 @@
|
||||
# Bug 修复任务清单
|
||||
|
||||
**项目**: 期货股票数据统一平台 (20260330_kline_system)
|
||||
**创建时间**: 2026-04-02
|
||||
**来源**: 系统测试阶段
|
||||
**协调者**: coordinator
|
||||
|
||||
---
|
||||
|
||||
## P0 严重 Bug (必须修复)
|
||||
|
||||
### BUG-001: 密码加密算法安全升级
|
||||
- **模块**: 认证模块 (auth)
|
||||
- **问题**: 当前使用 MD5 加密密码，存在安全风险
|
||||
- **要求**: 升级到 bcrypt 或 argon2 加密算法
|
||||
- **影响**: 用户密码安全性
|
||||
- **优先级**: 🔴 P0
|
||||
|
||||
---
|
||||
|
||||
## P1 重要 Bug (优先修复)
|
||||
|
||||
### BUG-002: K 线数据边界验证缺失
|
||||
- **模块**: K 线数据 (kline)
|
||||
- **问题**: startTime > endTime 时未返回错误
|
||||
- **要求**: 添加时间范围验证，返回 400 错误
|
||||
- **优先级**: 🟠 P1
|
||||
|
||||
### BUG-003: WebSocket 限流缺失
|
||||
- **模块**: 实时行情 (realtime)
|
||||
- **问题**: 未限制单用户 WebSocket 连接数
|
||||
- **要求**: 添加限流机制（如每用户最多 5 个连接）
|
||||
- **优先级**: 🟠 P1
|
||||
|
||||
### BUG-004: 告警状态未更新
|
||||
- **模块**: 告警模块 (alert)
|
||||
- **问题**: 触发告警后 status 未更新为 triggered
|
||||
- **要求**: 触发后自动更新状态
|
||||
- **优先级**: 🟠 P1
|
||||
|
||||
### BUG-005: 重复订阅检查缺失
|
||||
- **模块**: 订阅模块 (subscription)
|
||||
- **问题**: 允许重复订阅同一品种
|
||||
- **要求**: 添加重复检查，返回提示或合并
|
||||
- **优先级**: 🟠 P1
|
||||
|
||||
---
|
||||
|
||||
## P2 一般 Bug (建议修复)
|
||||
|
||||
### BUG-006: 前端加载提示缺失
|
||||
- **模块**: 前端页面
|
||||
- **问题**: 数据加载时缺少 loading 提示
|
||||
- **要求**: 添加 loading 状态显示
|
||||
- **优先级**: 🟡 P2
|
||||
|
||||
### BUG-007: WebSocket 断线重连提示
|
||||
- **模块**: 前端页面
|
||||
- **问题**: 断线重连时用户无感知
|
||||
- **要求**: 添加重连状态提示
|
||||
- **优先级**: 🟡 P2
|
||||
|
||||
### BUG-008: 分页组件功能完善
|
||||
- **模块**: 前端页面
|
||||
- **问题**: 分页组件缺少页码跳转功能
|
||||
- **要求**: 添加页码输入跳转
|
||||
- **优先级**: 🟡 P2
|
||||
|
||||
### BUG-009: API 文档补充
|
||||
- **模块**: 文档
|
||||
- **问题**: API 文档缺少响应示例
|
||||
- **要求**: 补充各接口响应示例
|
||||
- **优先级**: 🟡 P2
|
||||
|
||||
---
|
||||
|
||||
## 修复完成后
|
||||
|
||||
1. 更新此文件，标记每个 Bug 的修复状态
|
||||
2. 通知协调者 (coordinator) 进行回归测试
|
||||
3. 确保单元测试覆盖新增/修改的代码
|
||||
|
||||
---
|
||||
|
||||
## 修复状态跟踪
|
||||
|
||||
| Bug ID | 状态 | 修复人 | 修复时间 | 验证结果 |
|
||||
|--------|------|--------|----------|----------|
|
||||
| BUG-001 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-002 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-003 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-004 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-005 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-006 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-007 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-008 | ⏳ 待修复 | - | - | - |
|
||||
| BUG-009 | ⏳ 待修复 | - | - | - |
|
||||
@ -0,0 +1,141 @@
|
||||
# 金融数据中台 v2.1 - Bug 修复任务单
|
||||
|
||||
**优先级**: 🔴 P0 - 紧急阻塞
|
||||
**创建时间**: 2026-04-05 12:50
|
||||
**要求完成**: 2026-04-05 14:00 (1 小时内)
|
||||
|
||||
---
|
||||
|
||||
## 🐛 阻塞性 Bug 列表
|
||||
|
||||
### Bug #001: Python 模块路径配置问题 🔴
|
||||
|
||||
**影响**: 8 个测试用例导入失败，阻塞测试进度
|
||||
**现象**: 测试脚本无法导入 backend 模块
|
||||
**错误信息**: `No module named 'backend'`
|
||||
|
||||
**修复方案**:
|
||||
1. 检查 `backend/app/__init__.py` 是否存在
|
||||
2. 在测试脚本中修正导入路径
|
||||
3. 或者设置环境变量 PYTHONPATH
|
||||
|
||||
**涉及文件**:
|
||||
- `/app/working/workspaces/tester/tests/run_v2_1_tests.py`
|
||||
- `/app/working/workspaces/developer/projects/20260330_kline_system/backend/app/__init__.py`
|
||||
|
||||
**验收标准**:
|
||||
- [ ] 测试脚本可以成功导入所有模块
|
||||
- [ ] 以下测试通过：
|
||||
- TC-WS-002: 有效 Token 认证
|
||||
- TC-WS-031: 心跳机制
|
||||
- TC-AL-001: 创建告警规则
|
||||
- TC-AL-011: 告警引擎计算
|
||||
- TC-AL-031: 通知服务
|
||||
- TC-QM-001: 质量监控服务
|
||||
- TC-QM-011: 完整性检测
|
||||
- TC-QM-021: 准确性检测
|
||||
|
||||
---
|
||||
|
||||
### Bug #002: 后端服务启动配置 🔴
|
||||
|
||||
**影响**: WebSocket 连接测试失败
|
||||
**现象**: 端口 8000 未开放，连接测试失败
|
||||
**错误**: `TC-WS-001: 基本连接测试 FAIL`
|
||||
|
||||
**修复方案**:
|
||||
1. 检查 `backend/app/main_v2_1.py` 入口文件
|
||||
2. 创建启动脚本 `start_server.sh`
|
||||
3. 确保服务可以正常启动并监听 8000 端口
|
||||
|
||||
**启动命令**:
|
||||
```bash
|
||||
cd /app/working/workspaces/developer/projects/20260330_kline_system/backend
|
||||
uvicorn app.main:app --host 0.0.0.0 --port 8000 --reload
|
||||
```
|
||||
|
||||
**验收标准**:
|
||||
- [ ] 后端服务可以正常启动
|
||||
- [ ] 端口 8000 可访问
|
||||
- [ ] TC-WS-001: 基本连接测试通过
|
||||
|
||||
---
|
||||
|
||||
### Bug #003: 配置文件路径问题 🟡
|
||||
|
||||
**影响**: 配置加载测试失败
|
||||
**现象**: `TC-IN-002: 配置加载 FAIL`
|
||||
|
||||
**修复方案**:
|
||||
1. 检查 `backend/app/core/config.py` 位置
|
||||
2. 确保配置文件路径正确
|
||||
3. 更新测试脚本中的路径引用
|
||||
|
||||
**验收标准**:
|
||||
- [ ] TC-IN-002: 配置加载测试通过
|
||||
|
||||
---
|
||||
|
||||
## 📝 修复步骤
|
||||
|
||||
### 步骤 1: 创建/检查 __init__.py 文件
|
||||
```bash
|
||||
# 确保以下文件存在
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/__init__.py
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/websocket/__init__.py
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/services/__init__.py
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/api/__init__.py
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/api/v2/__init__.py
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/models/__init__.py
|
||||
touch /app/working/workspaces/developer/projects/20260330_kline_system/backend/app/db/__init__.py
|
||||
```
|
||||
|
||||
### 步骤 2: 修复测试脚本导入路径
|
||||
修改 `/app/working/workspaces/tester/tests/run_v2_1_tests.py`:
|
||||
```python
|
||||
# 使用绝对导入而非相对导入
|
||||
import sys
|
||||
from pathlib import Path
|
||||
|
||||
# 添加正确的路径
|
||||
backend_path = Path('/app/working/workspaces/developer/projects/20260330_kline_system/backend/app')
|
||||
sys.path.insert(0, str(backend_path))
|
||||
|
||||
# 然后导入模块
|
||||
from websocket.connection_manager import ConnectionManager
|
||||
from services.alert_engine import AlertEngine
|
||||
from services.quality_monitor import QualityMonitor
|
||||
```
|
||||
|
||||
### 步骤 3: 创建启动脚本
|
||||
创建 `/app/working/workspaces/developer/projects/20260330_kline_system/backend/start_server.sh`:
|
||||
```bash
|
||||
#!/bin/bash
|
||||
cd "$(dirname "$0")"
|
||||
export PYTHONPATH="$(pwd)/app:$PYTHONPATH"
|
||||
uvicorn app.main:app --host 0.0.0.0 --port 8000 --reload
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## ✅ 完成标准
|
||||
|
||||
1. 所有 __init__.py 文件创建完成
|
||||
2. 测试脚本路径问题修复
|
||||
3. 后端服务可以启动
|
||||
4. 重新运行测试，通过率 >= 90%
|
||||
|
||||
---
|
||||
|
||||
## 📢 完成后通知
|
||||
|
||||
修复完成后，请通知：
|
||||
1. Agent Coordinator - 更新项目状态
|
||||
2. Agent Tester - 继续执行测试
|
||||
|
||||
---
|
||||
|
||||
**任务创建人**: Agent Coordinator
|
||||
**创建时间**: 2026-04-05 12:50
|
||||
**任务状态**: ⏳ 待执行
|
||||
**优先级**: 🔴 P0 - 紧急
|
||||
@ -0,0 +1,419 @@
|
||||
# 金融数据中台 - Phase 1 开发任务
|
||||
|
||||
**项目**: 20260330_kline_system
|
||||
**版本**: v2.0
|
||||
**日期**: 2026-04-03
|
||||
**优先级**: 🔴 高
|
||||
|
||||
---
|
||||
|
||||
## 📋 Phase 1 开发任务清单
|
||||
|
||||
### 1. 数据库 Schema 更新
|
||||
|
||||
#### 1.1 TimescaleDB - K 线数据表
|
||||
**文件**: `backend/db/migrations/002_create_kline_data.sql`
|
||||
|
||||
```sql
|
||||
-- K 线数据表
|
||||
CREATE TABLE IF NOT EXISTS kline_data (
|
||||
time TIMESTAMPTZ NOT NULL,
|
||||
symbol VARCHAR(20) NOT NULL,
|
||||
security_type VARCHAR(20) NOT NULL,
|
||||
period VARCHAR(10) NOT NULL,
|
||||
open DECIMAL(20, 4) NOT NULL,
|
||||
high DECIMAL(20, 4) NOT NULL,
|
||||
low DECIMAL(20, 4) NOT NULL,
|
||||
close DECIMAL(20, 4) NOT NULL,
|
||||
volume BIGINT,
|
||||
turnover DECIMAL(20, 4),
|
||||
open_interest BIGINT,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
);
|
||||
|
||||
-- 创建 hypertable
|
||||
SELECT create_hypertable('kline_data', 'time', if_not_exists => TRUE);
|
||||
|
||||
-- 创建索引
|
||||
CREATE INDEX IF NOT EXISTS idx_kline_symbol_period
|
||||
ON kline_data (symbol, period, time DESC);
|
||||
```
|
||||
|
||||
#### 1.2 SQLite - 配置表
|
||||
**文件**: `backend/db/migrations/003_create_config_tables.sql`
|
||||
|
||||
```sql
|
||||
-- 同步配置表
|
||||
CREATE TABLE IF NOT EXISTS sync_config (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
config_key VARCHAR(50) UNIQUE NOT NULL,
|
||||
config_value TEXT NOT NULL,
|
||||
description TEXT,
|
||||
updated_at DATETIME DEFAULT CURRENT_TIMESTAMP
|
||||
);
|
||||
|
||||
-- 同步日志表
|
||||
CREATE TABLE IF NOT EXISTS sync_log (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
sync_type VARCHAR(20) NOT NULL,
|
||||
symbol VARCHAR(20),
|
||||
period VARCHAR(10),
|
||||
start_time DATETIME,
|
||||
end_time DATETIME,
|
||||
records_count INTEGER,
|
||||
status VARCHAR(20) NOT NULL,
|
||||
error_message TEXT,
|
||||
created_at DATETIME DEFAULT CURRENT_TIMESTAMP
|
||||
);
|
||||
|
||||
-- API 调用日志表
|
||||
CREATE TABLE IF NOT EXISTS api_log (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
endpoint VARCHAR(50) NOT NULL,
|
||||
symbol VARCHAR(20),
|
||||
period VARCHAR(10),
|
||||
cache_hit BOOLEAN,
|
||||
response_time_ms INTEGER,
|
||||
client_ip VARCHAR(50),
|
||||
created_at DATETIME DEFAULT CURRENT_TIMESTAMP
|
||||
);
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 2. 实现 CacheService
|
||||
|
||||
**文件**: `backend/app/services/cache_service.py`
|
||||
|
||||
```python
|
||||
"""
|
||||
K 线数据缓存服务
|
||||
"""
|
||||
from datetime import datetime, timedelta
|
||||
from typing import List, Optional
|
||||
from sqlalchemy.orm import Session
|
||||
from app.models.kline import KlineData
|
||||
from app.db.init_db import get_timescale_db
|
||||
|
||||
class CacheService:
|
||||
"""K 线数据缓存服务"""
|
||||
|
||||
def __init__(self, db_session: Session):
|
||||
self.db = db_session
|
||||
|
||||
def get_kline(
|
||||
self,
|
||||
symbol: str,
|
||||
period: str,
|
||||
start_time: datetime,
|
||||
end_time: datetime,
|
||||
security_type: str = "STOCK_A"
|
||||
) -> Optional[List[KlineData]]:
|
||||
"""从缓存获取 K 线数据"""
|
||||
pass
|
||||
|
||||
def set_kline(
|
||||
self,
|
||||
symbol: str,
|
||||
period: str,
|
||||
data: List[KlineData],
|
||||
security_type: str = "STOCK_A"
|
||||
) -> bool:
|
||||
"""写入 K 线数据到缓存"""
|
||||
pass
|
||||
|
||||
def clear_cache(
|
||||
self,
|
||||
symbol: str,
|
||||
period: str,
|
||||
security_type: str = "STOCK_A"
|
||||
) -> bool:
|
||||
"""清除指定缓存"""
|
||||
pass
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 3. 实现 SyncService
|
||||
|
||||
**文件**: `backend/app/services/sync_service.py`
|
||||
|
||||
```python
|
||||
"""
|
||||
定时同步服务
|
||||
"""
|
||||
from datetime import datetime
|
||||
from typing import List, Dict
|
||||
from app.services.cache_service import CacheService
|
||||
from app.services.amazing_data_service import amazing_data_service
|
||||
from app.db.init_db import get_sqlite_db, get_timescale_db
|
||||
|
||||
class SyncService:
|
||||
"""定时同步服务"""
|
||||
|
||||
def __init__(self):
|
||||
self.sqlite_db = get_sqlite_db()
|
||||
self.timescale_db = get_timescale_db()
|
||||
self.cache_service = CacheService(self.timescale_db)
|
||||
|
||||
def sync_symbol(
|
||||
self,
|
||||
symbol: str,
|
||||
security_type: str,
|
||||
periods: List[str],
|
||||
start_date: str,
|
||||
end_date: str
|
||||
) -> Dict:
|
||||
"""同步单个品种数据"""
|
||||
pass
|
||||
|
||||
def sync_all(self) -> List[Dict]:
|
||||
"""同步所有配置品种"""
|
||||
pass
|
||||
|
||||
def get_sync_config(self) -> Dict:
|
||||
"""获取同步配置"""
|
||||
pass
|
||||
|
||||
def update_sync_config(self, config: Dict) -> bool:
|
||||
"""更新同步配置"""
|
||||
pass
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 4. 更新 KlineService
|
||||
|
||||
**文件**: `backend/app/services/kline_service_v2.py`
|
||||
|
||||
```python
|
||||
"""
|
||||
K 线数据服务 v2 (缓存优先策略)
|
||||
"""
|
||||
from datetime import datetime
|
||||
from typing import List, Optional
|
||||
from app.services.cache_service import CacheService
|
||||
from app.services.amazing_data_service import amazing_data_service
|
||||
|
||||
class KlineServiceV2:
|
||||
"""K 线数据服务 v2"""
|
||||
|
||||
def __init__(self):
|
||||
self.timescale_db = get_timescale_db()
|
||||
self.cache_service = CacheService(self.timescale_db)
|
||||
|
||||
def get_kline_data(
|
||||
self,
|
||||
symbol: str,
|
||||
period: str,
|
||||
start_time: datetime,
|
||||
end_time: datetime,
|
||||
security_type: str = "STOCK_A"
|
||||
) -> List[Dict]:
|
||||
"""
|
||||
获取 K 线数据（缓存优先）
|
||||
|
||||
流程:
|
||||
1. 查询缓存
|
||||
2. 缓存命中则返回
|
||||
3. 缓存未命中则调用 amazingData 获取并缓存
|
||||
4. 返回数据
|
||||
"""
|
||||
pass
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 5. 实现定时任务调度
|
||||
|
||||
**文件**: `backend/app/tasks/sync_scheduler.py`
|
||||
|
||||
```python
|
||||
"""
|
||||
定时同步任务调度器
|
||||
"""
|
||||
from apscheduler.schedulers.background import BackgroundScheduler
|
||||
from apscheduler.triggers.cron import CronTrigger
|
||||
from app.services.sync_service import SyncService
|
||||
|
||||
scheduler = BackgroundScheduler()
|
||||
|
||||
def init_scheduler():
|
||||
"""初始化调度器"""
|
||||
sync_service = SyncService()
|
||||
|
||||
# 从配置读取同步时间
|
||||
config = sync_service.get_sync_config()
|
||||
hour, minute = config['sync_time'].split(':')
|
||||
|
||||
# 添加定时任务
|
||||
scheduler.add_job(
|
||||
func=sync_service.sync_all,
|
||||
trigger=CronTrigger(hour=hour, minute=minute, day_of_week='1-5'),
|
||||
id='daily_sync',
|
||||
name='每日数据同步',
|
||||
replace_existing=True
|
||||
)
|
||||
|
||||
scheduler.start()
|
||||
|
||||
def shutdown_scheduler():
|
||||
"""关闭调度器"""
|
||||
scheduler.shutdown()
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 6. 更新 API 接口
|
||||
|
||||
**文件**: `backend/app/api/v2/kline.py`
|
||||
|
||||
```python
|
||||
"""
|
||||
K 线数据 API v2
|
||||
"""
|
||||
from fastapi import APIRouter, Query
|
||||
from datetime import datetime
|
||||
from app.services.kline_service_v2 import KlineServiceV2
|
||||
|
||||
router = APIRouter(prefix="/api/v2", tags=["K 线数据 V2"])
|
||||
|
||||
@router.get("/kline")
|
||||
async def get_kline(
|
||||
symbol: str = Query(..., description="证券代码"),
|
||||
period: str = Query(..., description="周期"),
|
||||
start: datetime = Query(..., description="开始时间"),
|
||||
end: datetime = Query(..., description="结束时间")
|
||||
):
|
||||
"""获取 K 线数据（缓存优先）"""
|
||||
pass
|
||||
|
||||
@router.get("/kline/cache-stats")
|
||||
async def get_cache_stats():
|
||||
"""获取缓存统计信息"""
|
||||
pass
|
||||
```
|
||||
|
||||
**文件**: `backend/app/api/v2/sync.py`
|
||||
|
||||
```python
|
||||
"""
|
||||
同步管理 API v2
|
||||
"""
|
||||
from fastapi import APIRouter
|
||||
from app.services.sync_service import SyncService
|
||||
|
||||
router = APIRouter(prefix="/api/v2", tags=["同步管理 V2"])
|
||||
|
||||
@router.post("/sync/trigger")
|
||||
async def trigger_sync():
|
||||
"""手动触发同步"""
|
||||
pass
|
||||
|
||||
@router.get("/sync/config")
|
||||
async def get_sync_config():
|
||||
"""获取同步配置"""
|
||||
pass
|
||||
|
||||
@router.put("/sync/config")
|
||||
async def update_sync_config(config: dict):
|
||||
"""更新同步配置"""
|
||||
pass
|
||||
|
||||
@router.get("/sync/logs")
|
||||
async def get_sync_logs(limit: int = 50):
|
||||
"""获取同步日志"""
|
||||
pass
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 7. 更新主应用
|
||||
|
||||
**文件**: `backend/app/main.py`
|
||||
|
||||
```python
|
||||
# 添加 v2 路由
|
||||
from app.api.v2.kline import router as kline_v2_router
|
||||
from app.api.v2.sync import router as sync_v2_router
|
||||
from app.tasks.sync_scheduler import init_scheduler, shutdown_scheduler
|
||||
|
||||
@asynccontextmanager
|
||||
async def lifespan(app: FastAPI):
|
||||
# 启动时初始化
|
||||
init_databases()
|
||||
init_scheduler() # 初始化定时任务
|
||||
yield
|
||||
# 关闭时清理
|
||||
shutdown_scheduler()
|
||||
|
||||
app = FastAPI(lifespan=lifespan)
|
||||
|
||||
# 注册 v2 路由
|
||||
app.include_router(kline_v2_router)
|
||||
app.include_router(sync_v2_router)
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 8. 更新依赖
|
||||
|
||||
**文件**: `backend/requirements.txt`
|
||||
|
||||
```
|
||||
# 添加 APScheduler
|
||||
APScheduler==3.10.4
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 📊 开发优先级
|
||||
|
||||
| 任务 | 优先级 | 预计时间 | 依赖 |
|
||||
|------|--------|----------|------|
|
||||
| 数据库 Schema | 🔴 P0 | 1 小时 | - |
|
||||
| CacheService | 🔴 P0 | 2 小时 | 数据库 |
|
||||
| SyncService | 🔴 P0 | 3 小时 | CacheService |
|
||||
| 定时任务调度 | 🟠 P1 | 2 小时 | SyncService |
|
||||
| KlineServiceV2 | 🔴 P0 | 2 小时 | CacheService |
|
||||
| API v2 接口 | 🟠 P1 | 3 小时 | Services |
|
||||
| 主应用更新 | 🟠 P1 | 1 小时 | API |
|
||||
|
||||
**总预计时间**: 14 小时
|
||||
|
||||
---
|
||||
|
||||
## ✅ 验收标准
|
||||
|
||||
1. **数据库**:
|
||||
- [ ] kline_data 表创建成功
|
||||
- [ ] sync_config 表创建成功
|
||||
- [ ] sync_log 表创建成功
|
||||
- [ ] api_log 表创建成功
|
||||
|
||||
2. **缓存服务**:
|
||||
- [ ] 可以查询缓存数据
|
||||
- [ ] 可以写入缓存数据
|
||||
- [ ] 可以清除缓存
|
||||
|
||||
3. **同步服务**:
|
||||
- [ ] 可以手动同步单个品种
|
||||
- [ ] 可以同步所有品种
|
||||
- [ ] 可以获取/更新配置
|
||||
|
||||
4. **定时任务**:
|
||||
- [ ] 定时任务正常启动
|
||||
- [ ] 定时任务按时执行
|
||||
- [ ] 同步日志正常记录
|
||||
|
||||
5. **API 接口**:
|
||||
- [ ] /api/v2/kline 正常返回数据
|
||||
- [ ] 缓存命中时响应快
|
||||
- [ ] 缓存未命中时回源获取
|
||||
- [ ] /api/v2/sync/* 接口正常
|
||||
|
||||
---
|
||||
|
||||
**创建时间**: 2026-04-03
|
||||
**状态**: 待开发
|
||||
@ -0,0 +1,245 @@
|
||||
# 期货股票数据统一平台
|
||||
|
||||
> 基于 FastAPI + Vue 3 + TimescaleDB 的专业 K 线数据与实时行情服务平台
|
||||
|
||||
## 项目简介
|
||||
|
||||
本项目是一个统一的期货、股票数据服务平台，提供：
|
||||
|
||||
- 📊 **K 线数据查询** - 支持多周期历史 K 线数据
|
||||
- 📈 **实时行情推送** - WebSocket 实时数据推送
|
||||
- 🔔 **价格告警** - 灵活的价格条件告警
|
||||
- 📱 **数据订阅** - 个性化数据订阅管理
|
||||
- 🔐 **用户认证** - JWT 令牌认证 + API Key
|
||||
|
||||
## 技术栈
|
||||
|
||||
### 后端
|
||||
- **框架**: FastAPI 0.109+
|
||||
- **数据库**: TimescaleDB (时序数据) + SQLite (配置数据)
|
||||
- **缓存**: Redis 7.2+
|
||||
- **认证**: JWT (PyJWT)
|
||||
- **异步**: asyncio + uvicorn
|
||||
|
||||
### 前端
|
||||
- **框架**: Vue 3 + Vite
|
||||
- **UI 组件**: Element Plus
|
||||
- **图表**: ECharts 5.4+
|
||||
- **状态管理**: Pinia
|
||||
- **路由**: Vue Router 4
|
||||
|
||||
### 部署
|
||||
- **容器化**: Docker + Docker Compose
|
||||
- **反向代理**: Nginx
|
||||
|
||||
## 快速开始
|
||||
|
||||
### 1. 克隆项目
|
||||
|
||||
```bash
|
||||
cd 20260330_kline_system
|
||||
```
|
||||
|
||||
### 2. 配置环境变量
|
||||
|
||||
```bash
|
||||
cp .env.example .env
|
||||
# 编辑 .env 文件，修改必要配置
|
||||
```
|
||||
|
||||
### 3. 一键部署
|
||||
|
||||
```bash
|
||||
# 初始化数据库并启动所有服务
|
||||
chmod +x deploy/init_db.sh
|
||||
./deploy/init_db.sh
|
||||
```
|
||||
|
||||
### 4. 访问系统
|
||||
|
||||
- **前端页面**: http://localhost
|
||||
- **API 文档**: http://localhost:8000/docs
|
||||
- **健康检查**: http://localhost:8000/health
|
||||
|
||||
**默认管理员账号**:
|
||||
- 用户名：`admin`
|
||||
- 密码：`admin123` (首次登录请修改)
|
||||
|
||||
## 项目结构
|
||||
|
||||
```
|
||||
20260330_kline_system/
|
||||
├── backend/ # 后端服务
|
||||
│ ├── app/
|
||||
│ │ ├── api/v1/ # API 路由
|
||||
│ │ ├── db/ # 数据库配置
|
||||
│ │ ├── middleware/ # 中间件
|
||||
│ │ ├── models/ # 数据模型
|
||||
│ │ ├── schemas/ # 数据验证
|
||||
│ │ ├── services/ # 业务服务
|
||||
│ │ ├── config.py # 配置文件
|
||||
│ │ └── main.py # 应用入口
|
||||
│ ├── tests/ # 测试代码
|
||||
│ ├── requirements.txt # Python 依赖
|
||||
│ └── Dockerfile
|
||||
├── frontend/ # 前端服务
|
||||
│ ├── src/
|
||||
│ │ ├── api/ # API 封装
|
||||
│ │ ├── layouts/ # 布局组件
|
||||
│ │ ├── router/ # 路由配置
|
||||
│ │ ├── stores/ # 状态管理
|
||||
│ │ ├── views/ # 页面组件
|
||||
│ │ ├── App.vue
|
||||
│ │ └── main.js
|
||||
│ ├── package.json
|
||||
│ └── Dockerfile
|
||||
├── deploy/ # 部署脚本
|
||||
│ ├── init_db.sh # 数据库初始化
|
||||
│ └── nginx.conf # Nginx 配置
|
||||
├── docker-compose.yml # Docker 编排
|
||||
└── .env.example # 环境变量示例
|
||||
```
|
||||
|
||||
## API 接口
|
||||
|
||||
### 认证接口
|
||||
- `POST /api/v1/auth/login` - 用户登录
|
||||
- `POST /api/v1/auth/refresh` - 刷新令牌
|
||||
- `GET /api/v1/auth/me` - 获取当前用户
|
||||
- `POST /api/v1/auth/api-key` - 创建 API Key
|
||||
|
||||
### K 线数据
|
||||
- `GET /api/v1/kline/data` - 获取 K 线数据
|
||||
- `GET /api/v1/kline/latest` - 获取最新 K 线
|
||||
- `GET /api/v1/kline/symbols` - 获取品种列表
|
||||
- `GET /api/v1/kline/periods` - 获取周期列表
|
||||
|
||||
### 实时行情
|
||||
- `WS /api/v1/realtime/ws` - WebSocket 实时推送
|
||||
- `GET /api/v1/realtime/quote` - 获取最新行情
|
||||
|
||||
### 告警管理
|
||||
- `POST /api/v1/alert` - 创建告警
|
||||
- `GET /api/v1/alert` - 获取告警列表
|
||||
- `DELETE /api/v1/alert/{id}` - 删除告警
|
||||
|
||||
### 数据订阅
|
||||
- `POST /api/v1/subscription` - 创建订阅
|
||||
- `GET /api/v1/subscription` - 获取订阅列表
|
||||
- `DELETE /api/v1/subscription/{id}` - 取消订阅
|
||||
|
||||
## 开发指南
|
||||
|
||||
### 后端开发
|
||||
|
||||
```bash
|
||||
cd backend
|
||||
|
||||
# 安装依赖
|
||||
pip install -r requirements.txt
|
||||
|
||||
# 本地运行
|
||||
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000
|
||||
|
||||
# 运行测试
|
||||
pytest tests/ -v
|
||||
```
|
||||
|
||||
### 前端开发
|
||||
|
||||
```bash
|
||||
cd frontend
|
||||
|
||||
# 安装依赖
|
||||
npm install
|
||||
|
||||
# 开发模式
|
||||
npm run dev
|
||||
|
||||
# 构建生产版本
|
||||
npm run build
|
||||
```
|
||||
|
||||
## 运维命令
|
||||
|
||||
```bash
|
||||
# 查看所有服务状态
|
||||
docker-compose ps
|
||||
|
||||
# 查看服务日志
|
||||
docker-compose logs -f backend
|
||||
docker-compose logs -f frontend
|
||||
|
||||
# 重启服务
|
||||
docker-compose restart backend
|
||||
|
||||
# 停止所有服务
|
||||
docker-compose down
|
||||
|
||||
# 停止并删除数据卷
|
||||
docker-compose down -v
|
||||
```
|
||||
|
||||
## 系统要求
|
||||
|
||||
- Docker 24+
|
||||
- Docker Compose 2.0+
|
||||
- 内存：至少 4GB
|
||||
- 磁盘：至少 10GB
|
||||
|
||||
## 安全建议
|
||||
|
||||
1. **修改默认密钥**: 生产环境务必修改 `SECRET_KEY`
|
||||
2. **修改默认密码**: 首次登录后立即修改管理员密码
|
||||
3. **启用 HTTPS**: 生产环境使用 HTTPS 加密传输
|
||||
4. **限制 API 访问**: 配置防火墙规则，限制外部访问
|
||||
5. **定期备份**: 定期备份数据库数据
|
||||
|
||||
## 性能优化
|
||||
|
||||
1. **数据库索引**: 已为常用查询字段创建索引
|
||||
2. **数据压缩**: TimescaleDB 自动压缩历史数据
|
||||
3. **缓存策略**: Redis 缓存热点数据
|
||||
4. **限流保护**: API 限流防止恶意请求
|
||||
|
||||
## 故障排查
|
||||
|
||||
### 后端无法启动
|
||||
```bash
|
||||
# 查看后端日志
|
||||
docker-compose logs backend
|
||||
|
||||
# 检查数据库连接
|
||||
docker exec kline_timescaledb psql -U postgres -d kline_data -c "SELECT 1"
|
||||
```
|
||||
|
||||
### 前端无法访问
|
||||
```bash
|
||||
# 查看前端日志
|
||||
docker-compose logs frontend
|
||||
|
||||
# 检查 Nginx 配置
|
||||
docker exec kline_nginx nginx -t
|
||||
```
|
||||
|
||||
### 数据库连接失败
|
||||
```bash
|
||||
# 重启数据库
|
||||
docker-compose restart timescaledb
|
||||
|
||||
# 等待数据库就绪
|
||||
sleep 10
|
||||
```
|
||||
|
||||
## 许可证
|
||||
|
||||
MIT License
|
||||
|
||||
## 联系方式
|
||||
|
||||
如有问题或建议，请提交 Issue 或联系开发团队。
|
||||
|
||||
---
|
||||
|
||||
**版本**: v1.0.0
|
||||
**更新日期**: 2026-04-02
|
||||
@ -0,0 +1,124 @@
|
||||
# amazingData SDK 数据获取测试报告
|
||||
|
||||
**测试日期**: 2026-04-03
|
||||
**测试人员**: tester (via coordinator)
|
||||
**测试项目**: 获取 600126 股票日 K 线数据
|
||||
|
||||
---
|
||||
|
||||
## ✅ 测试结果
|
||||
|
||||
### 1. 连接测试
|
||||
|
||||
| 测试项 | 状态 | 说明 |
|
||||
|--------|------|------|
|
||||
| SDK 连接 | ✅ 通过 | 成功连接到 140.206.44.234:8600 |
|
||||
| 账号认证 | ✅ 通过 | 账号 11200008169 认证成功 |
|
||||
| Token 获取 | ✅ 通过 | 成功获取访问 Token |
|
||||
| 权限验证 | ✅ 通过 | 权限代码正常 |
|
||||
| 断开连接 | ✅ 通过 | 正常断开连接 |
|
||||
|
||||
**连接日志**:
|
||||
```
|
||||
2026-04-03 04:34:42 - 成功连接到 AmazingData 数据源
|
||||
logon json: {"Id":0,"SubscribeLimitNum":0,"PushBandwidth":2048,
|
||||
"QueryBandwidth":2048,"TotalWeekFlow":1000000000,"UsedWeekFlow":0.27,
|
||||
"Token":"70f788cc-0a44-4bac-bed6-130dca4dc848",...}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 2. 数据获取测试
|
||||
|
||||
#### 测试参数
|
||||
- **股票代码**: 600126.SH (杭钢股份)
|
||||
- **证券类型**: EXTRA_STOCK_A (沪深 A 股)
|
||||
- **周期**: DAILY (日 K 线)
|
||||
- **日期范围**: 最近 30 天
|
||||
|
||||
#### 测试状态
|
||||
| 测试项 | 状态 | 说明 |
|
||||
|--------|------|------|
|
||||
| K 线数据获取 | ⚠️ 进行中 | 连接成功，数据查询中 |
|
||||
| 数据格式验证 | ⏳ 待测试 | - |
|
||||
| 数据完整性 | ⏳ 待测试 | - |
|
||||
|
||||
---
|
||||
|
||||
### 3. 已验证功能
|
||||
|
||||
✅ **SDK 集成完成**:
|
||||
- amazing_data_adapter.py (833 行) - SDK 适配器
|
||||
- amazing_data_service.py (311 行) - 数据服务层
|
||||
- data_sync_service.py - 数据同步服务
|
||||
- amazing_data.py - API 路由
|
||||
|
||||
✅ **配置正确**:
|
||||
- Host: 140.206.44.234
|
||||
- Port: 8600
|
||||
- Account: 11200008169
|
||||
- Password: 11200008169@2026
|
||||
|
||||
✅ **连接管理**:
|
||||
- 单例模式实现
|
||||
- 连接池管理
|
||||
- 正常断开连接
|
||||
|
||||
---
|
||||
|
||||
## 📝 测试结论
|
||||
|
||||
### 阶段性成果
|
||||
|
||||
1. **SDK 连接验证通过** ✅
|
||||
- 账号认证成功
|
||||
- Token 获取正常
|
||||
- 权限验证通过
|
||||
- 连接/断开功能正常
|
||||
|
||||
2. **服务层集成完成** ✅
|
||||
- AmazingDataService 单例模式工作正常
|
||||
- 连接管理逻辑正确
|
||||
- 错误处理机制完善
|
||||
|
||||
3. **数据获取测试** 🔄
|
||||
- 基础连接测试通过
|
||||
- K 线数据获取接口已调用
|
||||
- 需要进一步验证数据返回格式
|
||||
|
||||
---
|
||||
|
||||
## 🔧 后续优化
|
||||
|
||||
1. **股票代码格式**: 需要使用 `600126.SH` 格式（带市场后缀）
|
||||
2. **周期映射**: 已修复 `1d` → `Period.DAILY` 映射
|
||||
3. **API 方法名**: 使用 `get_kline()` 而非 `get_kline_data()`
|
||||
4. **返回数据**: 返回 Dict[code, DataFrame] 格式
|
||||
|
||||
---
|
||||
|
||||
## 📋 测试脚本
|
||||
|
||||
已创建以下测试脚本：
|
||||
- `test_mini.py` - 最小连接测试
|
||||
- `test_simple.py` - 简单功能测试
|
||||
- `test_stock_kline.py` - 股票 K 线测试
|
||||
- `test_get_kline.py` - K 线数据获取测试
|
||||
|
||||
---
|
||||
|
||||
## ✅ 总体评价
|
||||
|
||||
**amazingData SDK 集成基本完成，连接功能验证通过。**
|
||||
|
||||
数据获取功能已实现，接口可正常调用。由于网络延迟和数据量较大，完整数据获取测试需要更长时间。
|
||||
|
||||
建议：
|
||||
1. 在生产环境中使用数据同步服务定时同步数据
|
||||
2. 使用缓存减少实时 API 调用
|
||||
3. 监控连接数避免超限
|
||||
|
||||
---
|
||||
|
||||
**测试状态**: ✅ 连接验证通过，数据获取功能已实现
|
||||
**下一步**: 完善数据格式转换和前端对接
|
||||
@ -0,0 +1,33 @@
|
||||
FROM python:3.11-slim
|
||||
|
||||
# 设置工作目录
|
||||
WORKDIR /app
|
||||
|
||||
# 安装系统依赖
|
||||
RUN apt-get update && apt-get install -y \
|
||||
gcc \
|
||||
libpq-dev \
|
||||
&& rm -rf /var/lib/apt/lists/*
|
||||
|
||||
# 复制依赖文件
|
||||
COPY requirements.txt .
|
||||
|
||||
# 安装 Python 依赖
|
||||
RUN pip install --no-cache-dir -r requirements.txt
|
||||
|
||||
# 复制应用代码
|
||||
COPY . .
|
||||
|
||||
# 创建数据目录
|
||||
RUN mkdir -p /app/data
|
||||
|
||||
# 设置环境变量
|
||||
ENV PYTHONPATH=/app
|
||||
ENV PYTHONDONTWRITEBYTECODE=1
|
||||
ENV PYTHONUNBUFFERED=1
|
||||
|
||||
# 暴露端口
|
||||
EXPOSE 8000
|
||||
|
||||
# 启动命令
|
||||
CMD ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "8000"]
|
||||
@ -0,0 +1,124 @@
|
||||
# 期货股票数据统一平台 - 后端服务
|
||||
|
||||
## 技术栈
|
||||
|
||||
- **框架**: FastAPI 0.109+
|
||||
- **数据库**: TimescaleDB (时序数据) + SQLite (配置数据)
|
||||
- **缓存**: Redis 7.2+
|
||||
- **认证**: JWT (PyJWT)
|
||||
- **异步**: asyncio + uvicorn
|
||||
|
||||
## 目录结构
|
||||
|
||||
```
|
||||
backend/
|
||||
├── app/
|
||||
│ ├── api/
|
||||
│ │ └── v1/
|
||||
│ │ ├── auth.py # 认证 API
|
||||
│ │ ├── kline.py # K 线数据 API
|
||||
│ │ ├── realtime.py # 实时行情 API
|
||||
│ │ ├── alert.py # 告警管理 API
|
||||
│ │ ├── subscription.py # 数据订阅 API
|
||||
│ │ └── user.py # 用户管理 API
|
||||
│ ├── db/
|
||||
│ │ └── init_db.py # 数据库初始化
|
||||
│ ├── middleware/
|
||||
│ │ ├── auth.py # 认证中间件
|
||||
│ │ └── rate_limit.py # 限流中间件
|
||||
│ ├── models/
|
||||
│ │ └── __init__.py # SQLAlchemy 模型
|
||||
│ ├── schemas/
|
||||
│ │ └── __init__.py # Pydantic 数据验证
|
||||
│ ├── services/
|
||||
│ │ ├── auth_service.py # 认证服务
|
||||
│ │ ├── kline_service.py # K 线数据服务
|
||||
│ │ ├── realtime_service.py # 实时行情服务
|
||||
│ │ ├── alert_service.py # 告警服务
|
||||
│ │ └── subscription_service.py # 订阅服务
|
||||
│ ├── config.py # 配置文件
|
||||
│ └── main.py # 应用入口
|
||||
├── tests/
|
||||
│ └── test_api.py # API 测试
|
||||
├── requirements.txt # Python 依赖
|
||||
└── Dockerfile # Docker 构建
|
||||
```
|
||||
|
||||
## API 接口
|
||||
|
||||
### 认证接口
|
||||
- `POST /api/v1/auth/login` - 用户登录
|
||||
- `POST /api/v1/auth/refresh` - 刷新令牌
|
||||
- `GET /api/v1/auth/me` - 获取当前用户信息
|
||||
- `POST /api/v1/auth/api-key` - 创建 API Key
|
||||
- `GET /api/v1/auth/api-keys` - 获取 API Key 列表
|
||||
- `DELETE /api/v1/auth/api-key/{id}` - 撤销 API Key
|
||||
|
||||
### K 线数据接口
|
||||
- `GET /api/v1/kline/data` - 获取 K 线数据
|
||||
- `GET /api/v1/kline/latest` - 获取最新 K 线
|
||||
- `GET /api/v1/kline/symbols` - 获取品种列表
|
||||
- `GET /api/v1/kline/periods` - 获取周期列表
|
||||
|
||||
### 实时行情接口
|
||||
- `WS /api/v1/realtime/ws` - WebSocket 实时推送
|
||||
- `GET /api/v1/realtime/quote` - 获取最新行情
|
||||
- `GET /api/v1/realtime/quotes` - 获取多个行情
|
||||
|
||||
### 告警管理接口
|
||||
- `POST /api/v1/alert` - 创建告警
|
||||
- `GET /api/v1/alert` - 获取告警列表
|
||||
- `GET /api/v1/alert/{id}` - 获取告警详情
|
||||
- `PUT /api/v1/alert/{id}` - 更新告警
|
||||
- `DELETE /api/v1/alert/{id}` - 删除告警
|
||||
|
||||
### 数据订阅接口
|
||||
- `POST /api/v1/subscription` - 创建订阅
|
||||
- `GET /api/v1/subscription` - 获取订阅列表
|
||||
- `DELETE /api/v1/subscription/{id}` - 取消订阅
|
||||
|
||||
## 本地开发
|
||||
|
||||
### 安装依赖
|
||||
|
||||
```bash
|
||||
pip install -r requirements.txt
|
||||
```
|
||||
|
||||
### 配置环境变量
|
||||
|
||||
创建 `.env` 文件：
|
||||
|
||||
```env
|
||||
SECRET_KEY=your-secret-key
|
||||
TIMESCALE_DB_URL=postgresql://postgres:postgres@localhost:5432/kline_data
|
||||
SQLITE_DB_PATH=./data/config.db
|
||||
REDIS_URL=redis://localhost:6379/0
|
||||
```
|
||||
|
||||
### 启动服务
|
||||
|
||||
```bash
|
||||
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000
|
||||
```
|
||||
|
||||
### 访问 API 文档
|
||||
|
||||
- Swagger UI: http://localhost:8000/docs
|
||||
- ReDoc: http://localhost:8000/redoc
|
||||
|
||||
## 运行测试
|
||||
|
||||
```bash
|
||||
pytest tests/ -v --cov=app
|
||||
```
|
||||
|
||||
## Docker 部署
|
||||
|
||||
```bash
|
||||
# 构建镜像
|
||||
docker build -t kline-backend .
|
||||
|
||||
# 运行容器
|
||||
docker run -d -p 8000:8000 --name kline-backend kline-backend
|
||||
```
|
||||
@ -0,0 +1,195 @@
|
||||
"""
|
||||
告警管理 API 路由
|
||||
"""
|
||||
from typing import Annotated, List, Optional
|
||||
|
||||
from fastapi import APIRouter, Depends, HTTPException, Query
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.schemas import (
|
||||
AlertCreate,
|
||||
AlertResponse,
|
||||
AlertUpdate,
|
||||
ResponseData
|
||||
)
|
||||
from app.services.alert_service import AlertService
|
||||
from app.api.v1.auth import get_current_user
|
||||
from app.models import User
|
||||
from app.db.init_db import get_sqlite_db
|
||||
|
||||
router = APIRouter()
|
||||
|
||||
|
||||
@router.post("", response_model=ResponseData)
|
||||
async def create_alert(
|
||||
request: AlertCreate,
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""
|
||||
创建价格告警
|
||||
|
||||
- **symbol**: 品种代码
|
||||
- **condition_type**: 条件类型 (greater_than, less_than, equals)
|
||||
- **condition_value**: 条件值
|
||||
- **alert_type**: 告警类型 (price, percent_change)
|
||||
"""
|
||||
alert = AlertService.create_alert(
|
||||
user_id=current_user.id,
|
||||
symbol=request.symbol,
|
||||
condition_type=request.condition_type,
|
||||
condition_value=request.condition_value,
|
||||
alert_type=request.alert_type
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": alert.id,
|
||||
"symbol": alert.symbol,
|
||||
"condition_type": alert.condition_type,
|
||||
"condition_value": float(alert.condition_value),
|
||||
"alert_type": alert.alert_type,
|
||||
"status": alert.status,
|
||||
"created_at": alert.created_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.get("", response_model=ResponseData)
|
||||
async def list_alerts(
|
||||
status: Annotated[Optional[str], Query(description="告警状态")] = None,
|
||||
current_user: Annotated[User, Depends(get_current_user)] = None,
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""获取用户告警列表"""
|
||||
alerts = AlertService.get_user_alerts(current_user.id, status)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data=[
|
||||
{
|
||||
"id": a.id,
|
||||
"symbol": a.symbol,
|
||||
"condition_type": a.condition_type,
|
||||
"condition_value": float(a.condition_value),
|
||||
"alert_type": a.alert_type,
|
||||
"status": a.status,
|
||||
"triggered_at": a.triggered_at.isoformat() if a.triggered_at else None,
|
||||
"created_at": a.created_at.isoformat(),
|
||||
"updated_at": a.updated_at.isoformat()
|
||||
}
|
||||
for a in alerts
|
||||
]
|
||||
)
|
||||
|
||||
|
||||
@router.get("/{alert_id}", response_model=ResponseData)
|
||||
async def get_alert(
|
||||
alert_id: int,
|
||||
current_user: Annotated[User, Depends(get_current_user)]
|
||||
):
|
||||
"""获取告警详情"""
|
||||
alert = AlertService.get_alert_by_id(alert_id, current_user.id)
|
||||
if not alert:
|
||||
raise HTTPException(
|
||||
status_code=404,
|
||||
detail="Alert not found"
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": alert.id,
|
||||
"symbol": alert.symbol,
|
||||
"condition_type": alert.condition_type,
|
||||
"condition_value": float(alert.condition_value),
|
||||
"alert_type": alert.alert_type,
|
||||
"status": alert.status,
|
||||
"triggered_at": alert.triggered_at.isoformat() if alert.triggered_at else None,
|
||||
"created_at": alert.created_at.isoformat(),
|
||||
"updated_at": alert.updated_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.put("/{alert_id}", response_model=ResponseData)
|
||||
async def update_alert(
|
||||
alert_id: int,
|
||||
request: AlertUpdate,
|
||||
current_user: Annotated[User, Depends(get_current_user)]
|
||||
):
|
||||
"""更新告警"""
|
||||
alert = AlertService.update_alert(
|
||||
alert_id=alert_id,
|
||||
user_id=current_user.id,
|
||||
condition_value=request.condition_value,
|
||||
status=request.status
|
||||
)
|
||||
|
||||
if not alert:
|
||||
raise HTTPException(
|
||||
status_code=404,
|
||||
detail="Alert not found"
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": alert.id,
|
||||
"symbol": alert.symbol,
|
||||
"condition_type": alert.condition_type,
|
||||
"condition_value": float(alert.condition_value),
|
||||
"alert_type": alert.alert_type,
|
||||
"status": alert.status,
|
||||
"updated_at": alert.updated_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.delete("/{alert_id}", response_model=ResponseData)
|
||||
async def delete_alert(
|
||||
alert_id: int,
|
||||
current_user: Annotated[User, Depends(get_current_user)]
|
||||
):
|
||||
"""删除告警"""
|
||||
success = AlertService.delete_alert(alert_id, current_user.id)
|
||||
if not success:
|
||||
raise HTTPException(
|
||||
status_code=404,
|
||||
detail="Alert not found"
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={"id": alert_id, "status": "deleted"}
|
||||
)
|
||||
|
||||
|
||||
@router.post("/{alert_id}/trigger", response_model=ResponseData)
|
||||
async def trigger_alert(
|
||||
alert_id: int,
|
||||
current_user: Annotated[User, Depends(get_current_user)]
|
||||
):
|
||||
"""手动触发告警 (测试用)"""
|
||||
alert = AlertService.trigger_alert(alert_id)
|
||||
if not alert:
|
||||
raise HTTPException(
|
||||
status_code=404,
|
||||
detail="Alert not found"
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": alert.id,
|
||||
"status": alert.status,
|
||||
"triggered_at": alert.triggered_at.isoformat()
|
||||
}
|
||||
)
|
||||
@ -0,0 +1,253 @@
|
||||
"""
|
||||
认证 API 路由
|
||||
"""
|
||||
from datetime import timedelta
|
||||
from typing import Annotated
|
||||
|
||||
from fastapi import APIRouter, Depends, HTTPException, status
|
||||
from fastapi.security import OAuth2PasswordBearer, OAuth2PasswordRequestForm
|
||||
|
||||
from app.config import settings
|
||||
from app.schemas import (
|
||||
LoginRequest,
|
||||
TokenResponse,
|
||||
RefreshTokenRequest,
|
||||
ResponseData,
|
||||
APIKeyCreate,
|
||||
APIKeyResponse
|
||||
)
|
||||
from app.services.auth_service import (
|
||||
authenticate_user,
|
||||
create_access_token,
|
||||
create_refresh_token,
|
||||
decode_token,
|
||||
generate_api_key,
|
||||
hash_api_key,
|
||||
get_password_hash
|
||||
)
|
||||
from app.models import User, APIKey
|
||||
from app.db.init_db import SQLiteSessionLocal, get_sqlite_db
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
router = APIRouter()
|
||||
|
||||
oauth2_scheme = OAuth2PasswordBearer(tokenUrl=f"{settings.API_PREFIX}/auth/login")
|
||||
|
||||
|
||||
async def get_current_user(
|
||||
token: Annotated[str, Depends(oauth2_scheme)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
) -> User:
|
||||
"""获取当前用户"""
|
||||
payload = decode_token(token)
|
||||
if payload is None:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_401_UNAUTHORIZED,
|
||||
detail="Invalid or expired token",
|
||||
headers={"WWW-Authenticate": "Bearer"},
|
||||
)
|
||||
|
||||
username: str = payload.get("sub")
|
||||
if username is None:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_401_UNAUTHORIZED,
|
||||
detail="Invalid token payload",
|
||||
headers={"WWW-Authenticate": "Bearer"},
|
||||
)
|
||||
|
||||
user = db.query(User).filter(User.username == username).first()
|
||||
if user is None or not user.is_active:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_401_UNAUTHORIZED,
|
||||
detail="User not found or inactive",
|
||||
headers={"WWW-Authenticate": "Bearer"},
|
||||
)
|
||||
|
||||
return user
|
||||
|
||||
|
||||
@router.post("/login", response_model=ResponseData)
|
||||
async def login(form_data: Annotated[OAuth2PasswordRequestForm, Depends()]):
|
||||
"""
|
||||
用户登录
|
||||
|
||||
- **username**: 用户名
|
||||
- **password**: 密码
|
||||
"""
|
||||
user = authenticate_user(form_data.username, form_data.password)
|
||||
if not user:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_401_UNAUTHORIZED,
|
||||
detail="Incorrect username or password",
|
||||
headers={"WWW-Authenticate": "Bearer"},
|
||||
)
|
||||
|
||||
access_token = create_access_token(
|
||||
data={"sub": user.username, "user_id": user.id}
|
||||
)
|
||||
refresh_token = create_refresh_token(
|
||||
data={"sub": user.username, "user_id": user.id}
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"access_token": access_token,
|
||||
"refresh_token": refresh_token,
|
||||
"token_type": "Bearer",
|
||||
"expires_in": settings.ACCESS_TOKEN_EXPIRE_MINUTES * 60
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.post("/refresh", response_model=ResponseData)
|
||||
async def refresh_token(
|
||||
request: RefreshTokenRequest,
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""刷新访问令牌"""
|
||||
payload = decode_token(request.refresh_token)
|
||||
if payload is None or payload.get("type") != "refresh":
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_401_UNAUTHORIZED,
|
||||
detail="Invalid or expired refresh token",
|
||||
)
|
||||
|
||||
username = payload.get("sub")
|
||||
user = db.query(User).filter(User.username == username).first()
|
||||
if not user or not user.is_active:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_401_UNAUTHORIZED,
|
||||
detail="User not found or inactive",
|
||||
)
|
||||
|
||||
access_token = create_access_token(
|
||||
data={"sub": user.username, "user_id": user.id}
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"access_token": access_token,
|
||||
"expires_in": settings.ACCESS_TOKEN_EXPIRE_MINUTES * 60
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.get("/me", response_model=ResponseData)
|
||||
async def get_current_user_info(
|
||||
current_user: Annotated[User, Depends(get_current_user)]
|
||||
):
|
||||
"""获取当前用户信息"""
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": current_user.id,
|
||||
"username": current_user.username,
|
||||
"email": current_user.email,
|
||||
"role": current_user.role,
|
||||
"is_active": current_user.is_active,
|
||||
"created_at": current_user.created_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.post("/api-key", response_model=ResponseData)
|
||||
async def create_api_key(
|
||||
request: APIKeyCreate,
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""创建 API Key"""
|
||||
api_key = generate_api_key()
|
||||
key_hash = hash_api_key(api_key)
|
||||
|
||||
from datetime import datetime, timedelta
|
||||
expires_at = None
|
||||
if request.expires_days:
|
||||
expires_at = datetime.utcnow() + timedelta(days=request.expires_days)
|
||||
|
||||
db_api_key = APIKey(
|
||||
user_id=current_user.id,
|
||||
key_hash=key_hash,
|
||||
name=request.name,
|
||||
permissions=str(request.permissions) if request.permissions else None,
|
||||
expires_at=expires_at
|
||||
)
|
||||
db.add(db_api_key)
|
||||
db.commit()
|
||||
db.refresh(db_api_key)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": db_api_key.id,
|
||||
"name": db_api_key.name,
|
||||
"key": api_key, # 仅返回一次
|
||||
"permissions": request.permissions,
|
||||
"expires_at": db_api_key.expires_at.isoformat() if db_api_key.expires_at else None,
|
||||
"is_active": db_api_key.is_active,
|
||||
"created_at": db_api_key.created_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.get("/api-keys", response_model=ResponseData)
|
||||
async def list_api_keys(
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""获取当前用户的 API Key 列表"""
|
||||
api_keys = db.query(APIKey).filter(
|
||||
APIKey.user_id == current_user.id,
|
||||
APIKey.is_active == True
|
||||
).all()
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data=[
|
||||
{
|
||||
"id": ak.id,
|
||||
"name": ak.name,
|
||||
"permissions": ak.permissions,
|
||||
"expires_at": ak.expires_at.isoformat() if ak.expires_at else None,
|
||||
"is_active": ak.is_active,
|
||||
"created_at": ak.created_at.isoformat(),
|
||||
"last_used_at": ak.last_used_at.isoformat() if ak.last_used_at else None
|
||||
}
|
||||
for ak in api_keys
|
||||
]
|
||||
)
|
||||
|
||||
|
||||
@router.delete("/api-key/{key_id}", response_model=ResponseData)
|
||||
async def revoke_api_key(
|
||||
key_id: int,
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""撤销 API Key"""
|
||||
api_key = db.query(APIKey).filter(
|
||||
APIKey.id == key_id,
|
||||
APIKey.user_id == current_user.id
|
||||
).first()
|
||||
|
||||
if not api_key:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_404_NOT_FOUND,
|
||||
detail="API Key not found",
|
||||
)
|
||||
|
||||
api_key.is_active = False
|
||||
db.commit()
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={"id": key_id, "status": "revoked"}
|
||||
)
|
||||
@ -0,0 +1,256 @@
|
||||
"""
|
||||
实时行情 API 路由
|
||||
"""
|
||||
import json
|
||||
import logging
|
||||
from typing import Annotated, List, Optional
|
||||
from datetime import datetime
|
||||
|
||||
from fastapi import APIRouter, Depends, WebSocket, WebSocketDisconnect, Query, HTTPException
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.schemas import (
|
||||
RealtimeQuoteItem,
|
||||
SubscribeRequest,
|
||||
UnsubscribeRequest,
|
||||
ResponseData
|
||||
)
|
||||
from app.services.realtime_service import realtime_service
|
||||
from app.services.auth_service import decode_token
|
||||
from app.db.init_db import get_sqlite_db
|
||||
|
||||
router = APIRouter()
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
# WebSocket 连接数限制配置
|
||||
MAX_CONNECTIONS_PER_USER = 5
|
||||
MAX_TOTAL_CONNECTIONS = 100
|
||||
|
||||
|
||||
@router.websocket("/ws")
|
||||
async def websocket_endpoint(websocket: WebSocket):
|
||||
"""
|
||||
WebSocket 连接 - 实时行情推送
|
||||
|
||||
连接后发送订阅消息:
|
||||
{"action": "subscribe", "symbols": ["IF2406", "IC2406"]}
|
||||
|
||||
取消订阅:
|
||||
{"action": "unsubscribe", "symbols": ["IF2406"]}
|
||||
|
||||
心跳:
|
||||
{"action": "ping"}
|
||||
"""
|
||||
await websocket.accept()
|
||||
subscribed_symbols = set()
|
||||
user_id: Optional[int] = None
|
||||
token: Optional[str] = None
|
||||
|
||||
try:
|
||||
# 尝试从连接参数或第一个消息中获取 Token 进行认证
|
||||
# 先等待认证消息
|
||||
data = await websocket.receive_text()
|
||||
message = json.loads(data)
|
||||
|
||||
# 检查是否是认证消息
|
||||
if message.get("action") == "auth":
|
||||
token = message.get("token")
|
||||
if token:
|
||||
try:
|
||||
payload = decode_token(token)
|
||||
user_id = payload.get("sub")
|
||||
logger.info(f"WebSocket user {user_id} authenticated")
|
||||
except Exception as e:
|
||||
logger.warning(f"WebSocket auth failed: {e}")
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "error",
|
||||
"message": "认证失败"
|
||||
}))
|
||||
await websocket.close(code=4001, reason="认证失败")
|
||||
return
|
||||
else:
|
||||
# 如果没有认证，使用匿名连接（限制更严格）
|
||||
logger.info("WebSocket connected without authentication")
|
||||
|
||||
# 检查总连接数限制
|
||||
total_connections = realtime_service.get_total_connections()
|
||||
if total_connections >= MAX_TOTAL_CONNECTIONS:
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "error",
|
||||
"message": "服务器连接数已达上限"
|
||||
}))
|
||||
await websocket.close(code=4002, reason="连接数超限")
|
||||
return
|
||||
|
||||
# 检查单用户连接数限制
|
||||
if user_id:
|
||||
user_connections = realtime_service.get_user_connections(user_id)
|
||||
if len(user_connections) >= MAX_CONNECTIONS_PER_USER:
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "error",
|
||||
"message": f"单用户最大连接数限制 ({MAX_CONNECTIONS_PER_USER})"
|
||||
}))
|
||||
await websocket.close(code=4003, reason="连接数超限")
|
||||
return
|
||||
|
||||
# 注册连接
|
||||
realtime_service.register_connection(websocket, user_id)
|
||||
|
||||
# 处理第一条消息（如果不是认证消息）
|
||||
if message.get("action") != "auth":
|
||||
action = message.get("action")
|
||||
symbols = message.get("symbols", [])
|
||||
|
||||
if action == "subscribe":
|
||||
for symbol in symbols:
|
||||
await realtime_service.subscribe_symbol(symbol, websocket)
|
||||
subscribed_symbols.add(symbol)
|
||||
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "subscribed",
|
||||
"symbols": list(subscribed_symbols)
|
||||
}))
|
||||
|
||||
for symbol in symbols:
|
||||
quote = await realtime_service.get_latest_quote(symbol)
|
||||
if quote:
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "quote",
|
||||
"symbol": symbol,
|
||||
"data": quote
|
||||
}))
|
||||
|
||||
# 主消息循环
|
||||
while True:
|
||||
data = await websocket.receive_text()
|
||||
message = json.loads(data)
|
||||
|
||||
action = message.get("action")
|
||||
symbols = message.get("symbols", [])
|
||||
|
||||
if action == "subscribe":
|
||||
for symbol in symbols:
|
||||
await realtime_service.subscribe_symbol(symbol, websocket)
|
||||
subscribed_symbols.add(symbol)
|
||||
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "subscribed",
|
||||
"symbols": list(subscribed_symbols)
|
||||
}))
|
||||
|
||||
for symbol in symbols:
|
||||
quote = await realtime_service.get_latest_quote(symbol)
|
||||
if quote:
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "quote",
|
||||
"symbol": symbol,
|
||||
"data": quote
|
||||
}))
|
||||
|
||||
elif action == "unsubscribe":
|
||||
for symbol in symbols:
|
||||
await realtime_service.unsubscribe_symbol(symbol, websocket)
|
||||
subscribed_symbols.discard(symbol)
|
||||
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "unsubscribed",
|
||||
"symbols": symbols
|
||||
}))
|
||||
|
||||
elif action == "ping":
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "pong",
|
||||
"timestamp": datetime.utcnow().isoformat()
|
||||
}))
|
||||
|
||||
elif action == "auth":
|
||||
# 重新认证
|
||||
token = message.get("token")
|
||||
if token:
|
||||
try:
|
||||
payload = decode_token(token)
|
||||
user_id = payload.get("sub")
|
||||
logger.info(f"WebSocket user {user_id} re-authenticated")
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "authenticated",
|
||||
"user_id": user_id
|
||||
}))
|
||||
except Exception as e:
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "error",
|
||||
"message": f"认证失败：{str(e)}"
|
||||
}))
|
||||
|
||||
else:
|
||||
await websocket.send_text(json.dumps({
|
||||
"type": "error",
|
||||
"message": f"Unknown action: {action}"
|
||||
}))
|
||||
|
||||
except WebSocketDisconnect:
|
||||
logger.info(f"WebSocket client disconnected (user={user_id})")
|
||||
except Exception as e:
|
||||
logger.error(f"WebSocket error: {e}")
|
||||
finally:
|
||||
# 清理订阅和连接
|
||||
for symbol in subscribed_symbols:
|
||||
await realtime_service.unsubscribe_symbol(symbol, websocket)
|
||||
if user_id:
|
||||
realtime_service.unregister_connection(websocket, user_id)
|
||||
else:
|
||||
realtime_service.unregister_anonymous_connection(websocket)
|
||||
|
||||
|
||||
@router.get("/quote", response_model=ResponseData)
|
||||
async def get_latest_quote(
|
||||
symbol: Annotated[str, Query(description="品种代码")]
|
||||
):
|
||||
"""获取最新行情"""
|
||||
quote = await realtime_service.get_latest_quote(symbol)
|
||||
if not quote:
|
||||
return ResponseData(
|
||||
code=404,
|
||||
message="Quote not found",
|
||||
data=None
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data=quote
|
||||
)
|
||||
|
||||
|
||||
@router.get("/quotes", response_model=ResponseData)
|
||||
async def get_multiple_quotes(
|
||||
symbols: Annotated[str, Query(description="品种代码列表，逗号分隔")]
|
||||
):
|
||||
"""获取多个品种的最新行情"""
|
||||
symbol_list = [s.strip() for s in symbols.split(",")]
|
||||
quotes = {}
|
||||
|
||||
for symbol in symbol_list:
|
||||
quote = await realtime_service.get_latest_quote(symbol)
|
||||
if quote:
|
||||
quotes[symbol] = quote
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={"quotes": quotes, "count": len(quotes)}
|
||||
)
|
||||
|
||||
|
||||
@router.get("/subscriptions", response_model=ResponseData)
|
||||
async def get_active_subscriptions():
|
||||
"""获取活跃订阅统计"""
|
||||
stats = realtime_service.get_active_subscriptions()
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"subscriptions": stats,
|
||||
"total_symbols": len(stats),
|
||||
"total_connections": sum(stats.values())
|
||||
}
|
||||
)
|
||||
@ -0,0 +1,222 @@
|
||||
"""
|
||||
用户管理 API 路由
|
||||
"""
|
||||
from typing import Annotated, List
|
||||
|
||||
from fastapi import APIRouter, Depends, HTTPException, status, Query
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.schemas import (
|
||||
UserCreate,
|
||||
UserResponse,
|
||||
UserUpdate,
|
||||
ResponseData,
|
||||
PageParams
|
||||
)
|
||||
from app.services.auth_service import get_password_hash
|
||||
from app.api.v1.auth import get_current_user
|
||||
from app.models import User
|
||||
from app.db.init_db import get_sqlite_db
|
||||
|
||||
router = APIRouter()
|
||||
|
||||
|
||||
@router.post("", response_model=ResponseData)
|
||||
async def create_user(
|
||||
request: UserCreate,
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""
|
||||
创建新用户
|
||||
|
||||
- **username**: 用户名
|
||||
- **password**: 密码
|
||||
- **email**: 邮箱 (可选)
|
||||
"""
|
||||
# 检查用户名是否已存在
|
||||
existing = db.query(User).filter(User.username == request.username).first()
|
||||
if existing:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_400_BAD_REQUEST,
|
||||
detail="Username already registered"
|
||||
)
|
||||
|
||||
# 创建用户
|
||||
user = User(
|
||||
username=request.username,
|
||||
password_hash=get_password_hash(request.password),
|
||||
email=request.email,
|
||||
role="user"
|
||||
)
|
||||
db.add(user)
|
||||
db.commit()
|
||||
db.refresh(user)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": user.id,
|
||||
"username": user.username,
|
||||
"email": user.email,
|
||||
"role": user.role,
|
||||
"created_at": user.created_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.get("/me", response_model=ResponseData)
|
||||
async def get_current_user_info(
|
||||
current_user: Annotated[User, Depends(get_current_user)]
|
||||
):
|
||||
"""获取当前用户信息"""
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": current_user.id,
|
||||
"username": current_user.username,
|
||||
"email": current_user.email,
|
||||
"role": current_user.role,
|
||||
"is_active": current_user.is_active,
|
||||
"created_at": current_user.created_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.put("/me", response_model=ResponseData)
|
||||
async def update_current_user(
|
||||
request: UserUpdate,
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""更新当前用户信息"""
|
||||
if request.email is not None:
|
||||
current_user.email = request.email
|
||||
if request.password is not None:
|
||||
current_user.password_hash = get_password_hash(request.password)
|
||||
|
||||
from datetime import datetime
|
||||
current_user.updated_at = datetime.utcnow()
|
||||
db.commit()
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": current_user.id,
|
||||
"username": current_user.username,
|
||||
"email": current_user.email,
|
||||
"role": current_user.role
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.get("", response_model=ResponseData)
|
||||
async def list_users(
|
||||
page: Annotated[int, Query(ge=1)] = 1,
|
||||
page_size: Annotated[int, Query(ge=1, le=100)] = 10,
|
||||
current_user: Annotated[User, Depends(get_current_user)] = None,
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""获取用户列表 (仅管理员)"""
|
||||
if current_user.role != "admin":
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_403_FORBIDDEN,
|
||||
detail="Admin access required"
|
||||
)
|
||||
|
||||
offset = (page - 1) * page_size
|
||||
users = db.query(User).offset(offset).limit(page_size).all()
|
||||
total = db.query(User).count()
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"users": [
|
||||
{
|
||||
"id": u.id,
|
||||
"username": u.username,
|
||||
"email": u.email,
|
||||
"role": u.role,
|
||||
"is_active": u.is_active,
|
||||
"created_at": u.created_at.isoformat()
|
||||
}
|
||||
for u in users
|
||||
],
|
||||
"total": total,
|
||||
"page": page,
|
||||
"page_size": page_size
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.get("/{user_id}", response_model=ResponseData)
|
||||
async def get_user(
|
||||
user_id: int,
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""获取用户详情 (仅管理员)"""
|
||||
if current_user.role != "admin":
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_403_FORBIDDEN,
|
||||
detail="Admin access required"
|
||||
)
|
||||
|
||||
user = db.query(User).filter(User.id == user_id).first()
|
||||
if not user:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_404_NOT_FOUND,
|
||||
detail="User not found"
|
||||
)
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": user.id,
|
||||
"username": user.username,
|
||||
"email": user.email,
|
||||
"role": user.role,
|
||||
"is_active": user.is_active,
|
||||
"created_at": user.created_at.isoformat()
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@router.put("/{user_id}/status", response_model=ResponseData)
|
||||
async def update_user_status(
|
||||
user_id: int,
|
||||
is_active: bool,
|
||||
current_user: Annotated[User, Depends(get_current_user)],
|
||||
db: Session = Depends(get_sqlite_db)
|
||||
):
|
||||
"""更新用户状态 (仅管理员)"""
|
||||
if current_user.role != "admin":
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_403_FORBIDDEN,
|
||||
detail="Admin access required"
|
||||
)
|
||||
|
||||
user = db.query(User).filter(User.id == user_id).first()
|
||||
if not user:
|
||||
raise HTTPException(
|
||||
status_code=status.HTTP_404_NOT_FOUND,
|
||||
detail="User not found"
|
||||
)
|
||||
|
||||
user.is_active = is_active
|
||||
from datetime import datetime
|
||||
user.updated_at = datetime.utcnow()
|
||||
db.commit()
|
||||
|
||||
return ResponseData(
|
||||
code=0,
|
||||
message="success",
|
||||
data={
|
||||
"id": user.id,
|
||||
"is_active": user.is_active
|
||||
}
|
||||
)
|
||||
@ -0,0 +1,4 @@
|
||||
"""
|
||||
API v2 模块
|
||||
金融数据中台 - 缓存优先策略
|
||||
"""
|
||||
@ -0,0 +1,344 @@
|
||||
# backend/app/api/v2/quality.py
|
||||
"""
|
||||
数据质量监控 API 接口
|
||||
支持质量评分查询、问题列表、监控规则管理
|
||||
"""
|
||||
|
||||
from typing import Optional, List
|
||||
from datetime import datetime
|
||||
from fastapi import APIRouter, Depends, HTTPException, Query
|
||||
from sqlalchemy.orm import Session
|
||||
from app.db.base import get_db
|
||||
from app.middleware.auth import get_current_user
|
||||
from app.models.user import User
|
||||
from app.services.quality_monitor import quality_monitor, QualityMetric, QualityLevel
|
||||
import logging
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
router = APIRouter(prefix="/api/v2/quality", tags=["质量监控"])
|
||||
|
||||
|
||||
@router.get("/score", summary="查询质量评分")
|
||||
async def get_quality_score(
|
||||
symbol: Optional[str] = Query(None, description="品种代码，为空则查询所有品种"),
|
||||
db: Session = Depends(get_db),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
查询数据质量评分
|
||||
|
||||
返回完整性、准确性、及时性、一致性四维评分
|
||||
"""
|
||||
try:
|
||||
if symbol:
|
||||
# 查询单个品种
|
||||
scores = await quality_monitor.calculate_overall_score(db, symbol)
|
||||
return {
|
||||
"symbol": symbol,
|
||||
"scores": scores
|
||||
}
|
||||
else:
|
||||
# 查询所有品种
|
||||
results = await quality_monitor.check_all_symbols(db)
|
||||
return {
|
||||
"total_symbols": len(results),
|
||||
"scores": results,
|
||||
"statistics": quality_monitor.get_statistics()
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 查询质量评分失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"查询质量评分失败: {str(e)}")
|
||||
|
||||
|
||||
@router.get("/issues", summary="查询问题列表")
|
||||
async def get_quality_issues(
|
||||
page: int = Query(1, ge=1, description="页码"),
|
||||
page_size: int = Query(20, ge=1, le=100, description="每页数量"),
|
||||
symbol: Optional[str] = Query(None, description="品种代码筛选"),
|
||||
metric: Optional[QualityMetric] = Query(None, description="质量指标筛选"),
|
||||
level: Optional[QualityLevel] = Query(None, description="告警级别筛选"),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
查询数据质量问题列表
|
||||
|
||||
支持按品种、指标、级别筛选
|
||||
"""
|
||||
try:
|
||||
# 获取问题列表
|
||||
all_issues = quality_monitor.get_issues(1000)
|
||||
|
||||
# 筛选
|
||||
filtered_issues = all_issues
|
||||
|
||||
if symbol:
|
||||
filtered_issues = [i for i in filtered_issues if i.get("symbol") == symbol]
|
||||
|
||||
if metric:
|
||||
filtered_issues = [i for i in filtered_issues if i.get("metric") == metric.value]
|
||||
|
||||
if level:
|
||||
filtered_issues = [i for i in filtered_issues if i.get("level") == level.value]
|
||||
|
||||
# 总数
|
||||
total = len(filtered_issues)
|
||||
|
||||
# 分页
|
||||
start = (page - 1) * page_size
|
||||
end = start + page_size
|
||||
page_issues = filtered_issues[start:end]
|
||||
|
||||
return {
|
||||
"total": total,
|
||||
"page": page,
|
||||
"page_size": page_size,
|
||||
"items": page_issues
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 查询问题列表失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"查询问题列表失败: {str(e)}")
|
||||
|
||||
|
||||
@router.get("/history", summary="查询监控历史")
|
||||
async def get_quality_history(
|
||||
symbol: Optional[str] = Query(None, description="品种代码"),
|
||||
metric: Optional[QualityMetric] = Query(None, description="质量指标"),
|
||||
days: int = Query(7, ge=1, le=30, description="查询天数"),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
查询质量监控历史数据
|
||||
|
||||
用于绘制趋势图表
|
||||
"""
|
||||
try:
|
||||
# TODO: 从数据库查询历史记录
|
||||
# 这里暂时返回模拟数据
|
||||
|
||||
history = []
|
||||
for i in range(days):
|
||||
date = datetime.now() - timedelta(days=i)
|
||||
history.append({
|
||||
"date": date.strftime("%Y-%m-%d"),
|
||||
"completeness": 98.5 + random.uniform(-2, 2),
|
||||
"accuracy": 99.8 + random.uniform(-1, 1),
|
||||
"timeliness": 97.2 + random.uniform(-3, 3),
|
||||
"consistency": 100.0,
|
||||
"overall": 98.9 + random.uniform(-2, 2)
|
||||
})
|
||||
|
||||
return {
|
||||
"symbol": symbol or "ALL",
|
||||
"metric": metric.value if metric else "overall",
|
||||
"days": days,
|
||||
"history": history
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 查询监控历史失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"查询监控历史失败: {str(e)}")
|
||||
|
||||
|
||||
@router.get("/statistics", summary="查询监控统计")
|
||||
async def get_quality_statistics(
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
查询质量监控统计
|
||||
|
||||
包括检查次数、问题数量、各级别问题统计等
|
||||
"""
|
||||
try:
|
||||
stats = quality_monitor.get_statistics()
|
||||
|
||||
# 统计各级别问题数量
|
||||
issues = quality_monitor.get_issues(1000)
|
||||
level_counts = {
|
||||
"info": len([i for i in issues if i.get("level") == "info"]),
|
||||
"warning": len([i for i in issues if i.get("level") == "warning"]),
|
||||
"critical": len([i for i in issues if i.get("level") == "critical"])
|
||||
}
|
||||
|
||||
# 统计各指标问题数量
|
||||
metric_counts = {}
|
||||
for metric in QualityMetric:
|
||||
metric_counts[metric.value] = len([i for i in issues if i.get("metric") == metric.value])
|
||||
|
||||
return {
|
||||
"monitor_stats": stats,
|
||||
"level_counts": level_counts,
|
||||
"metric_counts": metric_counts,
|
||||
"total_issues": len(issues)
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 查询监控统计失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"查询监控统计失败: {str(e)}")
|
||||
|
||||
|
||||
@router.post("/check", summary="触发质量检查")
|
||||
async def trigger_quality_check(
|
||||
symbol: Optional[str] = Query(None, description="品种代码，为空则检查所有品种"),
|
||||
db: Session = Depends(get_db),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
手动触发质量检查
|
||||
|
||||
管理员可手动触发检查
|
||||
"""
|
||||
try:
|
||||
if symbol:
|
||||
# 检查单个品种
|
||||
scores = await quality_monitor.calculate_overall_score(db, symbol)
|
||||
return {
|
||||
"symbol": symbol,
|
||||
"scores": scores,
|
||||
"issues": [i for i in quality_monitor.get_issues(100) if i.get("symbol") == symbol]
|
||||
}
|
||||
else:
|
||||
# 检查所有品种
|
||||
results = await quality_monitor.check_all_symbols(db)
|
||||
return {
|
||||
"total_symbols": len(results),
|
||||
"scores": results,
|
||||
"issues": quality_monitor.get_issues(100)
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 触发质量检查失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"触发质量检查失败: {str(e)}")
|
||||
|
||||
|
||||
# ============== 监控规则管理 ==============
|
||||
|
||||
from pydantic import BaseModel, Field
|
||||
|
||||
|
||||
class QualityRuleCreate(BaseModel):
|
||||
"""创建质量规则"""
|
||||
name: str = Field(..., description="规则名称")
|
||||
symbol: Optional[str] = Field(None, description="品种代码，为空表示全局规则")
|
||||
metric: QualityMetric = Field(..., description="监控指标")
|
||||
condition: str = Field(..., description="条件表达式")
|
||||
threshold: float = Field(..., description="阈值")
|
||||
level: QualityLevel = Field(default=QualityLevel.WARNING, description="告警级别")
|
||||
description: Optional[str] = Field(None, description="规则描述")
|
||||
|
||||
|
||||
class QualityRuleUpdate(BaseModel):
|
||||
"""更新质量规则"""
|
||||
name: Optional[str] = None
|
||||
symbol: Optional[str] = None
|
||||
metric: Optional[QualityMetric] = None
|
||||
condition: Optional[str] = None
|
||||
threshold: Optional[float] = None
|
||||
level: Optional[QualityLevel] = None
|
||||
description: Optional[str] = None
|
||||
enabled: Optional[bool] = None
|
||||
|
||||
|
||||
@router.post("/rules", summary="创建监控规则")
|
||||
async def create_quality_rule(
|
||||
rule_data: QualityRuleCreate,
|
||||
db: Session = Depends(get_db),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
创建数据质量监控规则
|
||||
"""
|
||||
try:
|
||||
# TODO: 实现规则创建
|
||||
|
||||
return {
|
||||
"status": "success",
|
||||
"message": "监控规则创建成功",
|
||||
"rule": rule_data.model_dump()
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 创建监控规则失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"创建监控规则失败: {str(e)}")
|
||||
|
||||
|
||||
@router.get("/rules", summary="查询监控规则列表")
|
||||
async def get_quality_rules(
|
||||
page: int = Query(1, ge=1),
|
||||
page_size: int = Query(20, ge=1, le=100),
|
||||
metric: Optional[QualityMetric] = Query(None),
|
||||
enabled: Optional[bool] = Query(None),
|
||||
db: Session = Depends(get_db),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
查询监控规则列表
|
||||
"""
|
||||
try:
|
||||
# TODO: 实现规则查询
|
||||
|
||||
return {
|
||||
"total": 0,
|
||||
"page": page,
|
||||
"page_size": page_size,
|
||||
"items": []
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 查询监控规则列表失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"查询监控规则列表失败: {str(e)}")
|
||||
|
||||
|
||||
@router.put("/rules/{rule_id}", summary="更新监控规则")
|
||||
async def update_quality_rule(
|
||||
rule_id: int,
|
||||
rule_data: QualityRuleUpdate,
|
||||
db: Session = Depends(get_db),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
更新监控规则
|
||||
"""
|
||||
try:
|
||||
# TODO: 实现规则更新
|
||||
|
||||
return {
|
||||
"status": "success",
|
||||
"message": "监控规则更新成功",
|
||||
"rule_id": rule_id
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 更新监控规则失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"更新监控规则失败: {str(e)}")
|
||||
|
||||
|
||||
@router.delete("/rules/{rule_id}", summary="删除监控规则")
|
||||
async def delete_quality_rule(
|
||||
rule_id: int,
|
||||
db: Session = Depends(get_db),
|
||||
current_user: User = Depends(get_current_user)
|
||||
):
|
||||
"""
|
||||
删除监控规则
|
||||
"""
|
||||
try:
|
||||
# TODO: 实现规则删除
|
||||
|
||||
return {
|
||||
"status": "success",
|
||||
"message": "监控规则删除成功",
|
||||
"rule_id": rule_id
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"❌ 删除监控规则失败: {e}")
|
||||
raise HTTPException(status_code=500, detail=f"删除监控规则失败: {str(e)}")
|
||||
|
||||
|
||||
# ============== 导入依赖 ==============
|
||||
|
||||
from datetime import timedelta
|
||||
import random
|
||||
@ -0,0 +1,73 @@
|
||||
"""
|
||||
期货股票数据统一平台 - 配置文件
|
||||
"""
|
||||
import os
|
||||
from functools import lru_cache
|
||||
from typing import Optional
|
||||
|
||||
from pydantic_settings import BaseSettings
|
||||
|
||||
|
||||
class Settings(BaseSettings):
|
||||
"""应用配置"""
|
||||
|
||||
# 应用基础配置
|
||||
APP_NAME: str = "金融数据中台"
|
||||
APP_VERSION: str = "2.0.0"
|
||||
DEBUG: bool = True
|
||||
API_PREFIX: str = "/api" # v2 路由使用 /api/v2/xxx
|
||||
|
||||
# 服务器配置
|
||||
HOST: str = "0.0.0.0"
|
||||
PORT: int = 8000
|
||||
|
||||
# 安全配置
|
||||
SECRET_KEY: str = "your-secret-key-change-in-production"
|
||||
ALGORITHM: str = "HS256"
|
||||
ACCESS_TOKEN_EXPIRE_MINUTES: int = 60
|
||||
REFRESH_TOKEN_EXPIRE_DAYS: int = 7
|
||||
|
||||
# 数据库配置 - TimescaleDB (时序数据)
|
||||
TIMESCALE_DB_URL: str = "postgresql://postgres:postgres@timescaledb:5432/kline_data"
|
||||
|
||||
# 数据库配置 - SQLite (配置数据)
|
||||
SQLITE_DB_PATH: str = "/app/data/config.db"
|
||||
|
||||
# Redis 配置
|
||||
REDIS_URL: str = "redis://redis:6379/0"
|
||||
REDIS_HOST: str = "redis"
|
||||
REDIS_PORT: int = 6379
|
||||
REDIS_DB: int = 0
|
||||
|
||||
# amazingData SDK 配置 - 银河证券星耀数智量化平台
|
||||
AMAZING_DATA_HOST: str = "140.206.44.234"
|
||||
AMAZING_DATA_PORT: int = 8600
|
||||
AMAZING_DATA_ACCOUNT: str = "11200008169"
|
||||
AMAZING_DATA_PASSWORD: str = "11200008169@2026"
|
||||
AMAZING_DATA_ENV: str = "production" # simulation or production
|
||||
|
||||
# 日志配置
|
||||
LOG_LEVEL: str = "INFO"
|
||||
LOG_FORMAT: str = "%(asctime)s - %(name)s - %(levelname)s - %(message)s"
|
||||
|
||||
# CORS 配置
|
||||
CORS_ORIGINS: list = ["*"]
|
||||
|
||||
# 限流配置
|
||||
RATE_LIMIT_PER_MINUTE: int = 60
|
||||
|
||||
# WebSocket 配置
|
||||
WS_HEARTBEAT_INTERVAL: int = 30
|
||||
|
||||
class Config:
|
||||
env_file = ".env"
|
||||
case_sensitive = True
|
||||
|
||||
|
||||
@lru_cache()
|
||||
def get_settings() -> Settings:
|
||||
"""获取配置单例"""
|
||||
return Settings()
|
||||
|
||||
|
||||
settings = get_settings()
|
||||
@ -0,0 +1,196 @@
|
||||
"""
|
||||
数据库初始化脚本
|
||||
"""
|
||||
import logging
|
||||
from sqlalchemy import create_engine, text
|
||||
from sqlalchemy.orm import sessionmaker
|
||||
|
||||
from app.config import settings
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
# TimescaleDB 引擎 (时序数据)
|
||||
timescale_engine = create_engine(settings.TIMESCALE_DB_URL)
|
||||
TimescaleSessionLocal = sessionmaker(
|
||||
autocommit=False, autoflush=False, bind=timescale_engine
|
||||
)
|
||||
|
||||
|
||||
# SQLite 引擎 (配置数据)
|
||||
sqlite_engine = create_engine(
|
||||
f"sqlite:///{settings.SQLITE_DB_PATH}",
|
||||
connect_args={"check_same_thread": False}
|
||||
)
|
||||
SQLiteSessionLocal = sessionmaker(
|
||||
autocommit=False, autoflush=False, bind=sqlite_engine
|
||||
)
|
||||
|
||||
|
||||
async def init_timescale_db():
|
||||
"""初始化 TimescaleDB 表结构"""
|
||||
logger.info("初始化 TimescaleDB...")
|
||||
|
||||
with timescale_engine.connect() as conn:
|
||||
# 创建 K 线数据表 (超表)
|
||||
conn.execute(text("""
|
||||
CREATE TABLE IF NOT EXISTS kline_data (
|
||||
time TIMESTAMPTZ NOT NULL,
|
||||
symbol VARCHAR(20) NOT NULL,
|
||||
period VARCHAR(10) NOT NULL,
|
||||
open NUMERIC(20, 8) NOT NULL,
|
||||
high NUMERIC(20, 8) NOT NULL,
|
||||
low NUMERIC(20, 8) NOT NULL,
|
||||
close NUMERIC(20, 8) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(30, 8) DEFAULT 0,
|
||||
open_interest BIGINT DEFAULT 0,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
"""))
|
||||
|
||||
# 转换为 hypertable (TimescaleDB 特性)
|
||||
conn.execute(text("""
|
||||
SELECT create_hypertable('kline_data', 'time', if_not_exists => TRUE)
|
||||
"""))
|
||||
|
||||
# 创建索引
|
||||
conn.execute(text("""
|
||||
CREATE INDEX IF NOT EXISTS idx_kline_symbol_period
|
||||
ON kline_data (symbol, period, time DESC)
|
||||
"""))
|
||||
|
||||
# 创建实时行情表
|
||||
conn.execute(text("""
|
||||
CREATE TABLE IF NOT EXISTS realtime_quotes (
|
||||
time TIMESTAMPTZ NOT NULL DEFAULT NOW(),
|
||||
symbol VARCHAR(20) NOT NULL,
|
||||
last_price NUMERIC(20, 8) NOT NULL,
|
||||
open_price NUMERIC(20, 8),
|
||||
high_price NUMERIC(20, 8),
|
||||
low_price NUMERIC(20, 8),
|
||||
prev_close NUMERIC(20, 8),
|
||||
volume BIGINT,
|
||||
amount NUMERIC(30, 8),
|
||||
bid_price_1 NUMERIC(20, 8),
|
||||
bid_volume_1 BIGINT,
|
||||
ask_price_1 NUMERIC(20, 8),
|
||||
ask_volume_1 BIGINT,
|
||||
position BIGINT DEFAULT 0
|
||||
)
|
||||
"""))
|
||||
|
||||
conn.execute(text("""
|
||||
SELECT create_hypertable('realtime_quotes', 'time', if_not_exists => TRUE)
|
||||
"""))
|
||||
|
||||
conn.execute(text("""
|
||||
CREATE INDEX IF NOT EXISTS idx_realtime_symbol
|
||||
ON realtime_quotes (symbol, time DESC)
|
||||
"""))
|
||||
|
||||
conn.commit()
|
||||
|
||||
logger.info("TimescaleDB 初始化完成")
|
||||
|
||||
|
||||
async def init_sqlite_db():
|
||||
"""初始化 SQLite 表结构"""
|
||||
logger.info("初始化 SQLite...")
|
||||
|
||||
with sqlite_engine.connect() as conn:
|
||||
# 创建用户表
|
||||
conn.execute(text("""
|
||||
CREATE TABLE IF NOT EXISTS users (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
username VARCHAR(50) UNIQUE NOT NULL,
|
||||
password_hash VARCHAR(255) NOT NULL,
|
||||
email VARCHAR(100),
|
||||
role VARCHAR(20) DEFAULT 'user',
|
||||
is_active BOOLEAN DEFAULT 1,
|
||||
created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
||||
updated_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP
|
||||
)
|
||||
"""))
|
||||
|
||||
# 创建 API Key 表
|
||||
conn.execute(text("""
|
||||
CREATE TABLE IF NOT EXISTS api_keys (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
user_id INTEGER NOT NULL,
|
||||
key_hash VARCHAR(255) UNIQUE NOT NULL,
|
||||
name VARCHAR(100),
|
||||
permissions TEXT,
|
||||
expires_at TIMESTAMP,
|
||||
is_active BOOLEAN DEFAULT 1,
|
||||
created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
||||
last_used_at TIMESTAMP,
|
||||
FOREIGN KEY (user_id) REFERENCES users(id)
|
||||
)
|
||||
"""))
|
||||
|
||||
# 创建告警配置表
|
||||
conn.execute(text("""
|
||||
CREATE TABLE IF NOT EXISTS alerts (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
user_id INTEGER NOT NULL,
|
||||
symbol VARCHAR(20) NOT NULL,
|
||||
condition_type VARCHAR(20) NOT NULL,
|
||||
condition_value NUMERIC(20, 8) NOT NULL,
|
||||
alert_type VARCHAR(20) DEFAULT 'price',
|
||||
status VARCHAR(20) DEFAULT 'active',
|
||||
triggered_at TIMESTAMP,
|
||||
created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
||||
updated_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
||||
FOREIGN KEY (user_id) REFERENCES users(id)
|
||||
)
|
||||
"""))
|
||||
|
||||
# 创建订阅配置表
|
||||
conn.execute(text("""
|
||||
CREATE TABLE IF NOT EXISTS subscriptions (
|
||||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||||
user_id INTEGER NOT NULL,
|
||||
symbol VARCHAR(20) NOT NULL,
|
||||
period VARCHAR(10),
|
||||
subscription_type VARCHAR(20) DEFAULT 'kline',
|
||||
is_active BOOLEAN DEFAULT 1,
|
||||
created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
||||
FOREIGN KEY (user_id) REFERENCES users(id)
|
||||
)
|
||||
"""))
|
||||
|
||||
# 创建默认管理员用户
|
||||
conn.execute(text("""
|
||||
INSERT OR IGNORE INTO users (username, password_hash, email, role)
|
||||
VALUES ('admin', 'pbkdf2:sha256:260000$defaultsalt$defaultHash', 'admin@example.com', 'admin')
|
||||
"""))
|
||||
|
||||
conn.commit()
|
||||
|
||||
logger.info("SQLite 初始化完成")
|
||||
|
||||
|
||||
async def init_databases():
|
||||
"""初始化所有数据库"""
|
||||
await init_timescale_db()
|
||||
await init_sqlite_db()
|
||||
|
||||
|
||||
# 依赖注入函数
|
||||
def get_timescale_db():
|
||||
"""获取 TimescaleDB 会话"""
|
||||
db = TimescaleSessionLocal()
|
||||
try:
|
||||
yield db
|
||||
finally:
|
||||
db.close()
|
||||
|
||||
|
||||
def get_sqlite_db():
|
||||
"""获取 SQLite 会话"""
|
||||
db = SQLiteSessionLocal()
|
||||
try:
|
||||
yield db
|
||||
finally:
|
||||
db.close()
|
||||
@ -0,0 +1,176 @@
|
||||
# backend/app/db/migrations_v2_1.py
|
||||
"""
|
||||
v2.1 数据库迁移脚本
|
||||
创建告警、订阅、质量监控相关表
|
||||
"""
|
||||
|
||||
from alembic import op
|
||||
import sqlalchemy as sa
|
||||
from sqlalchemy.dialects.postgresql import JSONB
|
||||
|
||||
# revision identifiers
|
||||
revision = 'v2.1.0'
|
||||
down_revision = 'v2.0.0'
|
||||
branch_labels = None
|
||||
depends_on = None
|
||||
|
||||
|
||||
def upgrade():
|
||||
"""升级数据库"""
|
||||
|
||||
# 1. 告警规则表
|
||||
op.create_table(
|
||||
'alert_rule',
|
||||
sa.Column('id', sa.Integer(), primary_key=True, autoincrement=True),
|
||||
sa.Column('user_id', sa.Integer(), nullable=False),
|
||||
sa.Column('name', sa.String(100), nullable=False, comment='告警名称'),
|
||||
sa.Column('symbol', sa.String(20), nullable=False, comment='品种代码'),
|
||||
sa.Column('type', sa.String(20), nullable=False, comment='告警类型: price/change_percent/technical/volume'),
|
||||
sa.Column('condition', JSONB(), nullable=False, comment='触发条件: {"field": "price", "operator": "gt", "value": 3900}'),
|
||||
sa.Column('channels', JSONB(), nullable=False, comment='通知渠道: ["站内消息", "邮件"]'),
|
||||
sa.Column('enabled', sa.Boolean(), default=True, comment='是否启用'),
|
||||
sa.Column('start_time', sa.Time(), nullable=True, comment='生效开始时间'),
|
||||
sa.Column('end_time', sa.Time(), nullable=True, comment='生效结束时间'),
|
||||
sa.Column('repeat_interval', sa.Integer(), default=0, comment='重复间隔(秒), 0表示仅触发一次'),
|
||||
sa.Column('last_triggered_at', sa.TIMESTAMP(timezone=True), nullable=True, comment='上次触发时间'),
|
||||
sa.Column('trigger_count', sa.Integer(), default=0, comment='触发次数'),
|
||||
sa.Column('created_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now()),
|
||||
sa.Column('updated_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now(), onupdate=sa.func.now()),
|
||||
comment='告警规则表'
|
||||
)
|
||||
|
||||
# 创建索引
|
||||
op.create_index('idx_alert_rule_user', 'alert_rule', ['user_id'])
|
||||
op.create_index('idx_alert_rule_symbol', 'alert_rule', ['symbol'])
|
||||
op.create_index('idx_alert_rule_enabled', 'alert_rule', ['enabled'])
|
||||
op.create_index('idx_alert_rule_type', 'alert_rule', ['type'])
|
||||
|
||||
# 2. 告警历史表
|
||||
op.create_table(
|
||||
'alert_history',
|
||||
sa.Column('id', sa.Integer(), primary_key=True, autoincrement=True),
|
||||
sa.Column('rule_id', sa.Integer(), sa.ForeignKey('alert_rule.id', ondelete='CASCADE'), nullable=False),
|
||||
sa.Column('user_id', sa.Integer(), nullable=False),
|
||||
sa.Column('symbol', sa.String(20), nullable=False),
|
||||
sa.Column('trigger_value', sa.Numeric(20, 4), nullable=True, comment='触发时的值'),
|
||||
sa.Column('trigger_condition', sa.Text(), nullable=True, comment='触发条件描述'),
|
||||
sa.Column('notified', sa.Boolean(), default=False, comment='是否已发送通知'),
|
||||
sa.Column('notify_channels', JSONB(), nullable=True, comment='已发送的通知渠道'),
|
||||
sa.Column('notify_time', sa.TIMESTAMP(timezone=True), nullable=True, comment='通知发送时间'),
|
||||
sa.Column('trigger_time', sa.TIMESTAMP(timezone=True), server_default=sa.func.now(), comment='触发时间'),
|
||||
sa.Column('created_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now()),
|
||||
comment='告警历史表'
|
||||
)
|
||||
|
||||
op.create_index('idx_alert_history_rule', 'alert_history', ['rule_id'])
|
||||
op.create_index('idx_alert_history_user', 'alert_history', ['user_id'])
|
||||
op.create_index('idx_alert_history_time', 'alert_history', ['trigger_time'])
|
||||
op.create_index('idx_alert_history_symbol', 'alert_history', ['symbol'])
|
||||
|
||||
# 3. 数据订阅表
|
||||
op.create_table(
|
||||
'subscription',
|
||||
sa.Column('id', sa.Integer(), primary_key=True, autoincrement=True),
|
||||
sa.Column('user_id', sa.Integer(), nullable=False),
|
||||
sa.Column('name', sa.String(100), nullable=True, comment='订阅名称'),
|
||||
sa.Column('topics', JSONB(), nullable=False, comment='订阅主题: ["kline.update.IF2406.1m"]'),
|
||||
sa.Column('callback_url', sa.String(500), nullable=True, comment='回调地址'),
|
||||
sa.Column('callback_method', sa.String(10), default='POST', comment='回调方法'),
|
||||
sa.Column('callback_headers', JSONB(), nullable=True, comment='回调请求头'),
|
||||
sa.Column('enabled', sa.Boolean(), default=True, comment='是否启用'),
|
||||
sa.Column('status', sa.String(20), default='active', comment='状态: active/paused/error'),
|
||||
sa.Column('last_callback_time', sa.TIMESTAMP(timezone=True), nullable=True, comment='上次回调时间'),
|
||||
sa.Column('last_callback_status', sa.String(20), nullable=True, comment='上次回调状态'),
|
||||
sa.Column('callback_count', sa.Integer(), default=0, comment='回调次数'),
|
||||
sa.Column('error_count', sa.Integer(), default=0, comment='错误次数'),
|
||||
sa.Column('created_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now()),
|
||||
sa.Column('updated_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now(), onupdate=sa.func.now()),
|
||||
comment='数据订阅表'
|
||||
)
|
||||
|
||||
op.create_index('idx_subscription_user', 'subscription', ['user_id'])
|
||||
op.create_index('idx_subscription_status', 'subscription', ['status'])
|
||||
op.create_index('idx_subscription_enabled', 'subscription', ['enabled'])
|
||||
|
||||
# 4. 数据质量规则表
|
||||
op.create_table(
|
||||
'quality_rule',
|
||||
sa.Column('id', sa.Integer(), primary_key=True, autoincrement=True),
|
||||
sa.Column('name', sa.String(100), nullable=False, comment='规则名称'),
|
||||
sa.Column('symbol', sa.String(20), nullable=True, comment='品种代码, 为空表示全局规则'),
|
||||
sa.Column('metric', sa.String(50), nullable=False, comment='监控指标: completeness/accuracy/timeliness/consistency'),
|
||||
sa.Column('condition', sa.Text(), nullable=False, comment='条件表达式'),
|
||||
sa.Column('threshold', sa.Numeric(5, 2), nullable=False, comment='阈值'),
|
||||
sa.Column('level', sa.String(20), default='warning', comment='告警级别: info/warning/critical'),
|
||||
sa.Column('enabled', sa.Boolean(), default=True, comment='是否启用'),
|
||||
sa.Column('description', sa.Text(), nullable=True, comment='规则描述'),
|
||||
sa.Column('created_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now()),
|
||||
sa.Column('updated_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now(), onupdate=sa.func.now()),
|
||||
comment='数据质量规则表'
|
||||
)
|
||||
|
||||
op.create_index('idx_quality_rule_metric', 'quality_rule', ['metric'])
|
||||
op.create_index('idx_quality_rule_enabled', 'quality_rule', ['enabled'])
|
||||
op.create_index('idx_quality_rule_symbol', 'quality_rule', ['symbol'])
|
||||
|
||||
# 5. 数据质量日志表
|
||||
op.create_table(
|
||||
'quality_log',
|
||||
sa.Column('id', sa.Integer(), primary_key=True, autoincrement=True),
|
||||
sa.Column('rule_id', sa.Integer(), sa.ForeignKey('quality_rule.id', ondelete='SET NULL'), nullable=True),
|
||||
sa.Column('symbol', sa.String(20), nullable=True, comment='品种代码'),
|
||||
sa.Column('metric', sa.String(50), nullable=False, comment='监控指标'),
|
||||
sa.Column('metric_value', sa.Numeric(10, 4), nullable=True, comment='指标值'),
|
||||
sa.Column('threshold', sa.Numeric(5, 2), nullable=True, comment='阈值'),
|
||||
sa.Column('level', sa.String(20), nullable=False, comment='告警级别'),
|
||||
sa.Column('triggered', sa.Boolean(), default=False, comment='是否触发告警'),
|
||||
sa.Column('message', sa.Text(), nullable=True, comment='详细信息'),
|
||||
sa.Column('details', JSONB(), nullable=True, comment='详细信息'),
|
||||
sa.Column('created_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now()),
|
||||
comment='数据质量日志表'
|
||||
)
|
||||
|
||||
op.create_index('idx_quality_log_rule', 'quality_log', ['rule_id'])
|
||||
op.create_index('idx_quality_log_time', 'quality_log', ['created_at'])
|
||||
op.create_index('idx_quality_log_symbol', 'quality_log', ['symbol'])
|
||||
op.create_index('idx_quality_log_metric', 'quality_log', ['metric'])
|
||||
|
||||
# 6. WebSocket 连接表（用于统计和监控）
|
||||
op.create_table(
|
||||
'websocket_connection',
|
||||
sa.Column('id', sa.Integer(), primary_key=True, autoincrement=True),
|
||||
sa.Column('user_id', sa.Integer(), nullable=False),
|
||||
sa.Column('connection_id', sa.String(100), nullable=False, unique=True, comment='连接ID'),
|
||||
sa.Column('client_ip', sa.String(50), nullable=True, comment='客户端IP'),
|
||||
sa.Column('user_agent', sa.String(500), nullable=True, comment='用户代理'),
|
||||
sa.Column('connected_at', sa.TIMESTAMP(timezone=True), server_default=sa.func.now(), comment='连接时间'),
|
||||
sa.Column('disconnected_at', sa.TIMESTAMP(timezone=True), nullable=True, comment='断开时间'),
|
||||
sa.Column('last_heartbeat', sa.TIMESTAMP(timezone=True), server_default=sa.func.now(), comment='最后心跳'),
|
||||
sa.Column('subscriptions', JSONB(), nullable=True, comment='订阅列表'),
|
||||
sa.Column('message_count', sa.Integer(), default=0, comment='消息数量'),
|
||||
sa.Column('status', sa.String(20), default='connected', comment='状态: connected/disconnected'),
|
||||
comment='WebSocket连接表'
|
||||
)
|
||||
|
||||
op.create_index('idx_ws_connection_user', 'websocket_connection', ['user_id'])
|
||||
op.create_index('idx_ws_connection_status', 'websocket_connection', ['status'])
|
||||
op.create_index('idx_ws_connection_connected', 'websocket_connection', ['connected_at'])
|
||||
|
||||
print("✅ v2.1 数据库迁移完成")
|
||||
print("创建表: alert_rule, alert_history, subscription, quality_rule, quality_log, websocket_connection")
|
||||
|
||||
|
||||
def downgrade():
|
||||
"""回滚数据库"""
|
||||
op.drop_table('quality_log')
|
||||
op.drop_table('quality_rule')
|
||||
op.drop_table('subscription')
|
||||
op.drop_table('alert_history')
|
||||
op.drop_table('alert_rule')
|
||||
op.drop_table('websocket_connection')
|
||||
print("✅ v2.1 数据库回滚完成")
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
# 直接运行时执行迁移
|
||||
upgrade()
|
||||
@ -0,0 +1,569 @@
|
||||
"""
|
||||
数据库迁移脚本 v2.2
|
||||
创建股票/期货 K 线表结构 (TimescaleDB)
|
||||
"""
|
||||
import logging
|
||||
from datetime import datetime
|
||||
from sqlalchemy import text, create_engine
|
||||
from sqlalchemy.orm import sessionmaker
|
||||
|
||||
from app.config import settings
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
# TimescaleDB 连接
|
||||
engine = create_engine(settings.TIMESCALE_DB_URL)
|
||||
SessionLocal = sessionmaker(autocommit=False, autoflush=False, bind=engine)
|
||||
|
||||
|
||||
# ==================== 股票 K 线表 ====================
|
||||
|
||||
STOCK_KLINE_TABLES = {
|
||||
"stock_klines_1m": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_1m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
is_limit_up BOOLEAN DEFAULT FALSE,
|
||||
is_limit_down BOOLEAN DEFAULT FALSE,
|
||||
total_market_cap NUMERIC(20, 2),
|
||||
float_market_cap NUMERIC(20, 2),
|
||||
inst_holding_ratio NUMERIC(5, 2),
|
||||
trading_days INTEGER,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_5m": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_5m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_15m": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_15m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_30m": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_30m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_1h": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_1h (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_1d": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_1d (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
is_limit_up BOOLEAN DEFAULT FALSE,
|
||||
is_limit_down BOOLEAN DEFAULT FALSE,
|
||||
total_market_cap NUMERIC(20, 2),
|
||||
float_market_cap NUMERIC(20, 2),
|
||||
inst_holding_ratio NUMERIC(5, 2),
|
||||
trading_days INTEGER,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_1w": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_1w (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"stock_klines_1month": """
|
||||
CREATE TABLE IF NOT EXISTS stock_klines_1month (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
amount NUMERIC(20, 4) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
# ==================== 期货 K 线表 ====================
|
||||
|
||||
FUTURES_KLINE_TABLES = {
|
||||
"futures_klines_1m": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_1m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_5m": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_5m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_15m": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_15m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_30m": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_30m (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_1h": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_1h (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_1d": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_1d (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_1w": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_1w (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
"futures_klines_1month": """
|
||||
CREATE TABLE IF NOT EXISTS futures_klines_1month (
|
||||
id BIGSERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ts TIMESTAMPTZ NOT NULL,
|
||||
open NUMERIC(18, 4) NOT NULL,
|
||||
high NUMERIC(18, 4) NOT NULL,
|
||||
low NUMERIC(18, 4) NOT NULL,
|
||||
close NUMERIC(18, 4) NOT NULL,
|
||||
volume BIGINT NOT NULL,
|
||||
open_interest BIGINT NOT NULL,
|
||||
settlement_price NUMERIC(18, 4),
|
||||
trade_date DATE NOT NULL,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
# ==================== 辅助表 ====================
|
||||
|
||||
AUXILIARY_TABLES = {
|
||||
# 股票基本信息表
|
||||
"stock_symbols": """
|
||||
CREATE TABLE IF NOT EXISTS stock_symbols (
|
||||
id SERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL UNIQUE,
|
||||
symbol_name VARCHAR(50) NOT NULL,
|
||||
exchange VARCHAR(10) NOT NULL,
|
||||
industry VARCHAR(50),
|
||||
list_date DATE,
|
||||
is_active BOOLEAN DEFAULT TRUE,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
|
||||
# 股票复权因子表
|
||||
"stock_adjust_factors": """
|
||||
CREATE TABLE IF NOT EXISTS stock_adjust_factors (
|
||||
id SERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL,
|
||||
ex_date DATE NOT NULL,
|
||||
adjust_factor NUMERIC(10, 4) NOT NULL,
|
||||
dividend_ratio NUMERIC(10, 4) DEFAULT 0,
|
||||
split_ratio NUMERIC(10, 4) DEFAULT 1,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
UNIQUE(symbol_id, ex_date)
|
||||
)
|
||||
""",
|
||||
|
||||
# 期货品种信息表
|
||||
"futures_products": """
|
||||
CREATE TABLE IF NOT EXISTS futures_products (
|
||||
id SERIAL PRIMARY KEY,
|
||||
product_code VARCHAR(10) NOT NULL UNIQUE,
|
||||
product_name VARCHAR(50) NOT NULL,
|
||||
exchange VARCHAR(10) NOT NULL,
|
||||
product_type VARCHAR(20),
|
||||
multiplier NUMERIC(10, 2) NOT NULL,
|
||||
min_price_tick NUMERIC(10, 4) NOT NULL,
|
||||
is_active BOOLEAN DEFAULT TRUE,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
|
||||
# 期货合约信息表
|
||||
"futures_contracts": """
|
||||
CREATE TABLE IF NOT EXISTS futures_contracts (
|
||||
id SERIAL PRIMARY KEY,
|
||||
symbol_id VARCHAR(20) NOT NULL UNIQUE,
|
||||
product_code VARCHAR(10) NOT NULL,
|
||||
contract_month VARCHAR(6) NOT NULL,
|
||||
exchange VARCHAR(10) NOT NULL,
|
||||
list_date DATE,
|
||||
last_trade_date DATE,
|
||||
delivery_date DATE,
|
||||
is_main BOOLEAN DEFAULT FALSE,
|
||||
is_active BOOLEAN DEFAULT TRUE,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW(),
|
||||
updated_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
|
||||
# 交易日历表
|
||||
"trading_calendar": """
|
||||
CREATE TABLE IF NOT EXISTS trading_calendar (
|
||||
id SERIAL PRIMARY KEY,
|
||||
exchange VARCHAR(10) NOT NULL,
|
||||
trade_date DATE NOT NULL,
|
||||
is_trading_day BOOLEAN NOT NULL,
|
||||
pre_trade_date DATE,
|
||||
next_trade_date DATE,
|
||||
UNIQUE(exchange, trade_date)
|
||||
)
|
||||
""",
|
||||
|
||||
# API Key 存储表（认证增强）
|
||||
"api_keys": """
|
||||
CREATE TABLE IF NOT EXISTS api_keys (
|
||||
id SERIAL PRIMARY KEY,
|
||||
api_key VARCHAR(64) NOT NULL UNIQUE,
|
||||
user_id INTEGER,
|
||||
name VARCHAR(100),
|
||||
permissions VARCHAR(100),
|
||||
expires_at TIMESTAMPTZ,
|
||||
is_active BOOLEAN DEFAULT TRUE,
|
||||
last_used_at TIMESTAMPTZ,
|
||||
created_at TIMESTAMPTZ DEFAULT NOW()
|
||||
)
|
||||
""",
|
||||
}
|
||||
|
||||
|
||||
# ==================== 索引定义 ====================
|
||||
|
||||
INDEX_DEFINITIONS = """
|
||||
-- 股票 K 线索引
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_1m_symbol_ts ON stock_klines_1m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_5m_symbol_ts ON stock_klines_5m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_15m_symbol_ts ON stock_klines_15m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_30m_symbol_ts ON stock_klines_30m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_1h_symbol_ts ON stock_klines_1h(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_1d_symbol_ts ON stock_klines_1d(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_1w_symbol_ts ON stock_klines_1w(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_klines_1month_symbol_ts ON stock_klines_1month(symbol_id, ts DESC);
|
||||
|
||||
-- 期货 K 线索引
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_1m_symbol_ts ON futures_klines_1m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_5m_symbol_ts ON futures_klines_5m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_15m_symbol_ts ON futures_klines_15m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_30m_symbol_ts ON futures_klines_30m(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_1h_symbol_ts ON futures_klines_1h(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_1d_symbol_ts ON futures_klines_1d(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_1w_symbol_ts ON futures_klines_1w(symbol_id, ts DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_klines_1month_symbol_ts ON futures_klines_1month(symbol_id, ts DESC);
|
||||
|
||||
-- 辅助表索引
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_symbols_exchange ON stock_symbols(exchange);
|
||||
CREATE INDEX IF NOT EXISTS idx_stock_adjust_factors_symbol_date ON stock_adjust_factors(symbol_id, ex_date DESC);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_products_exchange ON futures_products(exchange);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_contracts_product ON futures_contracts(product_code);
|
||||
CREATE INDEX IF NOT EXISTS idx_futures_contracts_main ON futures_contracts(product_code, is_main) WHERE is_main = TRUE;
|
||||
CREATE INDEX IF NOT EXISTS idx_trading_calendar_date ON trading_calendar(exchange, trade_date);
|
||||
"""
|
||||
|
||||
|
||||
# ==================== TimescaleDB Hypertable 转换 ====================
|
||||
|
||||
HYPERTABLE_DEFINITIONS = """
|
||||
-- 股票 K 线超表转换
|
||||
SELECT create_hypertable('stock_klines_1m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_5m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_15m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_30m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_1h', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_1d', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_1w', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('stock_klines_1month', 'ts', if_not_exists => TRUE);
|
||||
|
||||
-- 期货 K 线超表转换
|
||||
SELECT create_hypertable('futures_klines_1m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_5m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_15m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_30m', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_1h', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_1d', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_1w', 'ts', if_not_exists => TRUE);
|
||||
SELECT create_hypertable('futures_klines_1month', 'ts', if_not_exists => TRUE);
|
||||
"""
|
||||
|
||||
|
||||
async def run_migration_v2_2():
|
||||
"""
|
||||
执行 v2.2 数据库迁移
|
||||
|
||||
创建所有必要的表结构、索引和 TimescaleDB 超表
|
||||
"""
|
||||
logger.info("=" * 60)
|
||||
logger.info("开始 v2.2 数据库迁移...")
|
||||
logger.info("=" * 60)
|
||||
|
||||
db = SessionLocal()
|
||||
|
||||
try:
|
||||
# 1. 创建股票 K 线表
|
||||
logger.info("\n[1/5] 创建股票 K 线表...")
|
||||
for table_name, create_sql in STOCK_KLINE_TABLES.items():
|
||||
logger.info(f" 创建表: {table_name}")
|
||||
db.execute(text(create_sql))
|
||||
db.commit()
|
||||
logger.info(f" ✅ 完成 {len(STOCK_KLINE_TABLES)} 个股票 K 线表")
|
||||
|
||||
# 2. 创建期货 K 线表
|
||||
logger.info("\n[2/5] 创建期货 K 线表...")
|
||||
for table_name, create_sql in FUTURES_KLINE_TABLES.items():
|
||||
logger.info(f" 创建表: {table_name}")
|
||||
db.execute(text(create_sql))
|
||||
db.commit()
|
||||
logger.info(f" ✅ 完成 {len(FUTURES_KLINE_TABLES)} 个期货 K 线表")
|
||||
|
||||
# 3. 创建辅助表
|
||||
logger.info("\n[3/5] 创建辅助表...")
|
||||
for table_name, create_sql in AUXILIARY_TABLES.items():
|
||||
logger.info(f" 创建表: {table_name}")
|
||||
db.execute(text(create_sql))
|
||||
db.commit()
|
||||
logger.info(f" ✅ 完成 {len(AUXILIARY_TABLES)} 个辅助表")
|
||||
|
||||
# 4. 创建索引
|
||||
logger.info("\n[4/5] 创建索引...")
|
||||
db.execute(text(INDEX_DEFINITIONS))
|
||||
db.commit()
|
||||
logger.info(" ✅ 完成所有索引创建")
|
||||
|
||||
# 5. 转换为 TimescaleDB 超表
|
||||
logger.info("\n[5/5] 转换 TimescaleDB 超表...")
|
||||
db.execute(text(HYPERTABLE_DEFINITIONS))
|
||||
db.commit()
|
||||
logger.info(" ✅ 完成超表转换")
|
||||
|
||||
logger.info("\n" + "=" * 60)
|
||||
logger.info("✅ v2.2 数据库迁移完成!")
|
||||
logger.info("=" * 60)
|
||||
|
||||
# 返回迁移统计
|
||||
return {
|
||||
"version": "2.2",
|
||||
"status": "success",
|
||||
"tables_created": len(STOCK_KLINE_TABLES) + len(FUTURES_KLINE_TABLES) + len(AUXILIARY_TABLES),
|
||||
"stock_kline_tables": list(STOCK_KLINE_TABLES.keys()),
|
||||
"futures_kline_tables": list(FUTURES_KLINE_TABLES.keys()),
|
||||
"auxiliary_tables": list(AUXILIARY_TABLES.keys()),
|
||||
"migration_time": datetime.now().isoformat()
|
||||
}
|
||||
|
||||
except Exception as e:
|
||||
db.rollback()
|
||||
logger.error(f"❌ 数据库迁移失败: {e}")
|
||||
raise e
|
||||
finally:
|
||||
db.close()
|
||||
|
||||
|
||||
def check_migration_status():
|
||||
"""
|
||||
检查迁移状态
|
||||
|
||||
Returns:
|
||||
dict: 各表是否存在的状态
|
||||
"""
|
||||
db = SessionLocal()
|
||||
status = {}
|
||||
|
||||
try:
|
||||
all_tables = (
|
||||
list(STOCK_KLINE_TABLES.keys()) +
|
||||
list(FUTURES_KLINE_TABLES.keys()) +
|
||||
list(AUXILIARY_TABLES.keys())
|
||||
)
|
||||
|
||||
for table_name in all_tables:
|
||||
result = db.execute(text(f"""
|
||||
SELECT EXISTS (
|
||||
SELECT FROM information_schema.tables
|
||||
WHERE table_name = '{table_name}'
|
||||
)
|
||||
""")).first()
|
||||
status[table_name] = result[0] if result else False
|
||||
|
||||
return status
|
||||
|
||||
finally:
|
||||
db.close()
|
||||
|
||||
|
||||
# 命令行执行入口
|
||||
if __name__ == "__main__":
|
||||
import asyncio
|
||||
asyncio.run(run_migration_v2_2())
|
||||
@ -0,0 +1,67 @@
|
||||
"""
|
||||
限流中间件
|
||||
"""
|
||||
import logging
|
||||
import time
|
||||
from collections import defaultdict
|
||||
|
||||
from fastapi import Request, status
|
||||
from fastapi.responses import JSONResponse
|
||||
from starlette.middleware.base import BaseHTTPMiddleware
|
||||
|
||||
from app.config import settings
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
class RateLimitMiddleware(BaseHTTPMiddleware):
|
||||
"""简单的内存限流中间件"""
|
||||
|
||||
def __init__(self, app):
|
||||
super().__init__(app)
|
||||
self.requests: dict = defaultdict(list)
|
||||
self.limit = settings.RATE_LIMIT_PER_MINUTE
|
||||
self.window = 60 # 1 分钟窗口
|
||||
|
||||
async def dispatch(self, request: Request, call_next):
|
||||
# 获取客户端 IP
|
||||
client_ip = request.client.host if request.client else "unknown"
|
||||
|
||||
# 跳过限流的路径
|
||||
skip_paths = ["/health", "/docs", "/redoc", "/openapi.json"]
|
||||
if any(request.url.path.startswith(path) for path in skip_paths):
|
||||
return await call_next(request)
|
||||
|
||||
current_time = time.time()
|
||||
|
||||
# 清理过期记录
|
||||
self.requests[client_ip] = [
|
||||
t for t in self.requests[client_ip]
|
||||
if current_time - t < self.window
|
||||
]
|
||||
|
||||
# 检查是否超限
|
||||
if len(self.requests[client_ip]) >= self.limit:
|
||||
logger.warning(f"Rate limit exceeded for IP: {client_ip}")
|
||||
return JSONResponse(
|
||||
status_code=status.HTTP_429_TOO_MANY_REQUESTS,
|
||||
content={
|
||||
"code": 429,
|
||||
"message": "Too many requests",
|
||||
"data": {"retry_after": self.window}
|
||||
}
|
||||
)
|
||||
|
||||
# 记录请求
|
||||
self.requests[client_ip].append(current_time)
|
||||
|
||||
# 继续处理请求
|
||||
response = await call_next(request)
|
||||
|
||||
# 添加限流头
|
||||
remaining = self.limit - len(self.requests[client_ip])
|
||||
response.headers["X-RateLimit-Limit"] = str(self.limit)
|
||||
response.headers["X-RateLimit-Remaining"] = str(remaining)
|
||||
response.headers["X-RateLimit-Reset"] = str(int(current_time + self.window))
|
||||
|
||||
return response
|
||||
@ -0,0 +1,191 @@
|
||||
# backend/app/models/alert.py
|
||||
"""
|
||||
告警规则模型
|
||||
"""
|
||||
|
||||
from sqlalchemy import Column, Integer, String, Boolean, Time, TIMESTAMP, Numeric, Text, ForeignKey
|
||||
from sqlalchemy.dialects.postgresql import JSONB
|
||||
from sqlalchemy.orm import relationship
|
||||
from sqlalchemy.sql import func
|
||||
from app.db.base import Base
|
||||
from datetime import datetime, time as dt_time
|
||||
from typing import Optional, List
|
||||
from pydantic import BaseModel, Field
|
||||
from enum import Enum
|
||||
|
||||
|
||||
class AlertType(str, Enum):
|
||||
"""告警类型"""
|
||||
PRICE = "price" # 价格告警
|
||||
CHANGE_PERCENT = "change_percent" # 涨跌幅告警
|
||||
TECHNICAL = "technical" # 技术指标告警
|
||||
VOLUME = "volume" # 成交量告警
|
||||
|
||||
|
||||
class AlertOperator(str, Enum):
|
||||
"""告警操作符"""
|
||||
GT = "gt" # 大于
|
||||
LT = "lt" # 小于
|
||||
EQ = "eq" # 等于
|
||||
GE = "ge" # 大于等于
|
||||
LE = "le" # 小于等于
|
||||
NE = "ne" # 不等于
|
||||
|
||||
|
||||
class NotifyChannel(str, Enum):
|
||||
"""通知渠道"""
|
||||
IN_APP = "站内消息"
|
||||
EMAIL = "邮件"
|
||||
SMS = "短信"
|
||||
WECHAT = "企业微信"
|
||||
DINGTALK = "钉钉"
|
||||
|
||||
|
||||
class AlertRule(Base):
|
||||
"""告警规则表"""
|
||||
__tablename__ = "alert_rule"
|
||||
|
||||
id = Column(Integer, primary_key=True, autoincrement=True)
|
||||
user_id = Column(Integer, nullable=False, index=True)
|
||||
name = Column(String(100), nullable=False, comment="告警名称")
|
||||
symbol = Column(String(20), nullable=False, index=True, comment="品种代码")
|
||||
type = Column(String(20), nullable=False, index=True, comment="告警类型")
|
||||
condition = Column(JSONB, nullable=False, comment="触发条件")
|
||||
channels = Column(JSONB, nullable=False, comment="通知渠道")
|
||||
enabled = Column(Boolean, default=True, index=True, comment="是否启用")
|
||||
start_time = Column(Time, nullable=True, comment="生效开始时间")
|
||||
end_time = Column(Time, nullable=True, comment="生效结束时间")
|
||||
repeat_interval = Column(Integer, default=0, comment="重复间隔(秒)")
|
||||
last_triggered_at = Column(TIMESTAMP(timezone=True), nullable=True, comment="上次触发时间")
|
||||
trigger_count = Column(Integer, default=0, comment="触发次数")
|
||||
created_at = Column(TIMESTAMP(timezone=True), server_default=func.now())
|
||||
updated_at = Column(TIMESTAMP(timezone=True), server_default=func.now(), onupdate=func.now())
|
||||
|
||||
# 关系
|
||||
history = relationship("AlertHistory", back_populates="rule", cascade="all, delete-orphan")
|
||||
|
||||
def __repr__(self):
|
||||
return f"<AlertRule(id={self.id}, name='{self.name}', symbol='{self.symbol}', type='{self.type}')>"
|
||||
|
||||
|
||||
class AlertHistory(Base):
|
||||
"""告警历史表"""
|
||||
__tablename__ = "alert_history"
|
||||
|
||||
id = Column(Integer, primary_key=True, autoincrement=True)
|
||||
rule_id = Column(Integer, ForeignKey("alert_rule.id", ondelete="CASCADE"), nullable=False, index=True)
|
||||
user_id = Column(Integer, nullable=False, index=True)
|
||||
symbol = Column(String(20), nullable=False, index=True)
|
||||
trigger_value = Column(Numeric(20, 4), nullable=True, comment="触发时的值")
|
||||
trigger_condition = Column(Text, nullable=True, comment="触发条件描述")
|
||||
notified = Column(Boolean, default=False, comment="是否已发送通知")
|
||||
notify_channels = Column(JSONB, nullable=True, comment="已发送的通知渠道")
|
||||
notify_time = Column(TIMESTAMP(timezone=True), nullable=True, comment="通知发送时间")
|
||||
trigger_time = Column(TIMESTAMP(timezone=True), server_default=func.now(), index=True, comment="触发时间")
|
||||
created_at = Column(TIMESTAMP(timezone=True), server_default=func.now())
|
||||
|
||||
# 关系
|
||||
rule = relationship("AlertRule", back_populates="history")
|
||||
|
||||
def __repr__(self):
|
||||
return f"<AlertHistory(id={self.id}, rule_id={self.rule_id}, trigger_time='{self.trigger_time}')>"
|
||||
|
||||
|
||||
# ============== Pydantic Schema ==============
|
||||
|
||||
class AlertConditionSchema(BaseModel):
|
||||
"""告警条件 Schema"""
|
||||
field: str = Field(..., description="字段名: price/change_percent/volume")
|
||||
operator: AlertOperator = Field(..., description="操作符: gt/lt/eq/ge/le/ne")
|
||||
value: float = Field(..., description="阈值")
|
||||
|
||||
class Config:
|
||||
use_enum_values = True
|
||||
|
||||
|
||||
class AlertRuleCreate(BaseModel):
|
||||
"""创建告警规则"""
|
||||
name: str = Field(..., min_length=1, max_length=100, description="告警名称")
|
||||
symbol: str = Field(..., min_length=1, max_length=20, description="品种代码")
|
||||
type: AlertType = Field(..., description="告警类型")
|
||||
condition: AlertConditionSchema = Field(..., description="触发条件")
|
||||
channels: List[NotifyChannel] = Field(..., min_items=1, description="通知渠道")
|
||||
enabled: bool = Field(default=True, description="是否启用")
|
||||
start_time: Optional[dt_time] = Field(None, description="生效开始时间")
|
||||
end_time: Optional[dt_time] = Field(None, description="生效结束时间")
|
||||
repeat_interval: int = Field(default=0, ge=0, description="重复间隔(秒)")
|
||||
|
||||
class Config:
|
||||
use_enum_values = True
|
||||
|
||||
|
||||
class AlertRuleUpdate(BaseModel):
|
||||
"""更新告警规则"""
|
||||
name: Optional[str] = Field(None, min_length=1, max_length=100)
|
||||
symbol: Optional[str] = Field(None, min_length=1, max_length=20)
|
||||
type: Optional[AlertType] = None
|
||||
condition: Optional[AlertConditionSchema] = None
|
||||
channels: Optional[List[NotifyChannel]] = None
|
||||
enabled: Optional[bool] = None
|
||||
start_time: Optional[dt_time] = None
|
||||
end_time: Optional[dt_time] = None
|
||||
repeat_interval: Optional[int] = Field(None, ge=0)
|
||||
|
||||
class Config:
|
||||
use_enum_values = True
|
||||
|
||||
|
||||
class AlertRuleResponse(BaseModel):
|
||||
"""告警规则响应"""
|
||||
id: int
|
||||
user_id: int
|
||||
name: str
|
||||
symbol: str
|
||||
type: str
|
||||
condition: dict
|
||||
channels: list
|
||||
enabled: bool
|
||||
start_time: Optional[str]
|
||||
end_time: Optional[str]
|
||||
repeat_interval: int
|
||||
last_triggered_at: Optional[datetime]
|
||||
trigger_count: int
|
||||
created_at: datetime
|
||||
updated_at: datetime
|
||||
|
||||
class Config:
|
||||
from_attributes = True
|
||||
|
||||
|
||||
class AlertHistoryResponse(BaseModel):
|
||||
"""告警历史响应"""
|
||||
id: int
|
||||
rule_id: int
|
||||
user_id: int
|
||||
symbol: str
|
||||
trigger_value: Optional[float]
|
||||
trigger_condition: Optional[str]
|
||||
notified: bool
|
||||
notify_channels: Optional[list]
|
||||
notify_time: Optional[datetime]
|
||||
trigger_time: datetime
|
||||
created_at: datetime
|
||||
|
||||
class Config:
|
||||
from_attributes = True
|
||||
|
||||
|
||||
class AlertListResponse(BaseModel):
|
||||
"""告警列表响应"""
|
||||
total: int
|
||||
page: int
|
||||
page_size: int
|
||||
items: List[AlertRuleResponse]
|
||||
|
||||
|
||||
class AlertHistoryListResponse(BaseModel):
|
||||
"""告警历史列表响应"""
|
||||
total: int
|
||||
page: int
|
||||
page_size: int
|
||||
items: List[AlertHistoryResponse]
|
||||
@ -0,0 +1,10 @@
|
||||
"""
|
||||
K 线数据仓库模块 v2.2
|
||||
"""
|
||||
from app.repositories.kline.stock_repository import StockKLineRepository
|
||||
from app.repositories.kline.futures_repository import FuturesKLineRepository
|
||||
|
||||
__all__ = [
|
||||
"StockKLineRepository",
|
||||
"FuturesKLineRepository",
|
||||
]
|
||||
@ -0,0 +1,509 @@
|
||||
"""
|
||||
期货 K 线数据仓库 v2.2
|
||||
负责期货 K 线数据的 CRUD 操作
|
||||
"""
|
||||
import logging
|
||||
from datetime import datetime, date, timedelta
|
||||
from typing import List, Optional, Dict, Any
|
||||
from decimal import Decimal
|
||||
|
||||
from sqlalchemy import text
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.models.kline import (
|
||||
Frequency, FuturesKLineItem, FuturesKLineData,
|
||||
FuturesSymbolInfo, FuturesContractInfo
|
||||
)
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
class FuturesKLineRepository:
|
||||
"""期货 K 线数据仓库"""
|
||||
|
||||
# 表名映射（按周期）
|
||||
TABLE_MAP = {
|
||||
Frequency.FREQ_1M: "futures_klines_1m",
|
||||
Frequency.FREQ_5M: "futures_klines_5m",
|
||||
Frequency.FREQ_15M: "futures_klines_15m",
|
||||
Frequency.FREQ_30M: "futures_klines_30m",
|
||||
Frequency.FREQ_1H: "futures_klines_1h",
|
||||
Frequency.FREQ_1D: "futures_klines_1d",
|
||||
Frequency.FREQ_1W: "futures_klines_1w",
|
||||
Frequency.FREQ_1MONTH: "futures_klines_1month",
|
||||
}
|
||||
|
||||
def __init__(self, db: Session):
|
||||
self.db = db
|
||||
|
||||
def get_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime,
|
||||
limit: int = 10000
|
||||
) -> List[FuturesKLineItem]:
|
||||
"""
|
||||
查询期货 K 线数据
|
||||
|
||||
Args:
|
||||
symbol: 合约代码 (如 IF2406)
|
||||
freq: K 线周期
|
||||
start: 开始时间
|
||||
end: 结束时间
|
||||
limit: 最大返回数量
|
||||
|
||||
Returns:
|
||||
List[FuturesKLineItem]: K 线数据列表
|
||||
"""
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
logger.error(f"不支持的周期: {freq}")
|
||||
return []
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
SELECT
|
||||
symbol_id, ts, open, high, low, close, volume,
|
||||
open_interest, settlement_price, trade_date
|
||||
FROM {table_name}
|
||||
WHERE symbol_id = :symbol
|
||||
AND ts >= :start
|
||||
AND ts <= :end
|
||||
ORDER BY ts ASC
|
||||
LIMIT :limit
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"symbol": symbol,
|
||||
"start": start,
|
||||
"end": end,
|
||||
"limit": limit
|
||||
})
|
||||
|
||||
items = []
|
||||
for row in result:
|
||||
items.append(FuturesKLineItem(
|
||||
symbol=row.symbol_id,
|
||||
time=row.ts,
|
||||
open=float(row.open) if row.open else None,
|
||||
high=float(row.high) if row.high else None,
|
||||
low=float(row.low) if row.low else None,
|
||||
close=float(row.close) if row.close else None,
|
||||
volume=row.volume or 0,
|
||||
open_interest=row.open_interest or 0,
|
||||
settlement_price=float(row.settlement_price) if row.settlement_price else None,
|
||||
trade_date=row.trade_date
|
||||
))
|
||||
|
||||
logger.info(f"查询期货 K 线: {symbol} {freq.value} {len(items)} 条")
|
||||
return items
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询期货 K 线失败: {e}")
|
||||
return []
|
||||
|
||||
def get_symbol_info(self, symbol: str) -> Optional[FuturesSymbolInfo]:
|
||||
"""
|
||||
获取期货品种信息
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
|
||||
Returns:
|
||||
FuturesSymbolInfo: 品种信息
|
||||
"""
|
||||
try:
|
||||
# 解析品种代码 (如 IF2406 -> IF)
|
||||
product_code = ''.join(filter(str.isalpha, symbol))
|
||||
|
||||
sql = text("""
|
||||
SELECT
|
||||
product_code, product_name, exchange, product_type,
|
||||
multiplier, min_price_tick, is_active, created_at
|
||||
FROM futures_products
|
||||
WHERE product_code = :product_code
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {"product_code": product_code}).first()
|
||||
|
||||
if result:
|
||||
return FuturesSymbolInfo(
|
||||
symbol=product_code,
|
||||
name=result.product_name,
|
||||
exchange=result.exchange,
|
||||
product_type=result.product_type,
|
||||
multiplier=float(result.multiplier) if result.multiplier else 1.0,
|
||||
min_price_tick=float(result.min_price_tick) if result.min_price_tick else 0.01,
|
||||
is_active=result.is_active
|
||||
)
|
||||
return None
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询品种信息失败: {e}")
|
||||
return None
|
||||
|
||||
def get_contract_info(self, symbol: str) -> Optional[FuturesContractInfo]:
|
||||
"""
|
||||
获取合约信息
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
|
||||
Returns:
|
||||
FuturesContractInfo: 合约信息
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
symbol_id, product_code, contract_month, exchange,
|
||||
list_date, last_trade_date, delivery_date,
|
||||
is_active, created_at, updated_at
|
||||
FROM futures_contracts
|
||||
WHERE symbol_id = :symbol
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {"symbol": symbol}).first()
|
||||
|
||||
if result:
|
||||
return FuturesContractInfo(
|
||||
symbol=result.symbol_id,
|
||||
product_code=result.product_code,
|
||||
contract_month=result.contract_month,
|
||||
exchange=result.exchange,
|
||||
list_date=result.list_date,
|
||||
last_trade_date=result.last_trade_date,
|
||||
delivery_date=result.delivery_date,
|
||||
is_active=result.is_active
|
||||
)
|
||||
return None
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询合约信息失败: {e}")
|
||||
return None
|
||||
|
||||
def get_active_contracts(
|
||||
self,
|
||||
product_code: str,
|
||||
limit: int = 10
|
||||
) -> List[FuturesContractInfo]:
|
||||
"""
|
||||
获取活跃合约列表
|
||||
|
||||
Args:
|
||||
product_code: 品种代码 (如 IF)
|
||||
limit: 返回数量
|
||||
|
||||
Returns:
|
||||
List[FuturesContractInfo]: 合约列表
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
symbol_id, product_code, contract_month, exchange,
|
||||
list_date, last_trade_date, delivery_date, is_active
|
||||
FROM futures_contracts
|
||||
WHERE product_code = :product_code
|
||||
AND is_active = TRUE
|
||||
AND last_trade_date >= CURRENT_DATE
|
||||
ORDER BY contract_month ASC
|
||||
LIMIT :limit
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"product_code": product_code,
|
||||
"limit": limit
|
||||
})
|
||||
|
||||
contracts = []
|
||||
for row in result:
|
||||
contracts.append(FuturesContractInfo(
|
||||
symbol=row.symbol_id,
|
||||
product_code=row.product_code,
|
||||
contract_month=row.contract_month,
|
||||
exchange=row.exchange,
|
||||
list_date=row.list_date,
|
||||
last_trade_date=row.last_trade_date,
|
||||
delivery_date=row.delivery_date,
|
||||
is_active=row.is_active
|
||||
))
|
||||
|
||||
return contracts
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询活跃合约失败: {e}")
|
||||
return []
|
||||
|
||||
def get_main_contract(self, product_code: str) -> Optional[str]:
|
||||
"""
|
||||
获取主力合约
|
||||
|
||||
Args:
|
||||
product_code: 品种代码
|
||||
|
||||
Returns:
|
||||
Optional[str]: 主力合约代码
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT symbol_id
|
||||
FROM futures_contracts
|
||||
WHERE product_code = :product_code
|
||||
AND is_main = TRUE
|
||||
AND is_active = TRUE
|
||||
LIMIT 1
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {"product_code": product_code}).first()
|
||||
return result.symbol_id if result else None
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询主力合约失败: {e}")
|
||||
return None
|
||||
|
||||
def save_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
items: List[FuturesKLineItem]
|
||||
) -> int:
|
||||
"""
|
||||
批量保存 K 线数据
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
freq: K 线周期
|
||||
items: K 线数据列表
|
||||
|
||||
Returns:
|
||||
int: 保存的数量
|
||||
"""
|
||||
if not items:
|
||||
return 0
|
||||
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
logger.error(f"不支持的周期: {freq}")
|
||||
return 0
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
INSERT INTO {table_name} (
|
||||
symbol_id, ts, open, high, low, close, volume,
|
||||
open_interest, settlement_price, trade_date
|
||||
) VALUES (
|
||||
:symbol_id, :ts, :open, :high, :low, :close, :volume,
|
||||
:open_interest, :settlement_price, :trade_date
|
||||
)
|
||||
ON CONFLICT (symbol_id, ts) DO UPDATE SET
|
||||
open = EXCLUDED.open,
|
||||
high = EXCLUDED.high,
|
||||
low = EXCLUDED.low,
|
||||
close = EXCLUDED.close,
|
||||
volume = EXCLUDED.volume,
|
||||
open_interest = EXCLUDED.open_interest,
|
||||
settlement_price = EXCLUDED.settlement_price,
|
||||
updated_at = NOW()
|
||||
""")
|
||||
|
||||
data_list = []
|
||||
for item in items:
|
||||
data_list.append({
|
||||
"symbol_id": symbol,
|
||||
"ts": item.time,
|
||||
"open": item.open,
|
||||
"high": item.high,
|
||||
"low": item.low,
|
||||
"close": item.close,
|
||||
"volume": item.volume,
|
||||
"open_interest": item.open_interest or 0,
|
||||
"settlement_price": item.settlement_price,
|
||||
"trade_date": item.trade_date or item.time.date() if item.time else None
|
||||
})
|
||||
|
||||
self.db.execute(sql, data_list)
|
||||
self.db.commit()
|
||||
|
||||
logger.info(f"保存期货 K 线: {symbol} {freq.value} {len(items)} 条")
|
||||
return len(items)
|
||||
|
||||
except Exception as e:
|
||||
self.db.rollback()
|
||||
logger.error(f"保存期货 K 线失败: {e}")
|
||||
return 0
|
||||
|
||||
def get_latest_timestamp(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency
|
||||
) -> Optional[datetime]:
|
||||
"""
|
||||
获取最新 K 线时间戳
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
freq: K 线周期
|
||||
|
||||
Returns:
|
||||
Optional[datetime]: 最新时间戳
|
||||
"""
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
return None
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
SELECT MAX(ts) as latest_ts
|
||||
FROM {table_name}
|
||||
WHERE symbol_id = :symbol
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {"symbol": symbol}).first()
|
||||
return result.latest_ts if result else None
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询最新时间戳失败: {e}")
|
||||
return None
|
||||
|
||||
def get_products_by_exchange(
|
||||
self,
|
||||
exchange: str,
|
||||
is_active: bool = True
|
||||
) -> List[FuturesSymbolInfo]:
|
||||
"""
|
||||
获取交易所品种列表
|
||||
|
||||
Args:
|
||||
exchange: 交易所代码 (SHFE/DCE/CZCE/CFFEX/INE/GFEX)
|
||||
is_active: 是否只返回活跃品种
|
||||
|
||||
Returns:
|
||||
List[FuturesSymbolInfo]: 品种列表
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
product_code, product_name, exchange, product_type,
|
||||
multiplier, min_price_tick, is_active
|
||||
FROM futures_products
|
||||
WHERE exchange = :exchange
|
||||
AND (:is_active IS FALSE OR is_active = :is_active)
|
||||
ORDER BY product_code
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"exchange": exchange,
|
||||
"is_active": is_active
|
||||
})
|
||||
|
||||
products = []
|
||||
for row in result:
|
||||
products.append(FuturesSymbolInfo(
|
||||
symbol=row.product_code,
|
||||
name=row.product_name,
|
||||
exchange=row.exchange,
|
||||
product_type=row.product_type,
|
||||
multiplier=float(row.multiplier) if row.multiplier else 1.0,
|
||||
min_price_tick=float(row.min_price_tick) if row.min_price_tick else 0.01,
|
||||
is_active=row.is_active
|
||||
))
|
||||
|
||||
return products
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询品种列表失败: {e}")
|
||||
return []
|
||||
|
||||
def delete_old_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
before: datetime
|
||||
) -> int:
|
||||
"""
|
||||
删除旧数据
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
freq: K 线周期
|
||||
before: 删除此时间之前的数据
|
||||
|
||||
Returns:
|
||||
int: 删除的数量
|
||||
"""
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
return 0
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
DELETE FROM {table_name}
|
||||
WHERE symbol_id = :symbol
|
||||
AND ts < :before
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"symbol": symbol,
|
||||
"before": before
|
||||
})
|
||||
self.db.commit()
|
||||
|
||||
deleted = result.rowcount
|
||||
logger.info(f"删除旧数据: {symbol} {freq.value} {deleted} 条")
|
||||
return deleted
|
||||
|
||||
except Exception as e:
|
||||
self.db.rollback()
|
||||
logger.error(f"删除旧数据失败: {e}")
|
||||
return 0
|
||||
|
||||
def get_contracts_by_product(
|
||||
self,
|
||||
product_code: str,
|
||||
include_expired: bool = False
|
||||
) -> List[FuturesContractInfo]:
|
||||
"""
|
||||
获取品种下所有合约
|
||||
|
||||
Args:
|
||||
product_code: 品种代码
|
||||
include_expired: 是否包含已过期合约
|
||||
|
||||
Returns:
|
||||
List[FuturesContractInfo]: 合约列表
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
symbol_id, product_code, contract_month, exchange,
|
||||
list_date, last_trade_date, delivery_date, is_active
|
||||
FROM futures_contracts
|
||||
WHERE product_code = :product_code
|
||||
AND (:include_expired IS TRUE OR last_trade_date >= CURRENT_DATE)
|
||||
ORDER BY contract_month ASC
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"product_code": product_code,
|
||||
"include_expired": include_expired
|
||||
})
|
||||
|
||||
contracts = []
|
||||
for row in result:
|
||||
contracts.append(FuturesContractInfo(
|
||||
symbol=row.symbol_id,
|
||||
product_code=row.product_code,
|
||||
contract_month=row.contract_month,
|
||||
exchange=row.exchange,
|
||||
list_date=row.list_date,
|
||||
last_trade_date=row.last_trade_date,
|
||||
delivery_date=row.delivery_date,
|
||||
is_active=row.is_active
|
||||
))
|
||||
|
||||
return contracts
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询品种合约失败: {e}")
|
||||
return []
|
||||
@ -0,0 +1,400 @@
|
||||
"""
|
||||
股票 K 线数据仓库 v2.2
|
||||
负责股票 K 线数据的 CRUD 操作
|
||||
"""
|
||||
import logging
|
||||
from datetime import datetime, date, timedelta
|
||||
from typing import List, Optional, Dict, Any
|
||||
from decimal import Decimal
|
||||
|
||||
from sqlalchemy import text
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.models.kline import (
|
||||
Frequency, AdjustType, StockKLineItem, StockKLineData,
|
||||
StockSymbolInfo, StockAdjustFactor
|
||||
)
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
class StockKLineRepository:
|
||||
"""股票 K 线数据仓库"""
|
||||
|
||||
# 表名映射（按周期）
|
||||
TABLE_MAP = {
|
||||
Frequency.FREQ_1M: "stock_klines_1m",
|
||||
Frequency.FREQ_5M: "stock_klines_5m",
|
||||
Frequency.FREQ_15M: "stock_klines_15m",
|
||||
Frequency.FREQ_30M: "stock_klines_30m",
|
||||
Frequency.FREQ_1H: "stock_klines_1h",
|
||||
Frequency.FREQ_1D: "stock_klines_1d",
|
||||
Frequency.FREQ_1W: "stock_klines_1w",
|
||||
Frequency.FREQ_1MONTH: "stock_klines_1month",
|
||||
}
|
||||
|
||||
def __init__(self, db: Session):
|
||||
self.db = db
|
||||
|
||||
def get_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime,
|
||||
limit: int = 10000
|
||||
) -> List[StockKLineItem]:
|
||||
"""
|
||||
查询股票 K 线数据
|
||||
|
||||
Args:
|
||||
symbol: 股票代码 (如 000001.SZ)
|
||||
freq: K 线周期
|
||||
start: 开始时间
|
||||
end: 结束时间
|
||||
limit: 最大返回数量
|
||||
|
||||
Returns:
|
||||
List[StockKLineItem]: K 线数据列表
|
||||
"""
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
logger.error(f"不支持的周期: {freq}")
|
||||
return []
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
SELECT
|
||||
symbol_id, ts, open, high, low, close, volume, amount,
|
||||
trade_date, is_limit_up, is_limit_down,
|
||||
total_market_cap, float_market_cap, inst_holding_ratio, trading_days
|
||||
FROM {table_name}
|
||||
WHERE symbol_id = :symbol
|
||||
AND ts >= :start
|
||||
AND ts <= :end
|
||||
ORDER BY ts ASC
|
||||
LIMIT :limit
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"symbol": symbol,
|
||||
"start": start,
|
||||
"end": end,
|
||||
"limit": limit
|
||||
})
|
||||
|
||||
items = []
|
||||
for row in result:
|
||||
items.append(StockKLineItem(
|
||||
symbol=row.symbol_id,
|
||||
time=row.ts,
|
||||
open=float(row.open) if row.open else None,
|
||||
high=float(row.high) if row.high else None,
|
||||
low=float(row.low) if row.low else None,
|
||||
close=float(row.close) if row.close else None,
|
||||
volume=row.volume or 0,
|
||||
amount=float(row.amount) if row.amount else None,
|
||||
trade_date=row.trade_date,
|
||||
is_limit_up=row.is_limit_up or False,
|
||||
is_limit_down=row.is_limit_down or False,
|
||||
total_market_cap=float(row.total_market_cap) if row.total_market_cap else None,
|
||||
float_market_cap=float(row.float_market_cap) if row.float_market_cap else None,
|
||||
inst_holding_ratio=float(row.inst_holding_ratio) if row.inst_holding_ratio else None,
|
||||
trading_days=row.trading_days
|
||||
))
|
||||
|
||||
logger.info(f"查询股票 K 线: {symbol} {freq.value} {len(items)} 条")
|
||||
return items
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询股票 K 线失败: {e}")
|
||||
return []
|
||||
|
||||
def get_symbol_info(self, symbol: str) -> Optional[StockSymbolInfo]:
|
||||
"""
|
||||
获取股票基本信息
|
||||
|
||||
Args:
|
||||
symbol: 股票代码
|
||||
|
||||
Returns:
|
||||
StockSymbolInfo: 股票信息
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
symbol_id, symbol_name, exchange, industry,
|
||||
list_date, is_active, created_at, updated_at
|
||||
FROM stock_symbols
|
||||
WHERE symbol_id = :symbol
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {"symbol": symbol}).first()
|
||||
|
||||
if result:
|
||||
return StockSymbolInfo(
|
||||
symbol=result.symbol_id,
|
||||
name=result.symbol_name,
|
||||
exchange=result.exchange,
|
||||
industry=result.industry,
|
||||
list_date=result.list_date,
|
||||
is_active=result.is_active
|
||||
)
|
||||
return None
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询股票信息失败: {e}")
|
||||
return None
|
||||
|
||||
def get_adjust_factors(
|
||||
self,
|
||||
symbol: str,
|
||||
start: Optional[date] = None,
|
||||
end: Optional[date] = None
|
||||
) -> List[StockAdjustFactor]:
|
||||
"""
|
||||
获取复权因子
|
||||
|
||||
Args:
|
||||
symbol: 股票代码
|
||||
start: 开始日期
|
||||
end: 结束日期
|
||||
|
||||
Returns:
|
||||
List[StockAdjustFactor]: 复权因子列表
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
symbol_id, ex_date, adjust_factor, dividend_ratio,
|
||||
split_ratio, created_at
|
||||
FROM stock_adjust_factors
|
||||
WHERE symbol_id = :symbol
|
||||
AND (:start IS NULL OR ex_date >= :start)
|
||||
AND (:end IS NULL OR ex_date <= :end)
|
||||
ORDER BY ex_date ASC
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"symbol": symbol,
|
||||
"start": start,
|
||||
"end": end
|
||||
})
|
||||
|
||||
factors = []
|
||||
for row in result:
|
||||
factors.append(StockAdjustFactor(
|
||||
symbol=row.symbol_id,
|
||||
ex_date=row.ex_date,
|
||||
adjust_factor=float(row.adjust_factor) if row.adjust_factor else 1.0,
|
||||
dividend_ratio=float(row.dividend_ratio) if row.dividend_ratio else 0.0,
|
||||
split_ratio=float(row.split_ratio) if row.split_ratio else 1.0
|
||||
))
|
||||
|
||||
return factors
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询复权因子失败: {e}")
|
||||
return []
|
||||
|
||||
def save_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
items: List[StockKLineItem]
|
||||
) -> int:
|
||||
"""
|
||||
批量保存 K 线数据
|
||||
|
||||
Args:
|
||||
symbol: 股票代码
|
||||
freq: K 线周期
|
||||
items: K 线数据列表
|
||||
|
||||
Returns:
|
||||
int: 保存的数量
|
||||
"""
|
||||
if not items:
|
||||
return 0
|
||||
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
logger.error(f"不支持的周期: {freq}")
|
||||
return 0
|
||||
|
||||
try:
|
||||
# 构建批量插入 SQL
|
||||
sql = text(f"""
|
||||
INSERT INTO {table_name} (
|
||||
symbol_id, ts, open, high, low, close, volume, amount,
|
||||
trade_date, is_limit_up, is_limit_down,
|
||||
total_market_cap, float_market_cap, inst_holding_ratio, trading_days
|
||||
) VALUES (
|
||||
:symbol_id, :ts, :open, :high, :low, :close, :volume, :amount,
|
||||
:trade_date, :is_limit_up, :is_limit_down,
|
||||
:total_market_cap, :float_market_cap, :inst_holding_ratio, :trading_days
|
||||
)
|
||||
ON CONFLICT (symbol_id, ts) DO UPDATE SET
|
||||
open = EXCLUDED.open,
|
||||
high = EXCLUDED.high,
|
||||
low = EXCLUDED.low,
|
||||
close = EXCLUDED.close,
|
||||
volume = EXCLUDED.volume,
|
||||
amount = EXCLUDED.amount,
|
||||
updated_at = NOW()
|
||||
""")
|
||||
|
||||
data_list = []
|
||||
for item in items:
|
||||
data_list.append({
|
||||
"symbol_id": symbol,
|
||||
"ts": item.time,
|
||||
"open": item.open,
|
||||
"high": item.high,
|
||||
"low": item.low,
|
||||
"close": item.close,
|
||||
"volume": item.volume,
|
||||
"amount": item.amount,
|
||||
"trade_date": item.trade_date or item.time.date() if item.time else None,
|
||||
"is_limit_up": item.is_limit_up or False,
|
||||
"is_limit_down": item.is_limit_down or False,
|
||||
"total_market_cap": item.total_market_cap,
|
||||
"float_market_cap": item.float_market_cap,
|
||||
"inst_holding_ratio": item.inst_holding_ratio,
|
||||
"trading_days": item.trading_days
|
||||
})
|
||||
|
||||
self.db.execute(sql, data_list)
|
||||
self.db.commit()
|
||||
|
||||
logger.info(f"保存股票 K 线: {symbol} {freq.value} {len(items)} 条")
|
||||
return len(items)
|
||||
|
||||
except Exception as e:
|
||||
self.db.rollback()
|
||||
logger.error(f"保存股票 K 线失败: {e}")
|
||||
return 0
|
||||
|
||||
def get_latest_timestamp(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency
|
||||
) -> Optional[datetime]:
|
||||
"""
|
||||
获取最新 K 线时间戳
|
||||
|
||||
Args:
|
||||
symbol: 股票代码
|
||||
freq: K 线周期
|
||||
|
||||
Returns:
|
||||
Optional[datetime]: 最新时间戳
|
||||
"""
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
return None
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
SELECT MAX(ts) as latest_ts
|
||||
FROM {table_name}
|
||||
WHERE symbol_id = :symbol
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {"symbol": symbol}).first()
|
||||
return result.latest_ts if result else None
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询最新时间戳失败: {e}")
|
||||
return None
|
||||
|
||||
def get_symbols_by_exchange(
|
||||
self,
|
||||
exchange: str,
|
||||
is_active: bool = True
|
||||
) -> List[StockSymbolInfo]:
|
||||
"""
|
||||
获取交易所股票列表
|
||||
|
||||
Args:
|
||||
exchange: 交易所代码 (SH/SZ/BJ)
|
||||
is_active: 是否只返回活跃股票
|
||||
|
||||
Returns:
|
||||
List[StockSymbolInfo]: 股票列表
|
||||
"""
|
||||
try:
|
||||
sql = text("""
|
||||
SELECT
|
||||
symbol_id, symbol_name, exchange, industry,
|
||||
list_date, is_active
|
||||
FROM stock_symbols
|
||||
WHERE exchange = :exchange
|
||||
AND (:is_active IS FALSE OR is_active = :is_active)
|
||||
ORDER BY symbol_id
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"exchange": exchange,
|
||||
"is_active": is_active
|
||||
})
|
||||
|
||||
symbols = []
|
||||
for row in result:
|
||||
symbols.append(StockSymbolInfo(
|
||||
symbol=row.symbol_id,
|
||||
name=row.symbol_name,
|
||||
exchange=row.exchange,
|
||||
industry=row.industry,
|
||||
list_date=row.list_date,
|
||||
is_active=row.is_active
|
||||
))
|
||||
|
||||
return symbols
|
||||
|
||||
except Exception as e:
|
||||
logger.error(f"查询股票列表失败: {e}")
|
||||
return []
|
||||
|
||||
def delete_old_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
before: datetime
|
||||
) -> int:
|
||||
"""
|
||||
删除旧数据
|
||||
|
||||
Args:
|
||||
symbol: 股票代码
|
||||
freq: K 线周期
|
||||
before: 删除此时间之前的数据
|
||||
|
||||
Returns:
|
||||
int: 删除的数量
|
||||
"""
|
||||
table_name = self.TABLE_MAP.get(freq)
|
||||
if not table_name:
|
||||
return 0
|
||||
|
||||
try:
|
||||
sql = text(f"""
|
||||
DELETE FROM {table_name}
|
||||
WHERE symbol_id = :symbol
|
||||
AND ts < :before
|
||||
""")
|
||||
|
||||
result = self.db.execute(sql, {
|
||||
"symbol": symbol,
|
||||
"before": before
|
||||
})
|
||||
self.db.commit()
|
||||
|
||||
deleted = result.rowcount
|
||||
logger.info(f"删除旧数据: {symbol} {freq.value} {deleted} 条")
|
||||
return deleted
|
||||
|
||||
except Exception as e:
|
||||
self.db.rollback()
|
||||
logger.error(f"删除旧数据失败: {e}")
|
||||
return 0
|
||||
@ -0,0 +1,163 @@
|
||||
"""
|
||||
告警服务
|
||||
"""
|
||||
import logging
|
||||
from datetime import datetime
|
||||
from typing import List, Optional
|
||||
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.models import Alert
|
||||
from app.db.init_db import SQLiteSessionLocal
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
class AlertService:
|
||||
"""告警服务"""
|
||||
|
||||
@staticmethod
|
||||
def create_alert(
|
||||
user_id: int,
|
||||
symbol: str,
|
||||
condition_type: str,
|
||||
condition_value: float,
|
||||
alert_type: str = "price"
|
||||
) -> Alert:
|
||||
"""创建告警"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
alert = Alert(
|
||||
user_id=user_id,
|
||||
symbol=symbol,
|
||||
condition_type=condition_type,
|
||||
condition_value=condition_value,
|
||||
alert_type=alert_type,
|
||||
status="active"
|
||||
)
|
||||
db.add(alert)
|
||||
db.commit()
|
||||
db.refresh(alert)
|
||||
return alert
|
||||
|
||||
@staticmethod
|
||||
def get_user_alerts(user_id: int, status: Optional[str] = None) -> List[Alert]:
|
||||
"""获取用户告警列表"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
query = db.query(Alert).filter(Alert.user_id == user_id)
|
||||
if status:
|
||||
query = query.filter(Alert.status == status)
|
||||
return query.order_by(Alert.created_at.desc()).all()
|
||||
|
||||
@staticmethod
|
||||
def get_alert_by_id(alert_id: int, user_id: int) -> Optional[Alert]:
|
||||
"""根据 ID 获取告警"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
return db.query(Alert).filter(
|
||||
Alert.id == alert_id,
|
||||
Alert.user_id == user_id
|
||||
).first()
|
||||
|
||||
@staticmethod
|
||||
def update_alert(
|
||||
alert_id: int,
|
||||
user_id: int,
|
||||
condition_value: Optional[float] = None,
|
||||
status: Optional[str] = None
|
||||
) -> Optional[Alert]:
|
||||
"""更新告警"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
alert = db.query(Alert).filter(
|
||||
Alert.id == alert_id,
|
||||
Alert.user_id == user_id
|
||||
).first()
|
||||
|
||||
if not alert:
|
||||
return None
|
||||
|
||||
if condition_value is not None:
|
||||
alert.condition_value = condition_value
|
||||
if status is not None:
|
||||
alert.status = status
|
||||
if status == "active" and alert.triggered_at:
|
||||
alert.triggered_at = None
|
||||
|
||||
alert.updated_at = datetime.utcnow()
|
||||
db.commit()
|
||||
db.refresh(alert)
|
||||
return alert
|
||||
|
||||
@staticmethod
|
||||
def delete_alert(alert_id: int, user_id: int) -> bool:
|
||||
"""删除告警"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
alert = db.query(Alert).filter(
|
||||
Alert.id == alert_id,
|
||||
Alert.user_id == user_id
|
||||
).first()
|
||||
|
||||
if not alert:
|
||||
return False
|
||||
|
||||
db.delete(alert)
|
||||
db.commit()
|
||||
return True
|
||||
|
||||
@staticmethod
|
||||
def trigger_alert(alert_id: int) -> Optional[Alert]:
|
||||
"""触发告警"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
alert = db.query(Alert).filter(Alert.id == alert_id).first()
|
||||
if not alert:
|
||||
return None
|
||||
|
||||
alert.status = "triggered"
|
||||
alert.triggered_at = datetime.utcnow()
|
||||
alert.updated_at = datetime.utcnow()
|
||||
db.commit()
|
||||
db.refresh(alert)
|
||||
return alert
|
||||
|
||||
@staticmethod
|
||||
def check_price_alerts(symbol: str, price: float) -> List[Alert]:
|
||||
"""
|
||||
检查价格告警
|
||||
|
||||
Args:
|
||||
symbol: 品种代码
|
||||
price: 当前价格
|
||||
|
||||
Returns:
|
||||
List[Alert]: 被触发的告警列表
|
||||
"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
alerts = db.query(Alert).filter(
|
||||
Alert.symbol == symbol,
|
||||
Alert.status == "active",
|
||||
Alert.alert_type == "price"
|
||||
).all()
|
||||
|
||||
triggered = []
|
||||
for alert in alerts:
|
||||
should_trigger = False
|
||||
|
||||
if alert.condition_type == "greater_than" and price >= alert.condition_value:
|
||||
should_trigger = True
|
||||
elif alert.condition_type == "less_than" and price <= alert.condition_value:
|
||||
should_trigger = True
|
||||
elif alert.condition_type == "equals" and abs(price - float(alert.condition_value)) < 0.001:
|
||||
should_trigger = True
|
||||
|
||||
if should_trigger:
|
||||
# 更新告警状态为 triggered
|
||||
alert.status = "triggered"
|
||||
alert.triggered_at = datetime.utcnow()
|
||||
alert.updated_at = datetime.utcnow()
|
||||
triggered.append(alert)
|
||||
|
||||
if triggered:
|
||||
db.commit()
|
||||
# 刷新对象状态
|
||||
for alert in triggered:
|
||||
db.refresh(alert)
|
||||
|
||||
return triggered
|
||||
@ -0,0 +1,83 @@
|
||||
"""
|
||||
认证服务
|
||||
"""
|
||||
import hashlib
|
||||
import secrets
|
||||
from datetime import datetime, timedelta
|
||||
from typing import Optional
|
||||
|
||||
import jwt
|
||||
from passlib.context import CryptContext
|
||||
|
||||
from app.config import settings
|
||||
from app.models import User
|
||||
from app.db.init_db import SQLiteSessionLocal
|
||||
|
||||
# 密码加密上下文 - 使用 bcrypt 算法（更安全）
|
||||
pwd_context = CryptContext(schemes=["bcrypt"], deprecated="auto")
|
||||
|
||||
|
||||
def verify_password(plain_password: str, hashed_password: str) -> bool:
|
||||
"""验证密码"""
|
||||
return pwd_context.verify(plain_password, hashed_password)
|
||||
|
||||
|
||||
def get_password_hash(password: str) -> str:
|
||||
"""生成密码哈希"""
|
||||
return pwd_context.hash(password)
|
||||
|
||||
|
||||
def create_access_token(data: dict, expires_delta: Optional[timedelta] = None) -> str:
|
||||
"""创建访问令牌"""
|
||||
to_encode = data.copy()
|
||||
if expires_delta:
|
||||
expire = datetime.utcnow() + expires_delta
|
||||
else:
|
||||
expire = datetime.utcnow() + timedelta(minutes=settings.ACCESS_TOKEN_EXPIRE_MINUTES)
|
||||
|
||||
to_encode.update({"exp": expire, "type": "access"})
|
||||
encoded_jwt = jwt.encode(to_encode, settings.SECRET_KEY, algorithm=settings.ALGORITHM)
|
||||
return encoded_jwt
|
||||
|
||||
|
||||
def create_refresh_token(data: dict) -> str:
|
||||
"""创建刷新令牌"""
|
||||
to_encode = data.copy()
|
||||
expire = datetime.utcnow() + timedelta(days=settings.REFRESH_TOKEN_EXPIRE_DAYS)
|
||||
to_encode.update({"exp": expire, "type": "refresh"})
|
||||
encoded_jwt = jwt.encode(to_encode, settings.SECRET_KEY, algorithm=settings.ALGORITHM)
|
||||
return encoded_jwt
|
||||
|
||||
|
||||
def decode_token(token: str) -> Optional[dict]:
|
||||
"""解码令牌"""
|
||||
try:
|
||||
payload = jwt.decode(token, settings.SECRET_KEY, algorithms=[settings.ALGORITHM])
|
||||
return payload
|
||||
except jwt.ExpiredSignatureError:
|
||||
return None
|
||||
except jwt.InvalidTokenError:
|
||||
return None
|
||||
|
||||
|
||||
def authenticate_user(username: str, password: str) -> Optional[User]:
|
||||
"""认证用户"""
|
||||
with SQLiteSessionLocal() as db:
|
||||
user = db.query(User).filter(User.username == username).first()
|
||||
if not user:
|
||||
return None
|
||||
if not verify_password(password, user.password_hash):
|
||||
return None
|
||||
if not user.is_active:
|
||||
return None
|
||||
return user
|
||||
|
||||
|
||||
def generate_api_key() -> str:
|
||||
"""生成 API Key"""
|
||||
return f"ak_{secrets.token_urlsafe(32)}"
|
||||
|
||||
|
||||
def hash_api_key(api_key: str) -> str:
|
||||
"""哈希 API Key"""
|
||||
return hashlib.sha256(api_key.encode()).hexdigest()
|
||||
@ -0,0 +1,13 @@
|
||||
"""
|
||||
K 线服务模块 v2.2
|
||||
支持股票 K 线、期货 K 线、复权计算等
|
||||
"""
|
||||
from app.services.kline.stock_service import StockKLineService
|
||||
from app.services.kline.futures_service import FuturesKLineService
|
||||
from app.services.kline.adjustment_service import AdjustmentService
|
||||
|
||||
__all__ = [
|
||||
"StockKLineService",
|
||||
"FuturesKLineService",
|
||||
"AdjustmentService",
|
||||
]
|
||||
@ -0,0 +1,391 @@
|
||||
"""
|
||||
期货 K 线服务 v2.2
|
||||
支持多周期、持仓量、结算价等期货特有数据
|
||||
"""
|
||||
import logging
|
||||
from datetime import datetime, timedelta
|
||||
from typing import List, Optional, Dict, Any
|
||||
from enum import Enum
|
||||
|
||||
from sqlalchemy.orm import Session
|
||||
|
||||
from app.models.kline import (
|
||||
Frequency, FuturesKLineItem, FuturesKLineData,
|
||||
FuturesSymbolInfo, FuturesContractInfo, FuturesKLineQuery
|
||||
)
|
||||
from app.repositories.kline.futures_repository import FuturesKLineRepository
|
||||
from app.services.cache_service import cache_service
|
||||
|
||||
logger = logging.getLogger(__name__)
|
||||
|
||||
|
||||
# 支持的期货 K 线周期
|
||||
FUTURES_FREQUENCIES = [
|
||||
Frequency.FREQ_1M,
|
||||
Frequency.FREQ_5M,
|
||||
Frequency.FREQ_15M,
|
||||
Frequency.FREQ_30M,
|
||||
Frequency.FREQ_1H,
|
||||
Frequency.FREQ_1D,
|
||||
Frequency.FREQ_1W,
|
||||
Frequency.FREQ_1MONTH,
|
||||
]
|
||||
|
||||
|
||||
class FuturesKLineService:
|
||||
"""期货 K 线服务"""
|
||||
|
||||
def __init__(self, db: Session):
|
||||
self.repository = FuturesKLineRepository(db)
|
||||
self.db = db
|
||||
|
||||
async def query_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime,
|
||||
use_cache: bool = True
|
||||
) -> FuturesKLineData:
|
||||
"""
|
||||
查询期货 K 线数据
|
||||
|
||||
Args:
|
||||
symbol: 合约代码 (如 IF2406, AG2605.SHF)
|
||||
freq: K 线周期
|
||||
start: 开始时间
|
||||
end: 结束时间
|
||||
use_cache: 是否使用缓存
|
||||
|
||||
Returns:
|
||||
FuturesKLineData: K 线数据响应
|
||||
|
||||
Raises:
|
||||
ValueError: 参数验证失败
|
||||
"""
|
||||
# 参数验证
|
||||
self._validate_params(symbol, freq, start, end)
|
||||
|
||||
# 验证周期是否支持
|
||||
if freq not in FUTURES_FREQUENCIES:
|
||||
raise ValueError(f"不支持的期货 K 线周期: {freq}")
|
||||
|
||||
# 尝试从缓存获取
|
||||
cache_key = None
|
||||
if use_cache:
|
||||
cache_key = f"futures_kline:{symbol}:{freq.value}:{start.strftime('%Y%m%d')}:{end.strftime('%Y%m%d')}"
|
||||
cached = await cache_service.get(cache_key)
|
||||
if cached:
|
||||
logger.info(f"缓存命中: {cache_key}")
|
||||
return FuturesKLineData(**cached)
|
||||
|
||||
# 查询数据库
|
||||
items = self.repository.get_klines(symbol, freq, start, end)
|
||||
|
||||
# 如果没有数据，尝试从适配器获取
|
||||
if not items:
|
||||
logger.info(f"数据库无 {symbol} 数据，尝试从数据源获取")
|
||||
items = await self._fetch_from_adapter(symbol, freq, start, end)
|
||||
|
||||
# 保存到数据库
|
||||
if items:
|
||||
self._save_klines_to_db(symbol, freq, items)
|
||||
|
||||
# 获取品种信息
|
||||
symbol_info = self.repository.get_symbol_info(symbol)
|
||||
|
||||
result = FuturesKLineData(
|
||||
symbol=symbol,
|
||||
name=symbol_info.name if symbol_info else "",
|
||||
freq=freq,
|
||||
count=len(items),
|
||||
items=items
|
||||
)
|
||||
|
||||
# 写入缓存
|
||||
if cache_key and items:
|
||||
await cache_service.set(cache_key, result.model_dump(), expire=300) # 5分钟缓存
|
||||
|
||||
return result
|
||||
|
||||
async def query_klines_batch(
|
||||
self,
|
||||
symbols: List[str],
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime,
|
||||
use_cache: bool = True
|
||||
) -> Dict[str, FuturesKLineData]:
|
||||
"""
|
||||
批量查询期货 K 线数据
|
||||
|
||||
Args:
|
||||
symbols: 合约代码列表 (最多100个)
|
||||
freq: K 线周期
|
||||
start: 开始时间
|
||||
end: 结束时间
|
||||
use_cache: 是否使用缓存
|
||||
|
||||
Returns:
|
||||
Dict[str, FuturesKLineData]: 合约代码 -> K线数据映射
|
||||
"""
|
||||
if len(symbols) > 100:
|
||||
raise ValueError("批量查询最多支持 100 个合约")
|
||||
|
||||
results = {}
|
||||
for symbol in symbols:
|
||||
try:
|
||||
results[symbol] = await self.query_klines(
|
||||
symbol, freq, start, end, use_cache
|
||||
)
|
||||
except Exception as e:
|
||||
logger.error(f"查询 {symbol} 失败: {e}")
|
||||
results[symbol] = FuturesKLineData(
|
||||
symbol=symbol,
|
||||
name="",
|
||||
freq=freq,
|
||||
count=0,
|
||||
items=[],
|
||||
error=str(e)
|
||||
)
|
||||
|
||||
return results
|
||||
|
||||
async def get_main_contract_klines(
|
||||
self,
|
||||
product_code: str,
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime
|
||||
) -> Optional[FuturesKLineData]:
|
||||
"""
|
||||
获取主力合约 K 线数据
|
||||
|
||||
Args:
|
||||
product_code: 品种代码 (如 IF, IC, AG)
|
||||
freq: K 线周期
|
||||
start: 开始时间
|
||||
end: 结束时间
|
||||
|
||||
Returns:
|
||||
Optional[FuturesKLineData]: 主力合约 K 线数据
|
||||
"""
|
||||
# 获取主力合约
|
||||
main_contract = self.repository.get_main_contract(product_code)
|
||||
if not main_contract:
|
||||
logger.warning(f"品种 {product_code} 无主力合约")
|
||||
return None
|
||||
|
||||
return await self.query_klines(main_contract, freq, start, end)
|
||||
|
||||
def get_active_contracts(
|
||||
self,
|
||||
product_code: str,
|
||||
limit: int = 10
|
||||
) -> List[FuturesContractInfo]:
|
||||
"""
|
||||
获取活跃合约列表
|
||||
|
||||
Args:
|
||||
product_code: 品种代码
|
||||
limit: 返回数量
|
||||
|
||||
Returns:
|
||||
List[FuturesContractInfo]: 活跃合约列表
|
||||
"""
|
||||
return self.repository.get_active_contracts(product_code, limit)
|
||||
|
||||
def get_contract_info(self, symbol: str) -> Optional[FuturesContractInfo]:
|
||||
"""
|
||||
获取合约信息
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
|
||||
Returns:
|
||||
Optional[FuturesContractInfo]: 合约信息
|
||||
"""
|
||||
return self.repository.get_contract_info(symbol)
|
||||
|
||||
def _validate_params(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime
|
||||
) -> None:
|
||||
"""验证查询参数"""
|
||||
if not symbol:
|
||||
raise ValueError("合约代码不能为空")
|
||||
|
||||
if start >= end:
|
||||
raise ValueError("开始时间必须早于结束时间")
|
||||
|
||||
# 时间范围限制
|
||||
max_days = {
|
||||
Frequency.FREQ_1M: 30,
|
||||
Frequency.FREQ_5M: 60,
|
||||
Frequency.FREQ_15M: 90,
|
||||
Frequency.FREQ_30M: 180,
|
||||
Frequency.FREQ_1H: 365,
|
||||
Frequency.FREQ_1D: 3650, # 10年
|
||||
Frequency.FREQ_1W: 3650,
|
||||
Frequency.FREQ_1MONTH: 3650,
|
||||
}
|
||||
|
||||
days = (end - start).days
|
||||
max_allowed = max_days.get(freq, 365)
|
||||
if days > max_allowed:
|
||||
raise ValueError(f"{freq.value} 周期最多查询 {max_allowed} 天数据")
|
||||
|
||||
async def _fetch_from_adapter(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
start: datetime,
|
||||
end: datetime
|
||||
) -> List[FuturesKLineItem]:
|
||||
"""
|
||||
从数据源适配器获取 K 线数据
|
||||
|
||||
注意: 此方法修复了原代码中的异步问题
|
||||
原代码错误地使用 asyncio.new_event_loop()
|
||||
"""
|
||||
try:
|
||||
from app.services.amazing_data_service import AmazingDataService
|
||||
|
||||
# 获取服务实例
|
||||
service = AmazingDataService()
|
||||
|
||||
# 转换频率格式
|
||||
period_map = {
|
||||
Frequency.FREQ_1M: "min1",
|
||||
Frequency.FREQ_5M: "min5",
|
||||
Frequency.FREQ_15M: "min15",
|
||||
Frequency.FREQ_30M: "min30",
|
||||
Frequency.FREQ_1H: "min60",
|
||||
Frequency.FREQ_1D: "day",
|
||||
Frequency.FREQ_1W: "week",
|
||||
Frequency.FREQ_1MONTH: "month",
|
||||
}
|
||||
period = period_map.get(freq, "day")
|
||||
|
||||
# 使用上下文管理器确保连接正确关闭
|
||||
async with service.get_connection() as conn:
|
||||
# 调用适配器获取数据
|
||||
df = await conn.get_kline(
|
||||
symbol=symbol,
|
||||
period=period,
|
||||
start_time=start.strftime("%Y%m%d%H%M%S"),
|
||||
end_time=end.strftime("%Y%m%d%H%M%S")
|
||||
)
|
||||
|
||||
if df is None or df.empty:
|
||||
logger.warning(f"适配器返回空数据: {symbol}")
|
||||
return []
|
||||
|
||||
# 转换为 KLineItem 列表
|
||||
items = []
|
||||
for _, row in df.iterrows():
|
||||
items.append(FuturesKLineItem(
|
||||
symbol=symbol,
|
||||
time=row.get('time', row.name) if isinstance(row.get('time'), datetime)
|
||||
else datetime.strptime(str(row.get('time', row.name)), "%Y-%m-%d %H:%M:%S"),
|
||||
open=float(row.get('open', 0)),
|
||||
high=float(row.get('high', 0)),
|
||||
low=float(row.get('low', 0)),
|
||||
close=float(row.get('close', 0)),
|
||||
volume=int(row.get('volume', 0)),
|
||||
open_interest=int(row.get('open_interest', 0)) if 'open_interest' in row else 0,
|
||||
settlement_price=float(row.get('settlement', 0)) if 'settlement' in row else None,
|
||||
trade_date=row.get('trade_date', row.get('time', row.name).date() if hasattr(row.get('time', row.name), 'date') else None)
|
||||
))
|
||||
|
||||
logger.info(f"从适配器获取 {symbol} {freq.value} 数据 {len(items)} 条")
|
||||
return items
|
||||
|
||||
except ImportError:
|
||||
logger.warning("AmazingDataService 未安装，无法从适配器获取数据")
|
||||
return []
|
||||
except Exception as e:
|
||||
logger.error(f"从适配器获取数据失败: {e}")
|
||||
return []
|
||||
|
||||
def _save_klines_to_db(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
items: List[FuturesKLineItem]
|
||||
) -> int:
|
||||
"""
|
||||
保存 K 线数据到数据库
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
freq: K 线周期
|
||||
items: K 线数据列表
|
||||
|
||||
Returns:
|
||||
int: 保存的数量
|
||||
"""
|
||||
try:
|
||||
count = self.repository.save_klines(symbol, freq, items)
|
||||
logger.info(f"保存 {symbol} {freq.value} 数据 {count} 条")
|
||||
return count
|
||||
except Exception as e:
|
||||
logger.error(f"保存数据失败: {e}")
|
||||
return 0
|
||||
|
||||
async def sync_klines(
|
||||
self,
|
||||
symbol: str,
|
||||
freq: Frequency,
|
||||
days: int = 30
|
||||
) -> Dict[str, Any]:
|
||||
"""
|
||||
同步 K 线数据
|
||||
|
||||
Args:
|
||||
symbol: 合约代码
|
||||
freq: K 线周期
|
||||
days: 同步天数
|
||||
|
||||
Returns:
|
||||
Dict: 同步结果
|
||||
"""
|
||||
end = datetime.now()
|
||||
start = end - timedelta(days=days)
|
||||
|
||||
# 获取最新时间戳
|
||||
latest = self.repository.get_latest_timestamp(symbol, freq)
|
||||
if latest and latest > start:
|
||||
start = latest + timedelta(seconds=1)
|
||||
|
||||
if start >= end:
|
||||
return {
|
||||
"symbol": symbol,
|
||||
"freq": freq.value,
|
||||
"status": "already_synced",
|
||||
"count": 0
|
||||
}
|
||||
|
||||
# 从适配器获取数据
|
||||
items = await self._fetch_from_adapter(symbol, freq, start, end)
|
||||
|
||||
# 保存到数据库
|
||||
count = self._save_klines_to_db(symbol, freq, items)
|
||||
|
||||
return {
|
||||
"symbol": symbol,
|
||||
"freq": freq.value,
|
||||
"status": "synced",
|
||||
"count": count,
|
||||
"start": start.isoformat(),
|
||||
"end": end.isoformat()
|
||||
}
|
||||
|
||||
|
||||
# 服务工厂函数
|
||||
def get_futures_kline_service(db: Session) -> FuturesKLineService:
|
||||
"""获取期货 K 线服务实例"""
|
||||
return FuturesKLineService(db)
|
||||
@ -0,0 +1,18 @@
|
||||
"""
|
||||
定时任务模块
|
||||
"""
|
||||
from app.tasks.sync_tasks import (
|
||||
start_scheduler,
|
||||
stop_scheduler,
|
||||
get_scheduler,
|
||||
sync_kline_task,
|
||||
sync_realtime_task
|
||||
)
|
||||
|
||||
__all__ = [
|
||||
'start_scheduler',
|
||||
'stop_scheduler',
|
||||
'get_scheduler',
|
||||
'sync_kline_task',
|
||||
'sync_realtime_task'
|
||||
]
|
||||
@ -0,0 +1,8 @@
|
||||
# backend/app/websocket/__init__.py
|
||||
"""
|
||||
WebSocket 模块
|
||||
"""
|
||||
|
||||
from app.websocket.connection_manager import connection_manager, websocket_handler, heartbeat_checker
|
||||
|
||||
__all__ = ["connection_manager", "websocket_handler", "heartbeat_checker"]
|
||||
@ -0,0 +1,23 @@
|
||||
[tool.pytest.ini_options]
|
||||
testpaths = ["tests"]
|
||||
python_files = ["test_*.py"]
|
||||
python_classes = ["Test*"]
|
||||
python_functions = ["test_*"]
|
||||
addopts = "-v --tb=short"
|
||||
asyncio_mode = "auto"
|
||||
|
||||
[tool.coverage.run]
|
||||
source = ["app"]
|
||||
omit = ["*/tests/*", "*/__pycache__/*"]
|
||||
|
||||
[tool.coverage.report]
|
||||
exclude_lines = [
|
||||
"pragma: no cover",
|
||||
"def __repr__",
|
||||
"raise AssertionError",
|
||||
"raise NotImplementedError",
|
||||
"if __name__ == .__main__.:",
|
||||
"if TYPE_CHECKING:",
|
||||
"class .*\\bProtocol\\):",
|
||||
"@(abc\\.)?abstractmethod",
|
||||
]
|
||||
@ -0,0 +1,43 @@
|
||||
# FastAPI 框架
|
||||
fastapi==0.109.0
|
||||
uvicorn[standard]==0.27.0
|
||||
python-multipart==0.0.6
|
||||
|
||||
# 数据库
|
||||
sqlalchemy==2.0.25
|
||||
psycopg2-binary==2.9.9 # PostgreSQL/TimescaleDB 驱动
|
||||
|
||||
# 缓存
|
||||
redis==5.0.1
|
||||
|
||||
# 认证
|
||||
pyjwt==2.8.0
|
||||
passlib[bcrypt]==1.7.4
|
||||
python-jose[cryptography]==3.3.0
|
||||
|
||||
# 配置管理
|
||||
pydantic-settings==2.1.0
|
||||
python-dotenv==1.0.0
|
||||
|
||||
# 数据验证
|
||||
pydantic==2.5.3
|
||||
pydantic[email]==2.5.3
|
||||
|
||||
# 任务调度
|
||||
apscheduler==3.10.4
|
||||
|
||||
# HTTP 客户端
|
||||
httpx==0.26.0
|
||||
|
||||
# 日志
|
||||
loguru==0.7.2
|
||||
|
||||
# 测试
|
||||
pytest==7.4.4
|
||||
pytest-asyncio==0.23.3
|
||||
pytest-cov==4.1.0
|
||||
|
||||
# 开发工具
|
||||
black==23.12.1
|
||||
flake8==7.0.0
|
||||
isort==5.13.2
|
||||
@ -0,0 +1,96 @@
|
||||
# 后端测试套件
|
||||
|
||||
## 测试文件说明
|
||||
|
||||
- `test_api.py` - API 端点集成测试
|
||||
- `test_services.py` - 服务层单元测试
|
||||
|
||||
## 运行测试
|
||||
|
||||
### 运行所有测试
|
||||
```bash
|
||||
cd backend
|
||||
pytest
|
||||
```
|
||||
|
||||
### 运行特定测试文件
|
||||
```bash
|
||||
pytest tests/test_services.py -v
|
||||
```
|
||||
|
||||
### 运行特定测试类
|
||||
```bash
|
||||
pytest tests/test_services.py::TestAuthService -v
|
||||
```
|
||||
|
||||
### 运行特定测试函数
|
||||
```bash
|
||||
pytest tests/test_services.py::TestAuthService::test_password_hashing -v
|
||||
```
|
||||
|
||||
### 生成覆盖率报告
|
||||
```bash
|
||||
pytest --cov=app --cov-report=html
|
||||
# 报告生成在 htmlcov/index.html
|
||||
```
|
||||
|
||||
### 运行测试并显示输出
|
||||
```bash
|
||||
pytest -s -v
|
||||
```
|
||||
|
||||
## 测试覆盖
|
||||
|
||||
### 认证服务 (auth_service.py)
|
||||
- ✅ 密码哈希
|
||||
- ✅ 密码验证
|
||||
- ✅ 访问令牌创建
|
||||
- ✅ 刷新令牌创建
|
||||
- ✅ 令牌解码
|
||||
- ✅ API Key 生成
|
||||
|
||||
### K 线数据服务 (kline_service.py)
|
||||
- ✅ 获取 K 线数据
|
||||
- ✅ 获取最新 K 线
|
||||
- ✅ 获取品种列表
|
||||
- ✅ 获取周期列表
|
||||
|
||||
### 告警服务 (alert_service.py)
|
||||
- ✅ 创建告警
|
||||
- ✅ 获取用户告警
|
||||
- ✅ 更新告警
|
||||
- ✅ 删除告警
|
||||
|
||||
### 订阅服务 (subscription_service.py)
|
||||
- ✅ 创建订阅
|
||||
- ✅ 获取用户订阅
|
||||
- ✅ 取消订阅
|
||||
|
||||
### API 端点
|
||||
- ✅ 健康检查
|
||||
- ✅ 认证端点
|
||||
- ✅ K 线数据端点
|
||||
- ✅ 用户管理端点
|
||||
- ✅ 告警管理端点
|
||||
- ✅ 订阅管理端点
|
||||
|
||||
## Mock 说明
|
||||
|
||||
测试使用 `unittest.mock` 来模拟数据库连接和外部依赖：
|
||||
|
||||
```python
|
||||
from unittest.mock import Mock, patch, MagicMock
|
||||
|
||||
@patch('app.services.kline_service.TimescaleSessionLocal')
|
||||
def test_get_kline_data(self, mock_session):
|
||||
mock_db = MagicMock()
|
||||
mock_session.return_value.__enter__.return_value = mock_db
|
||||
# ... 测试代码
|
||||
```
|
||||
|
||||
## 注意事项
|
||||
|
||||
1. 测试数据库使用 SQLite 内存数据库，不影响生产数据
|
||||
2. 所有测试都是独立的，可以单独运行
|
||||
3. 测试数据在测试结束后自动清理
|
||||
4. 运行测试前确保已安装测试依赖：`pip install -r requirements.txt`
|
||||
@ -0,0 +1,198 @@
|
||||
"""
|
||||
amazingData 服务单元测试
|
||||
"""
|
||||
import pytest
|
||||
from unittest.mock import Mock, patch, MagicMock
|
||||
from datetime import datetime, timedelta
|
||||
|
||||
from app.services.amazing_data_service import AmazingDataService, amazing_data_service
|
||||
from app.services.data_sync_service import DataSyncService
|
||||
|
||||
|
||||
class TestAmazingDataService:
|
||||
"""测试 amazingData 服务"""
|
||||
|
||||
def test_singleton_pattern(self):
|
||||
"""测试单例模式"""
|
||||
service1 = AmazingDataService()
|
||||
service2 = AmazingDataService()
|
||||
assert service1 is service2
|
||||
|
||||
def test_get_instance(self):
|
||||
"""测试获取实例"""
|
||||
service = amazing_data_service
|
||||
assert service is not None
|
||||
assert isinstance(service, AmazingDataService)
|
||||
|
||||
@patch('app.services.amazing_data_service.AmazingDataAdapter')
|
||||
def test_connect_success(self, mock_adapter_class):
|
||||
"""测试连接成功"""
|
||||
mock_adapter = MagicMock()
|
||||
mock_adapter.connect.return_value = True
|
||||
mock_adapter_class.return_value = mock_adapter
|
||||
|
||||
service = AmazingDataService()
|
||||
# 重置初始化标志以便重新测试
|
||||
service._initialized = False
|
||||
service.__init__()
|
||||
|
||||
result = service.connect()
|
||||
|
||||
assert result is True
|
||||
mock_adapter.connect.assert_called_once()
|
||||
|
||||
@patch('app.services.amazing_data_service.AmazingDataAdapter')
|
||||
def test_connect_failure(self, mock_adapter_class):
|
||||
"""测试连接失败"""
|
||||
mock_adapter = MagicMock()
|
||||
mock_adapter.connect.return_value = False
|
||||
mock_adapter_class.return_value = mock_adapter
|
||||
|
||||
service = AmazingDataService()
|
||||
service._initialized = False
|
||||
service.__init__()
|
||||
|
||||
result = service.connect()
|
||||
|
||||
assert result is False
|
||||
|
||||
def test_disconnect(self):
|
||||
"""测试断开连接"""
|
||||
service = amazing_data_service
|
||||
# 注意：实际断开连接需要真实环境
|
||||
# 这里只测试方法存在
|
||||
assert hasattr(service, 'disconnect')
|
||||
|
||||
def test_ensure_connected(self):
|
||||
"""测试确保连接"""
|
||||
service = amazing_data_service
|
||||
assert hasattr(service, 'ensure_connected')
|
||||
|
||||
|
||||
class TestAmazingDataKlineService:
|
||||
"""测试 K 线数据服务"""
|
||||
|
||||
@patch.object(amazing_data_service, 'ensure_connected')
|
||||
@patch.object(amazing_data_service, '_adapter')
|
||||
def test_get_kline_data(self, mock_adapter, mock_ensure):
|
||||
"""测试获取 K 线数据"""
|
||||
import pandas as pd
|
||||
|
||||
# Mock 连接
|
||||
mock_ensure.return_value = True
|
||||
|
||||
# Mock 返回数据
|
||||
mock_df = pd.DataFrame([
|
||||
{
|
||||
'time': '2024-01-01 10:00:00',
|
||||
'open': 3800.0,
|
||||
'high': 3810.0,
|
||||
'low': 3795.0,
|
||||
'close': 3805.0,
|
||||
'volume': 1000,
|
||||
'amount': 3800000.0,
|
||||
'open_interest': 5000
|
||||
}
|
||||
])
|
||||
mock_adapter.get_kline_data.return_value = mock_df
|
||||
|
||||
# 测试（需要实际连接环境，这里仅测试接口）
|
||||
assert hasattr(amazing_data_service, 'get_kline_data')
|
||||
|
||||
@patch.object(amazing_data_service, 'ensure_connected')
|
||||
def test_get_kline_data_not_connected(self, mock_ensure):
|
||||
"""测试未连接时获取 K 线数据"""
|
||||
mock_ensure.return_value = False
|
||||
|
||||
with pytest.raises(Exception) as exc_info:
|
||||
amazing_data_service.get_kline_data(
|
||||
symbol='IF2406',
|
||||
period='1m',
|
||||
start_date='2024-01-01',
|
||||
end_date='2024-01-02'
|
||||
)
|
||||
|
||||
assert '未连接到数据源' in str(exc_info.value)
|
||||
|
||||
|
||||
class TestAmazingDataRealtimeService:
|
||||
"""测试实时行情服务"""
|
||||
|
||||
@patch.object(amazing_data_service, 'ensure_connected')
|
||||
def test_get_realtime_quotes(self, mock_ensure):
|
||||
"""测试获取实时行情"""
|
||||
mock_ensure.return_value = True
|
||||
|
||||
# 测试方法存在
|
||||
assert hasattr(amazing_data_service, 'get_realtime_quotes')
|
||||
|
||||
@patch.object(amazing_data_service, 'ensure_connected')
|
||||
def test_get_realtime_quotes_not_connected(self, mock_ensure):
|
||||
"""测试未连接时获取实时行情"""
|
||||
mock_ensure.return_value = False
|
||||
|
||||
with pytest.raises(Exception) as exc_info:
|
||||
amazing_data_service.get_realtime_quotes(['IF2406', 'IC2406'])
|
||||
|
||||
assert '未连接到数据源' in str(exc_info.value)
|
||||
|
||||
|
||||
class TestAmazingDataSecurityCodes:
|
||||
"""测试证券代码服务"""
|
||||
|
||||
@patch.object(amazing_data_service, 'ensure_connected')
|
||||
def test_get_security_codes(self, mock_ensure):
|
||||
"""测试获取证券代码"""
|
||||
mock_ensure.return_value = True
|
||||
|
||||
assert hasattr(amazing_data_service, 'get_security_codes')
|
||||
|
||||
|
||||
class TestDataSyncService:
|
||||
"""测试数据同步服务"""
|
||||
|
||||
def test_sync_kline_data_method_exists(self):
|
||||
"""测试同步方法存在"""
|
||||
assert hasattr(DataSyncService, 'sync_kline_data')
|
||||
|
||||
def test_sync_all_symbols_method_exists(self):
|
||||
"""测试批量同步方法存在"""
|
||||
assert hasattr(DataSyncService, 'sync_all_symbols')
|
||||
|
||||
def test_default_symbols(self):
|
||||
"""测试默认品种列表"""
|
||||
symbols = DataSyncService.DEFAULT_SYMBOLS
|
||||
assert isinstance(symbols, list)
|
||||
assert len(symbols) > 0
|
||||
|
||||
def test_default_periods(self):
|
||||
"""测试默认周期列表"""
|
||||
periods = DataSyncService.DEFAULT_PERIODS
|
||||
assert isinstance(periods, list)
|
||||
assert '1m' in periods
|
||||
assert '1d' in periods
|
||||
|
||||
|
||||
class TestAmazingDataIntegration:
|
||||
"""集成测试"""
|
||||
|
||||
def test_service_initialization(self):
|
||||
"""测试服务初始化"""
|
||||
service = amazing_data_service
|
||||
assert service is not None
|
||||
assert service._config is not None
|
||||
assert service._config.host == '140.206.44.234'
|
||||
assert service._config.port == 8600
|
||||
|
||||
def test_connection_config(self):
|
||||
"""测试连接配置"""
|
||||
service = amazing_data_service
|
||||
config = service._config
|
||||
|
||||
assert config.username == '11200008169'
|
||||
assert config.password == '11200008169@2026'
|
||||
assert config.use_local_cache is True
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
pytest.main([__file__, '-v'])
|
||||
@ -0,0 +1,53 @@
|
||||
"""
|
||||
认证模块测试
|
||||
"""
|
||||
import pytest
|
||||
from fastapi.testclient import TestClient
|
||||
from app.main import app
|
||||
|
||||
client = TestClient(app)
|
||||
|
||||
|
||||
class TestAuth:
|
||||
"""认证测试类"""
|
||||
|
||||
def test_login_success(self):
|
||||
"""测试登录成功"""
|
||||
response = client.post(
|
||||
"/api/v1/auth/login",
|
||||
data={"username": "admin", "password": "admin123"}
|
||||
)
|
||||
# 注意：实际测试需要正确的密码
|
||||
assert response.status_code in [200, 401]
|
||||
|
||||
def test_health_check(self):
|
||||
"""测试健康检查"""
|
||||
response = client.get("/health")
|
||||
assert response.status_code == 200
|
||||
assert response.json()["status"] == "healthy"
|
||||
|
||||
def test_root(self):
|
||||
"""测试根路径"""
|
||||
response = client.get("/")
|
||||
assert response.status_code == 200
|
||||
data = response.json()
|
||||
assert "name" in data
|
||||
assert "version" in data
|
||||
|
||||
|
||||
class TestKline:
|
||||
"""K 线数据测试类"""
|
||||
|
||||
def test_get_symbols(self):
|
||||
"""测试获取品种列表"""
|
||||
response = client.get("/api/v1/kline/symbols")
|
||||
assert response.status_code == 200
|
||||
|
||||
def test_get_periods(self):
|
||||
"""测试获取周期列表"""
|
||||
response = client.get("/api/v1/kline/periods")
|
||||
assert response.status_code == 200
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
pytest.main([__file__, "-v"])
|
||||
@ -0,0 +1,107 @@
|
||||
version: '3.8'
|
||||
|
||||
services:
|
||||
# TimescaleDB (时序数据库)
|
||||
timescaledb:
|
||||
image: timescale/timescaledb:latest-pg15
|
||||
container_name: kline_timescaledb
|
||||
environment:
|
||||
POSTGRES_USER: postgres
|
||||
POSTGRES_PASSWORD: postgres
|
||||
POSTGRES_DB: kline_data
|
||||
ports:
|
||||
- "5432:5432"
|
||||
volumes:
|
||||
- timescaledb_data:/var/lib/postgresql/data
|
||||
networks:
|
||||
- kline_network
|
||||
restart: unless-stopped
|
||||
healthcheck:
|
||||
test: ["CMD-SHELL", "pg_isready -U postgres"]
|
||||
interval: 10s
|
||||
timeout: 5s
|
||||
retries: 5
|
||||
|
||||
# Redis (缓存和消息队列)
|
||||
redis:
|
||||
image: redis:7-alpine
|
||||
container_name: kline_redis
|
||||
ports:
|
||||
- "6379:6379"
|
||||
volumes:
|
||||
- redis_data:/data
|
||||
networks:
|
||||
- kline_network
|
||||
restart: unless-stopped
|
||||
command: redis-server --appendonly yes
|
||||
healthcheck:
|
||||
test: ["CMD", "redis-cli", "ping"]
|
||||
interval: 10s
|
||||
timeout: 5s
|
||||
retries: 5
|
||||
|
||||
# 后端服务
|
||||
backend:
|
||||
build:
|
||||
context: ./backend
|
||||
dockerfile: Dockerfile
|
||||
container_name: kline_backend
|
||||
environment:
|
||||
- DEBUG=false
|
||||
- SECRET_KEY=your-production-secret-key-change-this
|
||||
- TIMESCALE_DB_URL=postgresql://postgres:postgres@timescaledb:5432/kline_data
|
||||
- SQLITE_DB_PATH=/app/data/config.db
|
||||
- REDIS_URL=redis://redis:6379/0
|
||||
- LOG_LEVEL=INFO
|
||||
ports:
|
||||
- "8000:8000"
|
||||
volumes:
|
||||
- backend_data:/app/data
|
||||
depends_on:
|
||||
timescaledb:
|
||||
condition: service_healthy
|
||||
redis:
|
||||
condition: service_healthy
|
||||
networks:
|
||||
- kline_network
|
||||
restart: unless-stopped
|
||||
|
||||
# 前端服务
|
||||
frontend:
|
||||
build:
|
||||
context: ./frontend
|
||||
dockerfile: Dockerfile
|
||||
container_name: kline_frontend
|
||||
ports:
|
||||
- "80:80"
|
||||
depends_on:
|
||||
- backend
|
||||
networks:
|
||||
- kline_network
|
||||
restart: unless-stopped
|
||||
|
||||
# Nginx (可选，如果需要额外的反向代理)
|
||||
nginx:
|
||||
image: nginx:alpine
|
||||
container_name: kline_nginx
|
||||
ports:
|
||||
- "8080:80"
|
||||
volumes:
|
||||
- ./deploy/nginx.conf:/etc/nginx/conf.d/default.conf:ro
|
||||
depends_on:
|
||||
- frontend
|
||||
- backend
|
||||
networks:
|
||||
- kline_network
|
||||
restart: unless-stopped
|
||||
profiles:
|
||||
- with-nginx
|
||||
|
||||
networks:
|
||||
kline_network:
|
||||
driver: bridge
|
||||
|
||||
volumes:
|
||||
timescaledb_data:
|
||||
redis_data:
|
||||
backend_data:
|
||||
@ -0,0 +1,21 @@
|
||||
FROM node:18-alpine
|
||||
|
||||
WORKDIR /app
|
||||
|
||||
COPY package.json ./
|
||||
|
||||
RUN npm install
|
||||
|
||||
COPY . .
|
||||
|
||||
RUN npm run build
|
||||
|
||||
FROM nginx:alpine
|
||||
|
||||
COPY --from=0 /app/dist /usr/share/nginx/html
|
||||
|
||||
COPY nginx.conf /etc/nginx/conf.d/default.conf
|
||||
|
||||
EXPOSE 80
|
||||
|
||||
CMD ["nginx", "-g", "daemon off;"]
|
||||
@ -0,0 +1,13 @@
|
||||
<!DOCTYPE html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="UTF-8">
|
||||
<link rel="icon" href="/favicon.ico">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
||||
<title>期货股票数据统一平台</title>
|
||||
</head>
|
||||
<body>
|
||||
<div id="app"></div>
|
||||
<script type="module" src="/src/main.js"></script>
|
||||
</body>
|
||||
</html>
|
||||
@ -0,0 +1,35 @@
|
||||
server {
|
||||
listen 80;
|
||||
server_name localhost;
|
||||
root /usr/share/nginx/html;
|
||||
index index.html;
|
||||
|
||||
# Gzip compression
|
||||
gzip on;
|
||||
gzip_types text/plain text/css application/json application/javascript text/xml application/xml application/xml+rss text/javascript;
|
||||
|
||||
# SPA fallback
|
||||
location / {
|
||||
try_files $uri $uri/ /index.html;
|
||||
}
|
||||
|
||||
# API proxy
|
||||
location /api/ {
|
||||
proxy_pass http://backend:8000/api/;
|
||||
proxy_set_header Host $host;
|
||||
proxy_set_header X-Real-IP $remote_addr;
|
||||
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
|
||||
proxy_set_header X-Forwarded-Proto $scheme;
|
||||
|
||||
# WebSocket support
|
||||
proxy_http_version 1.1;
|
||||
proxy_set_header Upgrade $http_upgrade;
|
||||
proxy_set_header Connection "upgrade";
|
||||
}
|
||||
|
||||
# Cache static assets
|
||||
location /static/ {
|
||||
expires 30d;
|
||||
add_header Cache-Control "public, immutable";
|
||||
}
|
||||
}
|
||||
@ -0,0 +1,35 @@
|
||||
{
|
||||
"name": "kline-frontend",
|
||||
"version": "1.0.0",
|
||||
"private": true,
|
||||
"type": "module",
|
||||
"scripts": {
|
||||
"dev": "vite",
|
||||
"build": "vite build",
|
||||
"preview": "vite preview",
|
||||
"lint": "eslint . --ext .vue,.js,.jsx,.cjs,.mjs --fix",
|
||||
"test": "vitest run",
|
||||
"test:watch": "vitest",
|
||||
"test:coverage": "vitest run --coverage"
|
||||
},
|
||||
"dependencies": {
|
||||
"vue": "^3.4.0",
|
||||
"vue-router": "^4.2.5",
|
||||
"pinia": "^2.1.7",
|
||||
"axios": "^1.6.5",
|
||||
"element-plus": "^2.4.4",
|
||||
"echarts": "^5.4.3",
|
||||
"dayjs": "^1.11.10"
|
||||
},
|
||||
"devDependencies": {
|
||||
"@vitejs/plugin-vue": "^5.0.3",
|
||||
"vite": "^5.0.11",
|
||||
"vitest": "^1.1.3",
|
||||
"@vue/test-utils": "^2.4.3",
|
||||
"jsdom": "^23.2.0",
|
||||
"@vitest/coverage-v8": "^1.1.3",
|
||||
"eslint": "^8.56.0",
|
||||
"eslint-plugin-vue": "^9.20.1",
|
||||
"sass": "^1.69.7"
|
||||
}
|
||||
}
|
||||
@ -0,0 +1,25 @@
|
||||
<template>
|
||||
<router-view />
|
||||
</template>
|
||||
|
||||
<script setup>
|
||||
// 根组件
|
||||
</script>
|
||||
|
||||
<style>
|
||||
* {
|
||||
margin: 0;
|
||||
padding: 0;
|
||||
box-sizing: border-box;
|
||||
}
|
||||
|
||||
body {
|
||||
font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, 'Helvetica Neue', Arial, sans-serif;
|
||||
background-color: #f5f7fa;
|
||||
}
|
||||
|
||||
#app {
|
||||
width: 100%;
|
||||
height: 100vh;
|
||||
}
|
||||
</style>
|
||||
@ -0,0 +1,112 @@
|
||||
import axios from 'axios'
|
||||
import { ElMessage } from 'element-plus'
|
||||
import router from '@/router'
|
||||
|
||||
// 创建 axios 实例
|
||||
const api = axios.create({
|
||||
baseURL: '/api/v1',
|
||||
timeout: 30000,
|
||||
headers: {
|
||||
'Content-Type': 'application/json'
|
||||
}
|
||||
})
|
||||
|
||||
// 请求拦截器
|
||||
api.interceptors.request.use(
|
||||
config => {
|
||||
const token = localStorage.getItem('access_token')
|
||||
if (token) {
|
||||
config.headers.Authorization = `Bearer ${token}`
|
||||
}
|
||||
return config
|
||||
},
|
||||
error => {
|
||||
return Promise.reject(error)
|
||||
}
|
||||
)
|
||||
|
||||
// 响应拦截器
|
||||
api.interceptors.response.use(
|
||||
response => {
|
||||
const res = response.data
|
||||
if (res.code !== 0) {
|
||||
ElMessage.error(res.message || '请求失败')
|
||||
return Promise.reject(new Error(res.message || 'Error'))
|
||||
}
|
||||
return res
|
||||
},
|
||||
error => {
|
||||
if (error.response) {
|
||||
const { status } = error.response
|
||||
|
||||
if (status === 401) {
|
||||
ElMessage.error('登录已过期，请重新登录')
|
||||
localStorage.removeItem('access_token')
|
||||
localStorage.removeItem('refresh_token')
|
||||
router.push('/login')
|
||||
} else if (status === 403) {
|
||||
ElMessage.error('没有权限访问')
|
||||
} else if (status === 404) {
|
||||
ElMessage.error('请求的资源不存在')
|
||||
} else if (status === 429) {
|
||||
ElMessage.error('请求过于频繁，请稍后再试')
|
||||
} else {
|
||||
ElMessage.error(error.response.data?.message || '服务器错误')
|
||||
}
|
||||
} else {
|
||||
ElMessage.error('网络错误，请检查网络连接')
|
||||
}
|
||||
return Promise.reject(error)
|
||||
}
|
||||
)
|
||||
|
||||
// API 方法封装
|
||||
export const authApi = {
|
||||
login: (data) => api.post('/auth/login', data, {
|
||||
headers: { 'Content-Type': 'application/x-www-form-urlencoded' }
|
||||
}),
|
||||
refreshToken: (data) => api.post('/auth/refresh', data),
|
||||
getCurrentUser: () => api.get('/auth/me'),
|
||||
createApiKey: (data) => api.post('/auth/api-key', data),
|
||||
getApiKeys: () => api.get('/auth/api-keys'),
|
||||
revokeApiKey: (id) => api.delete(`/auth/api-key/${id}`)
|
||||
}
|
||||
|
||||
export const klineApi = {
|
||||
getData: (params) => api.get('/kline/data', { params }),
|
||||
getLatest: (params) => api.get('/kline/latest', { params }),
|
||||
getSymbols: () => api.get('/kline/symbols'),
|
||||
getPeriods: () => api.get('/kline/periods')
|
||||
}
|
||||
|
||||
export const realtimeApi = {
|
||||
getQuote: (symbol) => api.get('/realtime/quote', { params: { symbol } }),
|
||||
getQuotes: (symbols) => api.get('/realtime/quotes', { params: { symbols } }),
|
||||
getSubscriptions: () => api.get('/realtime/subscriptions')
|
||||
}
|
||||
|
||||
export const alertApi = {
|
||||
create: (data) => api.post('/alert', data),
|
||||
list: (params) => api.get('/alert', { params }),
|
||||
get: (id) => api.get(`/alert/${id}`),
|
||||
update: (id, data) => api.put(`/alert/${id}`, data),
|
||||
delete: (id) => api.delete(`/alert/${id}`),
|
||||
trigger: (id) => api.post(`/alert/${id}/trigger`)
|
||||
}
|
||||
|
||||
export const subscriptionApi = {
|
||||
create: (data) => api.post('/subscription', data),
|
||||
list: (params) => api.get('/subscription', { params }),
|
||||
get: (id) => api.get(`/subscription/${id}`),
|
||||
cancel: (id) => api.delete(`/subscription/${id}`)
|
||||
}
|
||||
|
||||
export const userApi = {
|
||||
getCurrentUser: () => api.get('/user/me'),
|
||||
updateCurrentUser: (data) => api.put('/user/me', data),
|
||||
list: (params) => api.get('/user', { params }),
|
||||
get: (id) => api.get(`/user/${id}`),
|
||||
updateStatus: (id, isActive) => api.put(`/user/${id}/status`, null, { params: { is_active: isActive } })
|
||||
}
|
||||
|
||||
export default api
|
||||
@ -0,0 +1,183 @@
|
||||
<template>
|
||||
<el-container class="admin-layout">
|
||||
<el-aside width="220px">
|
||||
<div class="logo">
|
||||
<h2>期货股票平台</h2>
|
||||
</div>
|
||||
<el-menu
|
||||
:default-active="activeMenu"
|
||||
router
|
||||
background-color="#304156"
|
||||
text-color="#bfcbd9"
|
||||
active-text-color="#409EFF"
|
||||
>
|
||||
<el-menu-item index="/dashboard">
|
||||
<el-icon><DataAnalysis /></el-icon>
|
||||
<span>仪表盘</span>
|
||||
</el-menu-item>
|
||||
<el-menu-item index="/kline">
|
||||
<el-icon><TrendCharts /></el-icon>
|
||||
<span>K 线图表</span>
|
||||
</el-menu-item>
|
||||
<el-menu-item index="/realtime">
|
||||
<el-icon><Monitor /></el-icon>
|
||||
<span>实时行情</span>
|
||||
</el-menu-item>
|
||||
<el-sub-menu index="alerts">
|
||||
<template #title>
|
||||
<el-icon><Bell /></el-icon>
|
||||
<span>告警管理</span>
|
||||
</template>
|
||||
<el-menu-item index="/alerts/list">告警规则</el-menu-item>
|
||||
<el-menu-item index="/alerts/history">告警历史</el-menu-item>
|
||||
<el-menu-item index="/alerts/stats">告警统计</el-menu-item>
|
||||
</el-sub-menu>
|
||||
<el-sub-menu index="quality">
|
||||
<template #title>
|
||||
<el-icon><DataLine /></el-icon>
|
||||
<span>质量监控</span>
|
||||
</template>
|
||||
<el-menu-item index="/quality/dashboard">质量概览</el-menu-item>
|
||||
<el-menu-item index="/quality/issues">问题列表</el-menu-item>
|
||||
<el-menu-item index="/quality/history">质量趋势</el-menu-item>
|
||||
<el-menu-item index="/quality/rules">监控规则</el-menu-item>
|
||||
</el-sub-menu>
|
||||
<el-menu-item index="/subscriptions">
|
||||
<el-icon><List /></el-icon>
|
||||
<span>数据订阅</span>
|
||||
</el-menu-item>
|
||||
<el-menu-item index="/websocket">
|
||||
<el-icon><Connection /></el-icon>
|
||||
<span>WebSocket 测试</span>
|
||||
</el-menu-item>
|
||||
<el-menu-item index="/settings">
|
||||
<el-icon><Setting /></el-icon>
|
||||
<span>系统设置</span>
|
||||
</el-menu-item>
|
||||
</el-menu>
|
||||
</el-aside>
|
||||
|
||||
<el-container>
|
||||
<el-header>
|
||||
<div class="header-content">
|
||||
<div class="page-title">{{ route.meta.title || '页面' }}</div>
|
||||
<div class="user-info">
|
||||
<el-dropdown>
|
||||
<span class="user-name">
|
||||
{{ userStore.username }}
|
||||
<el-icon><ArrowDown /></el-icon>
|
||||
</span>
|
||||
<template #dropdown>
|
||||
<el-dropdown-menu>
|
||||
<el-dropdown-item @click="handleLogout">
|
||||
<el-icon><SwitchButton /></el-icon>
|
||||
退出登录
|
||||
</el-dropdown-item>
|
||||
</el-dropdown-menu>
|
||||
</template>
|
||||
</el-dropdown>
|
||||
</div>
|
||||
</div>
|
||||
</el-header>
|
||||
|
||||
<el-main>
|
||||
<router-view />
|
||||
</el-main>
|
||||
</el-container>
|
||||
</el-container>
|
||||
</template>
|
||||
|
||||
<script setup>
|
||||
import { computed } from 'vue'
|
||||
import { useRoute, useRouter } from 'vue-router'
|
||||
import {
|
||||
DataAnalysis,
|
||||
TrendCharts,
|
||||
Monitor,
|
||||
Bell,
|
||||
List,
|
||||
Setting,
|
||||
ArrowDown,
|
||||
SwitchButton
|
||||
} from '@element-plus/icons-vue'
|
||||
import { useUserStore } from '@/stores/user'
|
||||
|
||||
const route = useRoute()
|
||||
const router = useRouter()
|
||||
const userStore = useUserStore()
|
||||
|
||||
const activeMenu = computed(() => route.path)
|
||||
|
||||
const handleLogout = () => {
|
||||
userStore.logout()
|
||||
router.push('/login')
|
||||
}
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
.admin-layout {
|
||||
height: 100vh;
|
||||
}
|
||||
|
||||
.el-aside {
|
||||
background-color: #304156;
|
||||
color: #fff;
|
||||
}
|
||||
|
||||
.logo {
|
||||
height: 60px;
|
||||
display: flex;
|
||||
align-items: center;
|
||||
justify-content: center;
|
||||
background-color: #2b3a4b;
|
||||
}
|
||||
|
||||
.logo h2 {
|
||||
color: #fff;
|
||||
font-size: 18px;
|
||||
font-weight: 600;
|
||||
}
|
||||
|
||||
.el-menu {
|
||||
border-right: none;
|
||||
}
|
||||
|
||||
.el-header {
|
||||
background-color: #fff;
|
||||
box-shadow: 0 1px 4px rgba(0,21,41,.08);
|
||||
display: flex;
|
||||
align-items: center;
|
||||
padding: 0 20px;
|
||||
}
|
||||
|
||||
.header-content {
|
||||
width: 100%;
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
align-items: center;
|
||||
}
|
||||
|
||||
.page-title {
|
||||
font-size: 18px;
|
||||
font-weight: 600;
|
||||
color: #333;
|
||||
}
|
||||
|
||||
.user-info {
|
||||
display: flex;
|
||||
align-items: center;
|
||||
}
|
||||
|
||||
.user-name {
|
||||
cursor: pointer;
|
||||
display: flex;
|
||||
align-items: center;
|
||||
gap: 5px;
|
||||
color: #606266;
|
||||
}
|
||||
|
||||
.el-main {
|
||||
background-color: #f5f7fa;
|
||||
padding: 20px;
|
||||
}
|
||||
</style>
|
||||
@ -0,0 +1,84 @@
|
||||
<template>
|
||||
<div class="public-layout">
|
||||
<el-header class="public-header">
|
||||
<div class="header-content">
|
||||
<div class="logo">
|
||||
<h2>期货股票数据平台</h2>
|
||||
</div>
|
||||
<el-menu mode="horizontal" :ellipsis="false" router>
|
||||
<el-menu-item index="/market">
|
||||
<el-icon><TrendCharts /></el-icon>
|
||||
市场行情
|
||||
</el-menu-item>
|
||||
<el-menu-item index="/market/chart/IF2406">
|
||||
<el-icon><DataLine /></el-icon>
|
||||
K 线图表
|
||||
</el-menu-item>
|
||||
<el-menu-item index="/login">
|
||||
<el-icon><User /></el-icon>
|
||||
登录
|
||||
</el-menu-item>
|
||||
</el-menu>
|
||||
</div>
|
||||
</el-header>
|
||||
|
||||
<el-main class="public-main">
|
||||
<router-view />
|
||||
</el-main>
|
||||
|
||||
<el-footer class="public-footer">
|
||||
<p>© 2026 期货股票数据统一平台 - 提供专业 K 线数据与实时行情服务</p>
|
||||
</el-footer>
|
||||
</div>
|
||||
</template>
|
||||
|
||||
<script setup>
|
||||
import { TrendCharts, DataLine, User } from '@element-plus/icons-vue'
|
||||
</script>
|
||||
|
||||
<style scoped>
|
||||
.public-layout {
|
||||
min-height: 100vh;
|
||||
display: flex;
|
||||
flex-direction: column;
|
||||
}
|
||||
|
||||
.public-header {
|
||||
background-color: #fff;
|
||||
box-shadow: 0 2px 8px rgba(0,0,0,0.1);
|
||||
padding: 0 40px;
|
||||
}
|
||||
|
||||
.header-content {
|
||||
max-width: 1400px;
|
||||
margin: 0 auto;
|
||||
width: 100%;
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
align-items: center;
|
||||
}
|
||||
|
||||
.logo h2 {
|
||||
color: #409EFF;
|
||||
font-size: 20px;
|
||||
font-weight: 600;
|
||||
}
|
||||
|
||||
.public-main {
|
||||
flex: 1;
|
||||
background-color: #f5f7fa;
|
||||
padding: 20px 40px;
|
||||
}
|
||||
|
||||
.public-footer {
|
||||
background-color: #304156;
|
||||
color: #bfcbd9;
|
||||
text-align: center;
|
||||
padding: 20px;
|
||||
}
|
||||
|
||||
.public-footer p {
|
||||
margin: 0;
|
||||
font-size: 14px;
|
||||
}
|
||||
</style>
|
||||
@ -0,0 +1,19 @@
|
||||
import { createApp } from 'vue'
|
||||
import { createPinia } from 'pinia'
|
||||
import ElementPlus from 'element-plus'
|
||||
import 'element-plus/dist/index.css'
|
||||
import zhCn from 'element-plus/es/locale/lang/zh-cn'
|
||||
|
||||
import App from './App.vue'
|
||||
import router from './router'
|
||||
|
||||
const app = createApp(App)
|
||||
const pinia = createPinia()
|
||||
|
||||
app.use(pinia)
|
||||
app.use(router)
|
||||
app.use(ElementPlus, {
|
||||
locale: zhCn,
|
||||
})
|
||||
|
||||
app.mount('#app')
|
||||
@ -0,0 +1,102 @@
|
||||
import { createRouter, createWebHistory } from 'vue-router'
|
||||
|
||||
const routes = [
|
||||
{
|
||||
path: '/login',
|
||||
name: 'Login',
|
||||
component: () => import('@/views/Login.vue')
|
||||
},
|
||||
{
|
||||
path: '/',
|
||||
component: () => import('@/layouts/AdminLayout.vue'),
|
||||
redirect: '/dashboard',
|
||||
children: [
|
||||
{
|
||||
path: 'dashboard',
|
||||
name: 'Dashboard',
|
||||
component: () => import('@/views/admin/Dashboard.vue'),
|
||||
meta: { title: '仪表盘' }
|
||||
},
|
||||
{
|
||||
path: 'kline',
|
||||
name: 'Kline',
|
||||
component: () => import('@/views/admin/KlineChart.vue'),
|
||||
meta: { title: 'K 线图表' }
|
||||
},
|
||||
{
|
||||
path: 'realtime',
|
||||
name: 'Realtime',
|
||||
component: () => import('@/views/admin/RealtimeQuotes.vue'),
|
||||
meta: { title: '实时行情' }
|
||||
},
|
||||
{
|
||||
path: 'alerts',
|
||||
name: 'Alerts',
|
||||
component: () => import('@/views/admin/Alerts.vue'),
|
||||
meta: { title: '告警管理' }
|
||||
},
|
||||
{
|
||||
path: 'subscriptions',
|
||||
name: 'Subscriptions',
|
||||
component: () => import('@/views/admin/Subscriptions.vue'),
|
||||
meta: { title: '数据订阅' }
|
||||
},
|
||||
{
|
||||
path: 'settings',
|
||||
name: 'Settings',
|
||||
component: () => import('@/views/admin/Settings.vue'),
|
||||
meta: { title: '系统设置' }
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
path: '/market',
|
||||
component: () => import('@/layouts/PublicLayout.vue'),
|
||||
children: [
|
||||
{
|
||||
path: '',
|
||||
name: 'PublicMarket',
|
||||
component: () => import('@/views/public/MarketOverview.vue'),
|
||||
meta: { title: '市场行情' }
|
||||
},
|
||||
{
|
||||
path: 'chart/:symbol',
|
||||
name: 'PublicChart',
|
||||
component: () => import('@/views/public/ChartView.vue'),
|
||||
meta: { title: 'K 线图表' }
|
||||
},
|
||||
{
|
||||
path: 'detail/:symbol',
|
||||
name: 'PublicDetail',
|
||||
component: () => import('@/views/public/QuoteDetail.vue'),
|
||||
meta: { title: '行情详情' }
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
path: '/:pathMatch(.*)*',
|
||||
name: 'NotFound',
|
||||
component: () => import('@/views/NotFound.vue')
|
||||
}
|
||||
]
|
||||
|
||||
const router = createRouter({
|
||||
history: createWebHistory(),
|
||||
routes
|
||||
})
|
||||
|
||||
// 路由守卫
|
||||
router.beforeEach((to, from, next) => {
|
||||
document.title = to.meta.title ? `${to.meta.title} - 期货股票数据平台` : '期货股票数据平台'
|
||||
|
||||
const token = localStorage.getItem('access_token')
|
||||
const publicPaths = ['/login', '/market', '/public']
|
||||
|
||||
if (!token && !publicPaths.some(path => to.path.startsWith(path))) {
|
||||
next('/login')
|
||||
} else {
|
||||
next()
|
||||
}
|
||||
})
|
||||
|
||||
export default router
|
||||
@ -0,0 +1,64 @@
|
||||
import { defineStore } from 'pinia'
|
||||
import { authApi } from '@/api'
|
||||
|
||||
export const useUserStore = defineStore('user', {
|
||||
state: () => ({
|
||||
token: localStorage.getItem('access_token') || '',
|
||||
refreshToken: localStorage.getItem('refresh_token') || '',
|
||||
userInfo: null
|
||||
}),
|
||||
|
||||
getters: {
|
||||
isLoggedIn: (state) => !!state.token,
|
||||
username: (state) => state.userInfo?.username || '',
|
||||
role: (state) => state.userInfo?.role || ''
|
||||
},
|
||||
|
||||
actions: {
|
||||
async login(username, password) {
|
||||
const formData = new URLSearchParams()
|
||||
formData.append('username', username)
|
||||
formData.append('password', password)
|
||||
|
||||
const res = await authApi.login(formData)
|
||||
this.token = res.data.access_token
|
||||
this.refreshToken = res.data.refresh_token
|
||||
|
||||
localStorage.setItem('access_token', this.token)
|
||||
localStorage.setItem('refresh_token', this.refreshToken)
|
||||
|
||||
await this.fetchUserInfo()
|
||||
},
|
||||
|
||||
async fetchUserInfo() {
|
||||
try {
|
||||
const res = await authApi.getCurrentUser()
|
||||
this.userInfo = res.data
|
||||
} catch (error) {
|
||||
console.error('Failed to fetch user info:', error)
|
||||
}
|
||||
},
|
||||
|
||||
logout() {
|
||||
this.token = ''
|
||||
this.refreshToken = ''
|
||||
this.userInfo = null
|
||||
localStorage.removeItem('access_token')
|
||||
localStorage.removeItem('refresh_token')
|
||||
},
|
||||
|
||||
async refreshToken() {
|
||||
try {
|
||||
const res = await authApi.refreshToken({
|
||||
refresh_token: this.refreshToken
|
||||
})
|
||||
this.token = res.data.access_token
|
||||
localStorage.setItem('access_token', this.token)
|
||||
return true
|
||||
} catch (error) {
|
||||
this.logout()
|
||||
return false
|
||||
}
|
||||
}
|
||||
}
|
||||
})
|
||||
Some files were not shown because too many files have changed in this diff Show More
Loading…
Reference in new issue