Refactor sql analysis (238)
Added
- General filter module for Analysis
- Tests
Changed
- Refactor sql analysis and migrate it ReadHandler
15
Added
- SLURM module: models.py and api.py
- get_squeue_result for reading squeue output into Pydantic models
- get_current_analysis_status for getting the analysis status based on job status distribution
- SqueueResult and SqueueJob Pydantic models
- Constants:
- SlurmJobStatus
- HOURS_IN_DAY
- MINUTES_PER_HOUR
- SCALE_SECONDS_TO_MINUTES
- SlurmSqueueHeader
- Pipeline
- CSV file extension and file format
- Header to squeue output to enable CSV dict stream parsing and aliasing in Pydantic model
- Reading CSV str stream into list of dicts
- Tests
Refactor reading squeue output (241)
Changed
- Lock Pydantic version to 1.10.9
- Remove Pandas
- TrailblazerStatus to be a str based enum, enabling removal of ".value" accessing
- Decode bytes to string in subprocessing squeue output
- Refactored sacct test fixtures into squeue csv files
- All parsing oof squeue output is done when initializing Squeue Pydantic models