ISO-DART

Getting Started

  • Installation Guide
    • System Requirements
    • Quick Install
    • Detailed Installation
      • Step 1: Check Python Version
      • Step 2: Install Git
      • Step 3: Clone Repository
      • Step 4: Create Virtual Environment (Recommended)
      • Step 5: Install Dependencies
      • Step 6: Verify Installation
    • Alternative Installation Methods
      • Method 1: Conda/Mamba
      • Method 2: Pipenv
      • Method 3: System-Wide Install (Not Recommended)
      • Method 4: Development Install
    • Optional Dependencies
      • For Documentation Building
      • For Development
      • For Data Analysis
    • Configuration
      • API Keys (Optional)
      • Directory Structure
    • Troubleshooting Installation
      • Issue: “python: command not found”
      • Issue: “pip: command not found”
      • Issue: Permission denied errors
      • Issue: SSL certificate errors
      • Issue: Dependency conflicts
      • Issue: pandas or numpy install fails
    • Platform-Specific Notes
      • Linux
      • macOS
      • Windows
    • Updating ISO-DART
    • Uninstalling
    • Testing Your Installation
    • Post-Installation Setup
    • Docker Installation (Advanced)
    • Next Steps
    • Getting Help
    • Installation Checklist
  • ISO-DART v2.0 Quick Start Guide
    • 🚀 Installation (2 minutes)
    • 📊 Your First Download (3 minutes)
      • Option 1: Interactive Mode (Easiest)
      • Option 2: Command Line (Fastest)
    • 📈 Using Your Data
      • Load and Visualize
      • Basic Analysis
    • 🌤️ Weather Data
      • Analyze Weather Data
    • 🔄 Common Workflows
      • 1. Download Multiple Markets
      • 2. Automated Daily Download
      • 3. Compare Multiple Locations
    • 🔍 Troubleshooting
      • Issue: “ModuleNotFoundError”
      • Issue: “No data returned”
      • Issue: Slow downloads
    • 📚 Next Steps
    • 💡 Pro Tips
    • 🎯 Useful Commands
    • 🤝 Need Help?
    • ⚡ Power User Shortcut
  • ISO-DART Migration Guide: v1.1 → v2.0
    • Overview
    • 🎯 Quick Summary
    • 🚀 Migration Steps
      • 1. Backup Your Data
      • 2. Update Python Version
      • 3. Install v2.0
      • 4. Verify Installation
    • 🔄 Code Migration
      • Old Way (v1.1)
      • New Way (v2.0)
    • 📋 Breaking Changes
      • 1. File Structure
      • 2. Import Changes
      • 3. Query Class Changes
      • 4. Error Handling
      • 5. Configuration
    • 🆕 New Features
      • 1. Command-Line Interface
      • 2. Logging
      • 3. Type Safety
      • 4. Testing
      • 5. Better Error Messages
    • 🔧 Custom Script Migration
      • Example: Automated Daily Download
      • Example: Multi-Market Download
    • 📊 Data Compatibility
    • ⚠️ Known Issues & Solutions
      • Issue 1: pdb.set_trace() removed
      • Issue 2: exec(open().read()) not supported
      • Issue 3: Different error handling
    • 🎓 Learning Resources
      • For New v2.0 Features
      • For Python Modernization
    • 📞 Getting Help
      • During Migration
      • Common Migration Questions
    • ✅ Migration Checklist
    • 🎉 You’re Ready!

User Guide

  • User Guide
    • Interactive Mode Guide
      • Overview
      • Starting Interactive Mode
      • Main Menu Options
        • Option 1: ISO Data
        • Option 2: Weather Data
      • Complete Walkthrough: CAISO Example
        • Step 1: Select Data Source
        • Step 2: Select Data Category
        • Step 3: Select Specific Data Type
        • Step 4: Select Market
        • Step 5: Enter Date Range
        • Step 6: Download Progress
      • Navigation Tips
        • Going Back
        • Input Validation
        • Date Validation
      • ISO-Specific Features
        • CAISO Interactive Mode
        • MISO Interactive Mode
        • NYISO Interactive Mode
        • SPP Interactive Mode
        • BPA Interactive Mode
      • Weather Data Interactive Mode
        • Step-by-Step: Weather Download
      • Tips for Efficient Use
        • Batch Downloads
        • Taking Notes
        • Large Date Ranges
        • Keyboard Shortcuts
      • Common Workflows
        • Daily Price Check
        • Weekly Data Collection
        • Monthly Analysis Prep
      • Troubleshooting Interactive Mode
        • Issue: “Invalid choice” errors
        • Issue: No data stations found (weather)
        • Issue: Download hangs or is very slow
        • Issue: “Connection error” or “Timeout”
      • Getting Help
        • Within Interactive Mode
        • After Download
        • Documentation
      • Exiting Interactive Mode
        • Graceful Exit
      • Comparison with Other Modes
      • Next Steps
      • See Also
    • Command Line Usage Guide
      • Overview
      • Basic Syntax
      • Quick Examples
      • Global Options
        • Required Arguments
        • Optional Arguments
      • ISO-Specific Options
        • CAISO Options
        • MISO Options
        • NYISO Options
        • SPP Options
        • BPA Options
        • PJM Options
        • ISO-NE Options
      • Weather Data Options
      • Advanced Usage
        • Using Configuration Files
        • Automation with Cron
        • Batch Processing
      • Output Files
      • Logging
      • Error Handling
        • Common Errors
        • Exit Codes
      • Best Practices
      • Command Reference
        • Quick Reference Table
    • Python API Guide
      • Overview
      • Installation
      • Basic Usage Pattern
      • CAISO Client
        • Basic LMP Download
        • Available Markets
        • Load Forecasts
        • Renewable Generation
        • Ancillary Services
        • Custom Configuration
      • MISO Client
        • Setup with API Keys
        • LMP Data
        • Available LMP Types
        • Load and Generation
        • Working with MISO Data
      • NYISO Client
        • Basic Usage
      • SPP Client
        • LMP Data
        • Load and Resource Forecasts
      • BPA Client
        • Historical Data
      • PJM Client
        • Setup
        • LMP Data
      • ISO-NE Client
        • Basic Usage
      • Weather Client
        • Download Weather Data
      • Advanced Patterns
        • Multi-ISO Download
        • Error Handling
        • Async/Parallel Downloads
        • Data Processing Pipeline
        • Custom Retry Logic
      • Best Practices
        • 1. Always Clean Up
        • 2. Check Return Values
        • 3. Use Appropriate Date Ranges
        • 4. Configure Logging
      • Type Hints
      • Next Steps
    • Data Formats Guide
      • Overview
      • General CSV Format
      • File Naming Conventions
        • CAISO
        • MISO
        • NYISO
        • SPP
        • BPA
        • PJM
        • Weather
      • Data Schemas
        • CAISO LMP Data
        • CAISO Load Forecast
        • CAISO Wind/Solar Summary
        • MISO LMP Data
        • MISO Fuel Mix
        • NYISO LBMP Data
        • NYISO Fuel Mix
        • SPP LMP Data
      • Working with Data
        • Loading in Python
        • Loading in R
        • Excel Import
        • Database Import
      • Data Quality Checks
        • Validate Date Ranges
        • Check for Nulls
        • Validate Intervals
      • Time Zones
        • CAISO
        • MISO
        • NYISO
        • SPP
        • PJM
      • Next Steps
  • Interactive Mode Guide
    • Overview
    • Starting Interactive Mode
    • Main Menu Options
      • Option 1: ISO Data
      • Option 2: Weather Data
    • Complete Walkthrough: CAISO Example
      • Step 1: Select Data Source
      • Step 2: Select Data Category
      • Step 3: Select Specific Data Type
      • Step 4: Select Market
      • Step 5: Enter Date Range
      • Step 6: Download Progress
    • Navigation Tips
      • Going Back
      • Input Validation
      • Date Validation
    • ISO-Specific Features
      • CAISO Interactive Mode
      • MISO Interactive Mode
      • NYISO Interactive Mode
      • SPP Interactive Mode
      • BPA Interactive Mode
    • Weather Data Interactive Mode
      • Step-by-Step: Weather Download
    • Tips for Efficient Use
      • Batch Downloads
      • Taking Notes
      • Large Date Ranges
      • Keyboard Shortcuts
    • Common Workflows
      • Daily Price Check
      • Weekly Data Collection
      • Monthly Analysis Prep
    • Troubleshooting Interactive Mode
      • Issue: “Invalid choice” errors
      • Issue: No data stations found (weather)
      • Issue: Download hangs or is very slow
      • Issue: “Connection error” or “Timeout”
    • Getting Help
      • Within Interactive Mode
      • After Download
      • Documentation
    • Exiting Interactive Mode
      • Graceful Exit
    • Comparison with Other Modes
    • Next Steps
    • See Also
  • Command Line Usage Guide
    • Overview
    • Basic Syntax
    • Quick Examples
    • Global Options
      • Required Arguments
      • Optional Arguments
    • ISO-Specific Options
      • CAISO Options
      • MISO Options
      • NYISO Options
      • SPP Options
      • BPA Options
      • PJM Options
      • ISO-NE Options
    • Weather Data Options
    • Advanced Usage
      • Using Configuration Files
      • Automation with Cron
      • Batch Processing
    • Output Files
    • Logging
    • Error Handling
      • Common Errors
      • Exit Codes
    • Best Practices
    • Command Reference
      • Quick Reference Table
  • Python API Guide
    • Overview
    • Installation
    • Basic Usage Pattern
    • CAISO Client
      • Basic LMP Download
      • Available Markets
      • Load Forecasts
      • Renewable Generation
      • Ancillary Services
      • Custom Configuration
    • MISO Client
      • Setup with API Keys
      • LMP Data
      • Available LMP Types
      • Load and Generation
      • Working with MISO Data
    • NYISO Client
      • Basic Usage
    • SPP Client
      • LMP Data
      • Load and Resource Forecasts
    • BPA Client
      • Historical Data
    • PJM Client
      • Setup
      • LMP Data
    • ISO-NE Client
      • Basic Usage
    • Weather Client
      • Download Weather Data
    • Advanced Patterns
      • Multi-ISO Download
      • Error Handling
      • Async/Parallel Downloads
      • Data Processing Pipeline
      • Custom Retry Logic
    • Best Practices
      • 1. Always Clean Up
      • 2. Check Return Values
      • 3. Use Appropriate Date Ranges
      • 4. Configure Logging
    • Type Hints
    • Next Steps
  • Data Formats Guide
    • Overview
    • General CSV Format
    • File Naming Conventions
      • CAISO
      • MISO
      • NYISO
      • SPP
      • BPA
      • PJM
      • Weather
    • Data Schemas
      • CAISO LMP Data
      • CAISO Load Forecast
      • CAISO Wind/Solar Summary
      • MISO LMP Data
      • MISO Fuel Mix
      • NYISO LBMP Data
      • NYISO Fuel Mix
      • SPP LMP Data
    • Working with Data
      • Loading in Python
      • Loading in R
      • Excel Import
      • Database Import
    • Data Quality Checks
      • Validate Date Ranges
      • Check for Nulls
      • Validate Intervals
    • Time Zones
      • CAISO
      • MISO
      • NYISO
      • SPP
      • PJM
    • Next Steps

ISO Coverage

  • ISO Coverage
    • CAISO Documentation
      • CAISO Data Guide
        • Overview
        • Quick Reference
        • CAISO Markets
        • Available Data Types
        • Common Workflows
        • Data Quality & Limitations
        • Performance Tips
        • Troubleshooting
        • Additional Resources
        • Next Steps
    • MISO Documentation
      • MISO Data Guide
        • Overview
        • Quick Reference
        • MISO Markets
        • API Access & Authentication
        • Available Data Types
        • Common Workflows
        • Data Quality & Limitations
        • Performance Tips
        • Troubleshooting
        • Additional Resources
        • Next Steps
  • CAISO Documentation
    • CAISO Data Guide
      • Overview
      • Quick Reference
      • CAISO Markets
        • Day-Ahead Market (DAM)
        • Hour-Ahead Scheduling Process (HASP)
        • Real-Time Market (RTM)
        • Real-Time Pre-Dispatch (RTPD)
        • Residual Unit Commitment (RUC)
      • Available Data Types
        • 1. Pricing Data
        • 2. Load Data
        • 3. Generation & Resources
        • 4. Market Operations Data
        • 5. Ancillary Services
      • Common Workflows
        • 1. Daily Price Monitoring
        • 2. Renewable Generation Analysis
      • Data Quality & Limitations
        • Update Schedule
        • Historical Data Availability
        • Known Issues
        • Data Validation
      • Performance Tips
        • 1. Optimize Date Ranges
        • 2. Adjust Step Size
        • 3. Parallel Downloads
      • Troubleshooting
        • Issue: “API Error 404: Data not found”
        • Issue: Slow Downloads
        • Issue: Missing Intervals
      • Additional Resources
      • Next Steps
  • MISO Documentation
    • MISO Data Guide
      • Overview
      • Quick Reference
      • MISO Markets
        • Day-Ahead Market
        • Real-Time Market
      • API Access & Authentication
        • Pricing API
        • Load, Generation & Interchange (LGI) API
        • Configuration Setup
      • Available Data Types
        • 1. Pricing Data
        • 2. Load & Demand Data
        • 3. Generation Data
        • 4. Interchange Data
        • 5. Outages & Constraints
      • Common Workflows
        • 1. Daily Price Update
        • 2. Fuel Mix Analysis
        • 3. Load Correlation Study
      • Data Quality & Limitations
        • Update Schedule
        • Historical Data
        • Known Issues
        • Rate Limiting
      • Performance Tips
        • 1. Use Filters
        • 2. Adjust Time Resolution
        • 3. Batch Processing
      • Troubleshooting
        • Issue: “Authentication failed - check API key”
        • Issue: “No data returned”
        • Issue: Rate limit errors (429)
        • Issue: Timeout errors
      • Additional Resources
      • Next Steps

Weather & Solar

  • Weather & Solar Data

Tutorials

  • Basic Tutorials
    • Your First Data Download
      • Prerequisites
      • Step 1: Choose Your Data
      • Step 2: Download the Data
        • Method 1: Interactive Mode (Recommended for First Time)
        • Method 2: Command Line (Faster)
        • Method 3: Python Script (Most Flexible)
      • Step 3: Verify Your Download
      • Step 4: Load the Data
      • Step 5: Explore the Data
      • Step 6: Create Your First Visualization
      • Understanding Your Results
        • What the Visualization Shows
        • Why Do Prices Vary?
        • Common Patterns
      • Step 7: Compare Multiple Locations
      • Troubleshooting
        • Issue: “FileNotFoundError”
        • Issue: “No module named ‘pandas’”
        • Issue: Empty or Invalid Data
        • Issue: Plot Doesn’t Display
      • Next Steps
      • Practice Exercises
        • Exercise 1: Different Time Period
        • Exercise 2: Calculate Volatility
        • Exercise 3: Weekend vs. Weekday
      • Key Takeaways
      • Resources
      • Need Help?
    • Automating Data Downloads
      • Overview
      • Prerequisites
      • Part 1: Daily Download Script
        • Create the Script
        • Test the Script
      • Part 2: Multi-ISO Download Script
      • Part 3: Scheduling on Linux/Mac (cron)
        • Basic Cron Setup
        • Advanced Cron Examples
        • Cron with Virtual Environment
        • Verify Cron Jobs
      • Part 4: Scheduling on Windows (Task Scheduler)
        • Create Batch File
        • Create Scheduled Task
        • PowerShell Script Alternative
      • Part 5: Email Notifications
        • Add Email to Script
      • Part 6: Error Handling and Retry Logic
        • Robust Download Script
      • Part 7: Monitoring and Alerts
        • Check for Missing Data
      • Part 8: Complete Production Script
      • Best Practices
      • Troubleshooting
        • Cron job not running
        • Script works manually but not in cron
        • Email notifications not working
      • Next Steps
      • See Also
  • Intermediate Tutorials
  • Advanced Tutorials
  • Analysis Examples

API Reference

  • API Reference
    • CAISO API Reference
      • CAISOClient
        • CAISOClient.__init__()
        • CAISOClient.__init__()
        • CAISOClient.get_lmp()
        • CAISOClient.get_load_forecast()
        • CAISOClient.get_ancillary_services_prices()
        • CAISOClient.get_fuel_prices()
        • CAISOClient.get_wind_solar_summary()
        • CAISOClient.get_ghg_allowance_prices()
        • CAISOClient.get_intertie_constraint_shadow_prices()
        • CAISOClient.get_system_load()
        • CAISOClient.get_market_power_mitigation()
        • CAISOClient.get_flex_ramp_requirements()
        • CAISOClient.get_flex_ramp_awards()
        • CAISOClient.get_flex_ramp_demand_curve()
        • CAISOClient.get_eim_transfer()
        • CAISOClient.get_eim_transfer_limits()
        • CAISOClient.get_ancillary_services_requirements()
        • CAISOClient.get_ancillary_services_results()
        • CAISOClient.get_operating_reserves()
        • CAISOClient.get_scheduling_point_tie_prices()
        • CAISOClient.get_advisory_demand_forecast()
        • CAISOClient.get_curtailed_non_operational_reports()
        • CAISOClient.cleanup()
      • Configuration
        • CAISOConfig
      • Market Types
        • Market
      • Report Versions
        • ReportVersion
      • Main Methods
        • Pricing Data
        • Load Data
        • Generation Data
        • Market Operations
        • Ancillary Services
        • Utility Methods
      • Private Methods
        • CAISOClient._build_params()
        • CAISOClient._make_request()
        • CAISOClient._extract_zip()
        • CAISOClient._xml_to_csv()
        • CAISOClient._process_csv()
      • Examples
        • Basic LMP Download
        • Custom Configuration
        • Multiple Markets
      • See Also
      • Notes
  • CAISO API Reference
    • CAISOClient
      • CAISOClient.__init__()
      • CAISOClient.__init__()
      • CAISOClient.get_lmp()
      • CAISOClient.get_load_forecast()
      • CAISOClient.get_ancillary_services_prices()
      • CAISOClient.get_fuel_prices()
      • CAISOClient.get_wind_solar_summary()
      • CAISOClient.get_ghg_allowance_prices()
      • CAISOClient.get_intertie_constraint_shadow_prices()
      • CAISOClient.get_system_load()
      • CAISOClient.get_market_power_mitigation()
      • CAISOClient.get_flex_ramp_requirements()
      • CAISOClient.get_flex_ramp_awards()
      • CAISOClient.get_flex_ramp_demand_curve()
      • CAISOClient.get_eim_transfer()
      • CAISOClient.get_eim_transfer_limits()
      • CAISOClient.get_ancillary_services_requirements()
      • CAISOClient.get_ancillary_services_results()
      • CAISOClient.get_operating_reserves()
      • CAISOClient.get_scheduling_point_tie_prices()
      • CAISOClient.get_advisory_demand_forecast()
      • CAISOClient.get_curtailed_non_operational_reports()
      • CAISOClient.cleanup()
    • Configuration
      • CAISOConfig
        • CAISOConfig.base_url
        • CAISOConfig.query_date_format
        • CAISOConfig.data_date_format
        • CAISOConfig.raw_dir
        • CAISOConfig.xml_dir
        • CAISOConfig.data_dir
        • CAISOConfig.max_retries
        • CAISOConfig.retry_delay
        • CAISOConfig.timeout
        • CAISOConfig.__init__()
    • Market Types
      • Market
        • Market.DAM
        • Market.HASP
        • Market.RTM
        • Market.RTPD
        • Market.RUC
        • Market.TWO_DA
        • Market.SEVEN_DA
        • Market.ACTUAL
    • Report Versions
      • ReportVersion
        • ReportVersion.V1
        • ReportVersion.V4
        • ReportVersion.V5
        • ReportVersion.__init__()
    • Main Methods
      • Pricing Data
        • CAISOClient.get_lmp()
        • CAISOClient.get_ancillary_services_prices()
        • CAISOClient.get_fuel_prices()
        • CAISOClient.get_ghg_allowance_prices()
      • Load Data
        • CAISOClient.get_load_forecast()
        • CAISOClient.get_advisory_demand_forecast()
      • Generation Data
        • CAISOClient.get_wind_solar_summary()
        • CAISOClient.get_system_load()
      • Market Operations
        • CAISOClient.get_market_power_mitigation()
        • CAISOClient.get_flex_ramp_requirements()
        • CAISOClient.get_flex_ramp_awards()
        • CAISOClient.get_flex_ramp_demand_curve()
        • CAISOClient.get_eim_transfer()
        • CAISOClient.get_eim_transfer_limits()
      • Ancillary Services
        • CAISOClient.get_ancillary_services_requirements()
        • CAISOClient.get_ancillary_services_results()
        • CAISOClient.get_operating_reserves()
      • Utility Methods
        • CAISOClient.cleanup()
    • Private Methods
      • CAISOClient._build_params()
      • CAISOClient._make_request()
      • CAISOClient._extract_zip()
      • CAISOClient._xml_to_csv()
      • CAISOClient._process_csv()
    • Examples
      • Basic LMP Download
      • Custom Configuration
      • Multiple Markets
    • See Also
    • Notes

Developer Guide

  • Developer Guide

Operations

  • Operations Guide

Reference

  • Reference
ISO-DART
  • API Reference
  • View page source

API Reference

Complete API documentation for all ISO-DART clients.

  • CAISO API Reference
    • CAISOClient
    • Configuration
    • Market Types
    • Report Versions
    • Main Methods
    • Private Methods
    • Examples
    • See Also
    • Notes
Previous Next

© Copyright 2024, Lawrence Livermore National Laboratory.

Built with Sphinx using a theme provided by Read the Docs.