About This Release
Historical Data Retrieval for LMP Feeds and a bug fix.
In order to maintain good query performance for recent data, Data Miner is implementing Data Archiving for older historical data for the larger data feeds. This will allow the retrieval of historical data while still preserving performance for more recent, frequently queried data. Data Archiving is being implemented for the following feeds: Real-Time Five Minute LMPs, Real-Time Hourly LMPs and Day-Ahead Hourly LMPs.
The impact of Data archiving are noted below. A guide on historical data has been published on the Data Miner 2 Tools page.
Historic data will be available via UI and API as it is today
The data structure, format and layout has not changed
Historic data start and end dates are rolling dates, not calendar dates
Historic data has fewer querying options
API request and response structure, format and field definitions have not changed
Appropriate error messages will be returned to users if UI and/or API query contains a filter that is not available for historic data
Bug Fixes and Steps to Recreate
The validation for date range to not exceed 366 was not working for feeds that had the EPT and UTC as datetimestamps (instead of just date). This has now been fixed, and users attempting to use a date range more than 366 days for any feed will receive validation errors.
Historical Data Guide PDF