NYISO DECISION SUPPORT SYSTEM

NYISO DECISION SUPPORT SYSTEM

INTRODUCTION TRAINING COURSE

Presented by Jack Valentine

JValentine@nyiso.com

518 356 6220

If possible, please put your phone on mute.

Please do not use the hold button.

Training Agenda

• Course Background

– DSS Training Offerings

– Course Goals

– Supporting Documentation

• DSS Background Information

– What is a Data Warehouse/DSS?

– NYISO DSS Project Overview

– Corporate Report Overview

• Getting Started

DSS Training Offerings

• Introduction Training Course

– Instructor led online training course covering the basics of

NYISO’s DSS (WebEx delivered).

• Intermediate Training Course

– Instructor led classroom training course covering intermediate

topics such as custom report creation.

• Self-Directed Introduction Training Course

– Download and view the DSS Introduction Training Course on

NYISO’s DSS from the NYISO website (planned course).

• Third Party Offerings

– Independent training organizations offer a wide variety of

training programs on Business Objects.

Course Goals & Objectives

• WILL PROVIDE

9 An introduction to the DSS

9 An introduction to data warehouses in general

9 A brief overview of the data contained in the DSS

9 A demonstration of the basic features of DSS toolset

9 An overview of DSS Corporate Reports

• WILL NOT INCLUDE:

⊗ Training on intermediate features of the DSS Toolset –

see the NYISO DSS Intermediate Course

⊗ Advanced Business Objects training – available from

third parties.

Supporting Documentation

• The following documents should be used as

supplementary documentation for this

course:

– NYISO DSS Users Guide

– NYISO Billing and Accounting Manual

– DSS User Administration Technical

Bulletin-#109

– DSS Release Matrix

– DSS Customer Settlements Billing Code

Mapping Document

Data Warehouse Definition

• Data Warehouse

– Repository of integrated, non-volatile and

time-variant data, collected from heterogeneous

transaction processing applications, and stored in

a format optimal for reporting and strategic

analysis for an enterprise -- Bill Inmon

For NYISO…

- Data from BAS, MIS and Consolidated Invoice

applications is collected, formatted and stored in a

single, centralized location for customer

Data Warehouse Components

Data

Data

Warehouse

Warehouse

Store

Store

Feed

Feed

Use

Use

User Tools

(ETL)

Business Objects Introduction

MIS

BAS

Warehouse

Data

Power Suppliers

Load Serving Entities

Transaction Customers

Universe

: View of a functional set of data within the warehouse

Classes/Sub-classes

: Groups of objects

Objects

: Individual data elements (for reporting and filtering)

Example: Organization, Interval Start Time

Hierarchy

Data Prep & Transfer

Virtual Market

Customers

Etc.

~1200 data

elements

BO Universe Design Examples

• Universe:

– Power Suppliers

– Class/Sub-class:

• Objects:

– Class/Sub-class:

– DAM Energy Settlement / Hourly / Settlement Results

• Objects:

– Hourly DAM Energy Settlement ($)

– Hourly DAM Loss Settlement ($)

– Hourly DAM Congestion Settlement ($)

– Hourly Total DAM Settlement ($)

• Universe:

– Virtual Market Customers

– Class/Sub-class:

– Virtual Supply Market / Virtual Supply Bus

• Objects:

– Virtual Supply Bus Name – Virtual Supply Bus PTID

– Class/Sub-class:

– Virtual Load Market / BalMkt Virtual Load Settlement / SCD / Billing Determinants

• Objects:

– Hourly DAM Virtual Load Energy (MW)

– SCD RT Energy Price :Virtual Load Bus ($/MW)

– SCD RT Loss Price :Virtual Load Bus ($/MW)

– SCD RT Congestion Price :Virtual Load Bus ($/MW)

DSS Versioning Strategy

BAS

Settlement Versions

Advisory 1

Advisory 2

Advisory 3

Advisory 4

Invoice From Version 4

Advisory 5

Invoice

DSS

Settlement Versions

Version 0

Version 0

Version 0

Version 0

Version 1 Invoice

Version 0

Version 2 Invoice

Key Point: Version 0, when it exist, represents the latest version of

settlement data. If Version 0 does not exist, then the latest settlement will

be the invoice with the highest Version Invoice #.

DSS Project Goals

• Data Availability

– Offer as much data as possible

– Maximize data availability (when the data is available)

– 21x7 data loading between 4-7am daily

• Ease of Use

– First step is template driven

• Corporate Reports

• Easiest to use

– Reporting/Analytical flexibility is made easy (Covered

in the Intermediate Course)

DSS Project Summary

• Contains 99% of NYISO Settlement Billing Codes and all

related Dimensional data elements

• Power Suppliers

• Day Ahead & Balancing Market Energy and Bid Production Cost Guarantees • Ancillary Services (Black Start, VSS, Regulation, Operating Reserves)

• Load Serving Entities

• Day Ahead & Balancing Market Energy

• Ancillary Services, Residuals, Supplier Uplift Allocations, and Other Charges • Transaction Customers

• Day Ahead & Balancing Market Energy

• Day Ahead & Balancing Market Replacement Energy

• Day Ahead & Balancing Market Transmission Usage Charges • Day Ahead & Real-Time Bid Production Cost Guarantee

• Ancillary Services, Residuals, Supplier Uplift Allocations, and Other Charges • Virtual Market Customers Day Ahead & Real Time Market Virtual Energy

• Transmission Congestion Contract Customers Rent • Day Ahead Demand Response Program Customers

What Makes Up the Settlement

Datamart

• Nearly 25 Million rows per month per version in

the largest SCD (five minute interval) fact tables

– Over 11 million rows in single table per day/version

• Approximately 10 Terabytes of disk space

• ~1200 distinct data elements

• Large data volumes require a solid, scalable

architecture

– Time spent planning up-front will ensure scalability for months and

years to come

• Complex Data Structures and NYISO

Business/Settlement Rules

It’s

HU

DSS Data Availability

• Availability dependent upon release dates.

– Balancing Market Settlements; July, 2003

– DAM, Virtual and TCC markets; October, 2003

– Power Supplier and LSE Ancillaries, Transactions and

DADRP; December, 2003

• As settlements prior to release dates are re-spun,

additional data becomes available.

– See Lists of Interval Days and Invoice Versions in DSS

– Historic data will not be available

Corporate Reports

Summary and Administrative Reports

• Settlement Summary Reports

– Settlement Results Report

– Settlement Version Comparison Report

• Administrative Reports

– Settlement Version Control Log

– List of Interval Days & Invoice Versions

Contained in DSS

– Day Ahead Market Energy

– Day Ahead Market Bid Production Cost Guarantee – Balancing Market Energy

– Real Time Bid Production Cost Guarantee – DAM Margin Assurance

– ELR DAM Margin Assurance – Black Start Service

– Voltage Support Service Credit

– Voltage Support Service Lost Opportunity Credit – Regulation DAM Availability

– Regulation Supplemental Availability – Regulation Lost Opportunity Credit – Regulation Penalty

Corporate Reports -

Power Suppliers

– 10-Minute Sync DAM Availability

– 10-Minute Sync Supplemental Availability – 10-Minute Sync Reduction

– 10-Minute Non-Sync DAM Availability

– 10-Minute Non-Sync Supplemental Availability – 10-Minute Non-Sync Reduction

– 30-Minute Sync DAM Availability

– 30-Minute Sync Supplemental Availability – 30-Minute Sync Reduction

– Sync Reserve Lost Opportunity Credit (Blocked) – Sync Reserve Lost Opportunity Credit (Backed

Down)

– Non-Sync Reserve Lost Opportunity Credit – Sync Reserve Penalty

•

Power Supplier Settlement Detail Reports

– Day Ahead Market Energy – Balancing Market Energy – Ancillary Services

– MST Schedule 1 Charges – OATT Schedule 1 Charges – Black Start Charges

– Voltage Support Service Charges – Regulation Service Allocation

– Operating Reserve Service Allocation

– Residuals

– DAM Energy Residual Allocation – DAM Loss Residual Allocation

– Balancing Market Energy Residual Allocation – Balancing Market Loss Residual Allocation – Balancing Market Congestion Residual Allocation

– Supplier Uplift

– DAM Margin Assurance Allocation

– Import ECA Supplier Guarantee Allocation

– NTAC Charges

– Emergency Sales Allocation – Emergency Purchases Allocation

Corporate Reports -

Load Serving Entities

Corporate Reports -

Transaction Customers

– DAM TUCs – DAM Energy

– DAM Bid Production Cost Guarantee – DAM Replacement Energy

– Balancing Market TUCs – Balancing Market Energy

– Real-Time Bid Production Cost Guarantee – Balancing Market Replacement Energy – Ancillary Services

– MST Schedule 1 Charges – OATT Schedule 1 Charges

– Voltage Support Service Charges – Operating Reserve Service Allocation

• Transaction Customer Settlement Detail Reports

– Residuals

– DAM Energy Residual Allocation – DAM Loss Residual Allocation

– Balancing Market Energy Residual Allocation – Balancing Market Loss Residual Allocation

– Balancing Market Congestion Residual Allocation – Supplier Uplift

– DAM Margin Assurance Allocation

– Import ECA Supplier Guarantee Allocation – NTAC Charges

– Emergency Sales Allocation – Emergency Purchases Allocation

Corporate Reports

-Virtual Market Customers

• Virtual Market Customer Settlement Detail Reports

– Virtual Load

• DAM

• Balancing Market

– Virtual Supply

• DAM

• Balancing Market

Corporate Reports

Transmission Congestion Contract Customers

• TCC Customer Settlement Detail Reports

Corporate Reports

Day Ahead Demand Response Program Customers

• DADRP Customer Settlement Detail Reports

– Incentive

– Reduction

– Load Balance

– Penalty for Demand Response Providers

– Penalty for Load Serving Entities

Corporate Reports

Transmission Owners

• Transmission Owner Settlement Detail

Reports

Business Objects Functionality

• Getting Started

• Infoview (DSS Homepage)

• Business Objects

– Accessing Corporate Reports

– Printing

– Saving

• Web Intelligence

• Questions

Getting Started

To Start Using the NYISO DSS:

1. Minimum System Requirements

– 1GB of disk space

– 256MB of RAM

– MS Internet Explorer web browser

– 500Mhz Processor

2. Obtain DSS User Access

– See Technical Bulletin 109

3. Download Business Objects

Select the 2

_{radio button,unless you already have an account}

New Report Wizard is used to create a new document. We want to access existing Corporate Reports

To do so, Go to “File”…”Retrieve Document”…”Corporate Documents”

Once a file has been retrieved, it is stored in your machine and it is not necessary to re-retrieve each time.

You can then go to the Report using “Open”

Handling Documents

• To Print Corporate Reports:

– Select “File”, “Page Setup” Adjust “Fit to

print” as desired. Corporate Reports are pre-set

to fit on pages. Show Preview of print job.

• To Save and/or Export Reports:

– Select “Save As”, select (Highlight) the type of

file you wish to save it in (such as pdf) from the

drop-down menu. Select “Save”

Handling Documents (2)

• To Save a template file:

– Select “Save As”, select pdf. From the “Save as type”

drop-down. Select Save. The template with the

populated data will be stored in Adobe Acrobat.

• To Copy to an Excel spreadsheet:

– Select the table of data for export by placing the cursor

on the table. Select “Edit”, “Copy All”. Open a blank

Excel file, place the cursor on the A1 box and “Paste”.

Custom Reports can be exported much better to Excel

because you control the formatting and I suspect you’ll

use a lot less.

1.

2.

Conclusion

• Questions?

• Comments?