• No results found

What's New in SAP HANA Streaming Analytics 2.0 SP 03

N/A
N/A
Protected

Academic year: 2022

Share "What's New in SAP HANA Streaming Analytics 2.0 SP 03"

Copied!
50
0
0

Loading.... (view fulltext now)

Full text

(1)

PUBLIC

SAP HANA Streaming Analytics 2.0 SP 03 Document Version: 1.0.8 – 2020-02-07

What's New in SAP HANA Streaming Analytics 2.0 SP 03

AP affiliate company. All rights reserved.

(2)

Content

1 What's New in SAP HANA Streaming Analytics 2.0 SP 03. . . . 4

2 SAP HANA Streaming Analytics 2.0 SP 03 Features. . . .5

2.1 Installation and Update. . . .5

Multiple Streaming Servers on an SAP HANA Host (New and Changed). . . 6

IBM Power Systems Support. . . 8

2.2 Development (New and Changed). . . 8

Adapter Enhancements (New and Changed). . . .11

Web Services Provider Enhancements (New). . . 15

Streaming Web Service Enhancements (New). . . .16

Streaming Analytics Runtime Tool Enhancements (New). . . .16

Studio Enhancements (Changed). . . 17

2.3 System Administration (New). . . .17

Cluster Configuration Enhancements (New). . . .18

Project Administration Enhancements (Changed). . . .19

3 SAP HANA Streaming Analytics 2.0 SP 02 Features. . . .20

3.1 Product Name Change. . . 20

3.2 Development (New and Changed). . . 20

Adapter Enhancements (New and Changed). . . 22

SAP Web IDE and Streaming Analytics Runtime Tool Enhancements (New and Changed). . . .23

Streaming Web Service Enhancements (New). . . 24

4 SAP HANA Smart Data Streaming 2.0 SP 01 Features. . . . 26

4.1 Installation and Update (Changed). . . .26

Documentation (Changed). . . .27

Installation and Update Process (New and Changed). . . .27

4.2 Development (New and Changed). . . 28

Streaming Web Service Enhancements (New). . . 30

Studio Enhancements (New and Changed). . . .31

Smart Data Streaming and Web IDE Enhancements (New and Changed). . . .31

Machine Learning Enhancements (New). . . 32

Enabling the SAP HANA Repository Activation Plugin and Initializing the SAP HANA Smart Data Streaming Server (Changed). . . .33

Adapter Enhancements (New). . . 34

SDK Enhancements (New). . . .35

4.3 System Administration (New and Changed). . . 35

Streaming Service Broker Enhancements (New). . . .36

(3)

5 SAP HANA Smart Data Streaming 2.0 SP 00 Revision 002 Features. . . .37

5.1 Development (New). . . 37

Studio Enhancements (New and Changed). . . .37

6 SAP HANA Smart Data Streaming 2.0 SP 00 Features. . . .39

6.1 Important SAP Notes. . . 39

6.2 Installation and Update (Changed). . . .39

6.3 Development (New). . . 40

Adapter Enhancements (New). . . .41

Smart Data Streaming and SAP Web IDE Enhancements (New). . . .44

Streaming Web Service Enhancements (New). . . 45

Web Services Provider Enhancements (New). . . .45

6.4 System Administration (New and Changed). . . 45

Add/Remove Hosts during Replication (Changed). . . 46

Copy or Move a Tenant Database (New). . . .47

High Isolation for Multitenant Database Containers (New). . . .47

SAP HANA Cockpit (Changed). . . 47

Streaming Runtime Tool Enhancements (New). . . .48

(4)

1 What's New in SAP HANA Streaming Analytics 2.0 SP 03

Learn about new features and changed functionality. See feature summaries for each support package (SP).

Support Package (SP) First Released with Revision...

03 030

02 020

01 010

00 000

This document accumulates the features of all support packages and corresponding revisions of SAP HANA streaming analytics 2.0.

Note

This document lists new, changed, and deleted functionality in SAP HANA streaming analytics 2.0

revisions. If you are looking for information on new, changed, or deleted 1.0 functionality (revisions 90-122), see the SAP HANA streaming analytics 1.0 What's New in SAP HANA Smart Data Streaming document.

For information about the SAP HANA release strategy and for a detailed explanation of SAP HANA revisions, support packages, maintenance revisions and datacenter service points and their frequency, see the document SAP HANA Revision Strategy on SAP Service Marketplace.

To find out about issues fixed in a specific revision, see the SAP Note for that revision on the SAP Service Marketplace.

Related Information

SAP Note & Knowledge Base Article Search

2591029 - SAP HANA Streaming Analytics 2.0 SP 03 Release Note

(5)

2 SAP HANA Streaming Analytics 2.0 SP 03 Features

New and changed features in 2.0 SP 03.

Important SAP Notes: SP 03

Read the central SAP Note 2591029 before you start the installation. This note contains the latest information about the installation, including functional restrictions.

In this section:

Installation and Update [page 5]

SAP HANA streaming analytics 2.0 SP 03 introduces new and changed features for installation and update.

Development (New and Changed) [page 8]

SAP HANA streaming analytics 2.0 SP 03 introduces new and changed features for development.

System Administration (New) [page 17]

SAP HANA streaming analytics 2.0 SP 03 includes new system administration features.

2.1 Installation and Update

SAP HANA streaming analytics 2.0 SP 03 introduces new and changed features for installation and update.

SP 03 Feature Added in SP 03 Revision Date Released

Support for multiple streaming servers to use the same SAP HANA host. See Multiple Streaming Servers on an SAP HANA Host (New and Changed) [page 6].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Support for IBM Power Systems hard­

ware. See IBM Power Systems Support [page 8].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

In this section:

Multiple Streaming Servers on an SAP HANA Host (New and Changed) [page 6]

(6)

SAP HANA streaming analytics 2.0 SP 03 introduces better scalability in a production environment by supporting multiple streaming servers on a single SAP HANA host.

IBM Power Systems Support [page 8]

SAP HANA streaming analytics now supports the IBM Power Systems platform.

2.1.1 Multiple Streaming Servers on an SAP HANA Host (New and Changed)

SAP HANA streaming analytics 2.0 SP 03 introduces better scalability in a production environment by supporting multiple streaming servers on a single SAP HANA host.

Prior to 2.0 SP 03 Revision 030, streaming servers (also referred to as services) were required to use 3xx16 and 3xx26 as the internal and external ports (where xx is the SAP HANA instance number). This meant that you could only have one streaming service per host so when you added a streaming service to a new tenant, it needed to be on its own host with the streaming role. Now, you can have multiple streaming services on the same SAP HANA host, though each tenant can still only run one streaming service per host. This saves you time, minimizes complexity, and offers better overall scalability for your tenant system.

Dedicated Host Deployment

Dedicated Host Deployment with Multiple Tenants

(7)

Same Host Deployment

Same Host Deployment with Multiple Tenants

More Available Ports

Previously, the streaming analytics internal and external ports were fixed values that were automatically assigned. For default (single) tenant databases, this behavior remains the same. Otherwise, you can still use the previous default values for one of your tenants but can also choose from six new port ranges for your other tenants. If you specify 3xx16 as the internal port of one of your tenants, the previous default values are automatically used for the rest of the ports (external, Web Services, Streaming Web Service). If you don't specify the previous default value or don't specify a port number at all, one of the new ports will be

automatically assigned based on availability. Once they're assigned, the port numbers remain the same and don't change when you start and stop the streaming analytics server.

The new default port ranges are 3xx40 to 3xx99, with 9 ports reserved for each range. For example, one range is 3xx40 to 3xx48, the next 3xx49 to 3xx57, and so on. This is similar to other SAP HANA services, the only difference being that streaming analytics reserves 9 ports while other services reserve 3. With these new available ports, seven tenants can run on the same SAP HANA host. If you would like to have additional tenants on the same host, you can reserve additional ports by editing the [multidb]

reserved_instance_numbers property in the global.ini file.

To see your assigned internal port number, look at the streamingserver service in the landscape view in SAP HANA studio or run the SELECT PORT FROM M_SERVICES WHERE SERVICE_NAME='streamingserver' AND HOST='<host name'> statement and look at the PORT column in the M_SERVICES view. The external port number is always one number higher than the internal port. For example, if the internal port is 3xx40 then the external port is 3xx41.

Port Use

Previous Default Values (Prior to 2.0 SP 03 and still used single tenant sys­

tems) New Default Values (As of 2.0 SP 03)

Internal 3xx16 3xx40, 3xx49, 3xx58, 3xx67, 3xx76, and

3xx85

(8)

Port Use

Previous Default Values (Prior to 2.0 SP 03 and still used single tenant sys­

tems) New Default Values (As of 2.0 SP 03)

External 3xx26 3xx41, 3xx50, 3xx59, 3xx68, 3xx77, and

3xx86

Web Services Provider (SOAP port) 9090 3xx42, 3xx51, 3xx60, 3xx69, 3xx78, and 3xx87

Web Services Provider (REST port) 9091 3xx43, 3xx52, 3xx61, 3xx70, 3xx79, and 3xx88

Web Services Provider (WebSocket port)

9092 3xx44, 3xx53, 3xx62, 3xx71, 3xx80, and

3xx89

Streaming Web Service 9093 3xx45, 3xx54, 3xx63, 3xx72, 3xx81, and

3xx90

2.1.2 IBM Power Systems Support

SAP HANA streaming analytics now supports the IBM Power Systems platform.

You can install SAP HANA streaming analytics 2.0 SP 03 on IBM Power Systems hardware running one of the following operating system versions:

● SUSE Linux Enterprise Server (SLES) 12 SP1, SP2

● Red Hat Enterprise Linux (RHEL) 7.3

For a list of supported platforms and operating systems, see SAP Note 2577159 .

We do not support migrating streaming analytics data (for example, log stores) from an Intel platform to an IBM Power Systems Support platform. If you choose to migrate between these platforms, you are doing so at your own risk. We recommend performing a complete backup before migrating.

2.2 Development (New and Changed)

SAP HANA streaming analytics 2.0 SP 03 introduces new and changed features for development.

SP 03 Feature Added in SP 03 Revision Date Released

New retryNumber and

retryPeriod properties for the JMS adapters. See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 033.00

4 September, 2018

(9)

SP 03 Feature Added in SP 03 Revision Date Released

Throttling control properties for the Streaming Web Service and Web Serv­

ices Provider. See Streaming Web Serv­

ice Enhancements (New) [page 16]

and Web Services Provider Enhance­

ments (New) [page 15].

SAP HANA Streaming Analytics 2.0 Re­

vision 031.00

14 June, 2018

New location for log files for adapters built using the adapter toolkit. See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Enhancements to JSON Input Managed adapter properties. See Adapter En­

hancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Enhancements to JSON Input Unman­

aged adapter properties. See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

New JSON Stream to ESP Formatter.

See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

New File/Hadoop Avro Input and Out­

put adapter. See Adapter Enhance­

ments (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Ability to reduce file size with new Avro file parameters. See Adapter Enhance­

ments (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Ability to store data in more formats.

See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

New AMQP Toolkit adapters. See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

New AMQP Transporter Modules. See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

(10)

SP 03 Feature Added in SP 03 Revision Date Released

Ability to generate logs for data that can't be parsed by File/Hadoop CSV and File/Hadoop Event XML input adapters. See Adapter Enhancements (New and Changed) [page 11].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Ability to set a custom timezone for the Web Services Provider. See Web Serv­

ices Provider Enhancements (New) [page 15].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Ability to run SQL queries against win­

dows using the Streaming Web Service.

See Streaming Web Service Enhance­

ments (New) [page 16].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Ability to run SQL queries against win­

dows in the streaming analytics run­

time tool. See Streaming Analytics Run­

time Tool Enhancements (New) [page 16].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Improved model properties tab. See Studio Enhancements (Changed) [page 17].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Improved model importing. See Studio Enhancements (Changed) [page 17].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

In this section:

Adapter Enhancements (New and Changed) [page 11]

There are various enhancements for JSON input adapters, new properties for JMS adapters, and new adapter log and logging configuration files. There are also new adapters, including the File/Hadoop Avro Input and Output adapter and the AMQP adapters, new transporter modules, as well as improvements to the ESP to Avro Record and Avro Record to ESP formatters.

Web Services Provider Enhancements (New) [page 15]

The Web Services Provider has new properties for setting the timezone and throttling control.

Streaming Web Service Enhancements (New) [page 16]

The Streaming Web Service now supports snapshot queries of windows and has properties for throttling control.

Streaming Analytics Runtime Tool Enhancements (New) [page 16]

The streaming analytics runtime tool now supports running SQL queries against windows.

Studio Enhancements (Changed) [page 17]

The SAP HANA Streaming Development perspective in SAP HANA studio includes improved usability in the streaming analytics model properties tab, as well as enhancements to model importing.

(11)

2.2.1 Adapter Enhancements (New and Changed)

There are various enhancements for JSON input adapters, new properties for JMS adapters, and new adapter log and logging configuration files. There are also new adapters, including the File/Hadoop Avro Input and Output adapter and the AMQP adapters, new transporter modules, as well as improvements to the ESP to Avro Record and Avro Record to ESP formatters.

Adapter Log Files (New and Changed)

Adapters built using the streaming adapter toolkit now output their logging information to a new location. As before, you can access log and trace files for adapters using the studio Administration Console or by navigating to hana/shared/<SID>/HDB<instance>/<hostname>/trace/DB_<tenant-database-name> on the streaming analytics node's file system. In addition to the previously existing .trc and .out files, each adapter will now have a .log file in the following format:

streamingserver~<workspace-name>.<project-or-adapter-name>.<instance- index>~_<hostname>.<port>.000.log

For all managed adapters built using the adapter toolkit, the logging configuration file is also located in a new directory, and has a new name: %STREAMING_HOME%/adapters/framework/config/

log4j.managed.properties

On upgrade, all previously created adapters will automatically start using these files without any changes to the adapter code.

JSON Input Managed Adapter Properties (New and Changed)

There are various enhancements to the File/Hadoop, Kafka, and Socket JSON managed input adapters.

● JSON Column Mapping List property: You can now retrieve data from outside the set root path. Use the / character immediately before the data mapping. This character specifies an absolute path. Also, arrays can now contain null values.

● JSON Root Path property: If the root of the JSON data is an array, you can now specify "[]" to publish all data in the first level of the array, or "[<index-number>]".<value> to publish all data for the nested

<value>.

● Default Opcode property: You can use this new property to set a default operation code for the stream. If not specified, the stream treats all events as insert.

JSON Input Unmanaged Adapter Properties (New and Changed)

There are various enhancements to the File/Hadoop, Kafka, and Socket JSON unmanaged input adapters.

(12)

● Column property: You can now retrieve data from outside the set root path. Use the / character immediately before the data mapping. This character specifies an absolute path. Also, arrays can now contain null values.

● ColsMapping property, rootpath attribute: If the root of the JSON data is an array, you can now specify

"[]" in the rootpath attribute to publish all data in the first level of the array, or "[<index- number>]".<value> to publish all data for the nested <value>.

● ColsMapping property, defaultOpcode attribute: This is a new attribute for the ColsMapping property.

You can use this attribute to set a default operation code for the stream. If not specified, the stream treats all events as insert.

JSON Stream to ESP Formatter (New)

There is a new formatter available in the adapter toolkit: the JSON Stream to ESP formatter. This is a

streaming-based formatter, and it reads data from a Java InputStream, splits it into standalone JSON message strings, then translates the JSON strings to AepRecord objects.

Use this formatter module for building File/Hadoop JSON Input unmanaged adapters, in place of the previously used JSON Stream to JSON String and JSON String to ESP formatters.

File/Hadoop Avro Input and Output Adapter (New)

The new File/Hadoop Avro Input adapter reads an Avro file from a local hard disk or Hadoop Distributed File System (HDFS), transforms it to streaming analytics data format, and then publishes it to streaming analytics.

This input adapter:

● reads streaming analytics data from an Avro file in a local hard disk or HDFS,

● deletes Avro files after reading them from a local hard disk or HDFS,

● reads a batch of Avro files,

● supports guaranteed delivery (GD),

● polls an Avro file and appends data to a streaming analytics project, and

● continues to read data newly appended to the file after the adapter restarts.

The new File/Hadoop Avro Output adapter reads data from streaming analytics, transforms it to Avro format, and then publishes it to a local hard disk or HDFS. This output adapter:

● creates and writes streaming analytics data to an Avro file on a local hard disk or HDFS,

● appends streaming analytics data to an existing Avro file on a local hard disk or HDFS,

● supports GD,

● uses file size limit-based and time-based file name rotation, and

● uses a configurable uncompressed and compressed Avro file codec.

Reduce File Size with New Avro File Parameters (New)

There are two new Avro file parameters to help you reduce Avro file size and transmit data faster.

(13)

Parameter Name Purpose Adapters Formatter AvroCompressionCode

c

Specify the compression al­

gorithm for the Avro file. This helps reduce file size so you can send data faster.

File/Hadoop Avro Output adapter, Kafka Avro Record Output adapter

ESP to Avro Record Format­

ter

AvroCompressionLeve l

Specify the compression level for the Avro file. This helps to balance between the conversion speed and file size.

These new properties are part of the ESP to Avro Record Formatter, which is shipped as part of the adapter toolkit. You can use this formatter module when building your own custom adapter.

More Options for Storing Data (New)

Previously, you could only store Avro data in binary format when using the Kafka Avro Record Input and Output adapter. Now, with new Avro encode and decode parameters, you can also store Avro data in JSON and file serialization mode. When using the new File/Hadoop Avro Input and Output adapter, however, file format is the only option.

Parameter Name Purpose Adapters Formatter

AvroEncodeMode Specify the serialization mode for Avro record data.

Kafka Avro Record Output adapter: In addition to binary, you can store data in JSON and file format.

File/Hadoop Avro Output adapter: You can only store data in file format.

Kafka Avro Record Output adapter, File/Hadoop Avro Output adapter

ESP to Avro Record Format­

ter

AvroDecodeMode Specify the deserialization mode for Avro record data.

Kafka Avro Record Input adapter: In addition to binary, you can use JSON and file deserialization mode.

File/Hadoop Avro Input adapter: You can only use file deserialization mode.

Kafka Avro Record Input adapter, File/Hadoop Avro Input adapter

Avro Record to ESP Format­

ter

AvroEncodeMode is part of the ESP to Avro Record Formatter, and AvroDecodeMode is part of the Avro Record to ESP Formatter. Each formatter module is shipped as part of the adapter toolkit. You can use these formatter modules when building your own custom adapter.

(14)

AMQP Toolkit Adapters (New)

The new AMQP Input and Output adapters consume and produce messages using a third-party AMQP message broker. The Advanced Message Queuing Protocol (AMQP) process involves sending messages from producer applications to a message broker, where an exchange takes place to route the message to the appropriate message queue. Consumer applications then retrieve messages from the queue. These new adapters:

● Format messages and publish them to streaming analytics.

● Format streaming analytics data to different data types (CSV, JSON, string, and XML).

● Produce and transport messages to a third-party message broker.

● Support guaranteed delivery (GD).

Two new transporters, AMQP Input and AMQP Output, are added to the adapter toolkit. You can use these modules to create your own custom AMQP adapter.

AMQP Transporter Modules (New)

There are two new transporters available, which transport data between third-party AMQP message brokers and streaming analytics:

Transporter Name Purpose

AMQP Input transporter Designed to transport messages from message broker queues to the next module specified in the adapter configu­

ration file. This transporter acts as an AMQP consumer when it retrieves data from the message broker.

AMQP Output transporter Designed to obtain data from the previous module specified in the adapter configuration file and transport it to the mes­

sage broker. The message is then routed and consumed by an application. This transporter acts as an AMQP producer when it transports messages to the message broker.

These transporters are part of the new AMQP toolkit adapters. You can also use these transporter modules when building custom adapters.

Bad Data Logging (New)

The File/Hadoop CSV Input and File/Hadoop Event XML Input adapters can now generate logs of data that can't be parsed by the adapter.

Bad data logging is disabled by default. Set the parameter logBadData to true to enable it. If enabled, the adapter writes all bad data to a separate log file: streamingserver~<workspace-name>.<application- name>.<instance-index>.<adapter-name>_bad_data~_<hostname>.<port>.log.<yyyy-mm-dd>.

(15)

By default, the logging period rolls over daily at 00:00:00 in the local timezone, and the adapter begins logging bad data to a new file.

You can customize the rollover frequency through the log4j.appender.baddata.File property in the log4j.properties file.

Default Directory for Custom Adapter Logging Configuration File (Changed)

For custom adapters developed using the toolkit, streaming analytics now looks for the logging configuration file in this directory: $STREAMING_CUSTOM_ADAPTERS_HOME/config/log4j.managed.properties.

If you do not place a custom log4j.managed.properties file in this location, the adapter defaults to the directory for pre-built adapters: %STREAMING_HOME%/adapters/framework/config/

log4j.managed.properties.

Reconnection Properties for JMS Adapters (New)

The JMS CSV, Event XML, Map, and Object input and output adapters now have two reconnection properties (retryPeriod and retryNumber) which specify the duration and number of attempts the adapter will make to reestablish a lost connection to the JMS broker. These properties are meant to be used in case the JMS broker's failover mechanism fails.

JMS CSV Input and Output Adapter JMS Event XML Input and Output Adapter JMS Map Input and Output Adapter JMS Object Input and Output Adapter

2.2.2 Web Services Provider Enhancements (New)

The Web Services Provider has new properties for setting the timezone and throttling control.

Data Timezone Property

You can now set a custom timezone for the Web Services Provider through its configuration settings in the SAP HANA cockpit. If you don't set a timezone, the default timezone is UTC.

(16)

Throttling Control Properties

You can configure the Web Services Provider to delay responses to failed authentication attempts after a certain number of attempts are made, using the following new properties:

● Failed Authentications Threshold (requests/second)

● Failed Authentication Delay (milliseconds)

2.2.3 Streaming Web Service Enhancements (New)

The Streaming Web Service now supports snapshot queries of windows and has properties for throttling control.

You can use the new REST API to get a JSON array of rows, with each row in map format, from the window of a running project. The request returns all rows by default, or you can specify a limit to retrieve a smaller number of rows.

Throttling Control Properties

You can configure the Streaming Web Service to delay responses to failed authentication attempts after a certain number of attempts are made, using the following new properties:

● Failed Authentications Threshold (requests/second)

● Failed Authentication Delay (milliseconds) Configuring the Streaming Web Service

2.2.4 Streaming Analytics Runtime Tool Enhancements (New)

The streaming analytics runtime tool now supports running SQL queries against windows.

You can use the new SQL Query option to run snapshot SQL queries on any window in a running project. You can also execute multiple queries at the same time for a single streaming project.

To open the SQL Query tab, right-click on a running project and select SQL Query.

(17)

2.2.5 Studio Enhancements (Changed)

The SAP HANA Streaming Development perspective in SAP HANA studio includes improved usability in the streaming analytics model properties tab, as well as enhancements to model importing.

A More User-Friendly Model Properties Tab (Changed)

Instead of manually entering a referenced model, you can now choose from a dropdown list of imported models. There is no need to keep track of imported models, or to worry about entering unavailable model names.

As well, there is no need to manually enter an input schema when referencing a model. The input schema field now auto-populates based on the model you choose. This eliminates possible errors, especially in input schemas with many parameters. However, keep in mind that for models where no referenced model is used (for example, a Hoeffding Tree training or a DenStream clustering model), you still need to manually enter the input schema.

Improved Model Importing (Changed)

After importing a model, the origin is no longer lost, but is stored in the streaming analytics model metadata tables in the SAP HANA database. Everything from the service name to user data is retained in the

PARAMETERS column. The data stored here can be useful in gathering more information about the model later.

2.3 System Administration (New)

SAP HANA streaming analytics 2.0 SP 03 includes new system administration features.

SP 03 Feature Added in SP 03 Revision Date Released

New heartbeat properties. See Cluster Configuration Enhancements (New) [page 18].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

Ability to edit properties for the Stream­

ing Web Service and Web Services Pro­

vider on a node-by-node basis. See Cluster Configuration Enhancements (New) [page 18].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

(18)

SP 03 Feature Added in SP 03 Revision Date Released Ability to force a hanging project to stop

immediately. See Project Administra­

tion Enhancements (Changed) [page 19].

SAP HANA Streaming Analytics 2.0 Re­

vision 030

April 6, 2018

In this section:

Cluster Configuration Enhancements (New) [page 18]

There are two new heartbeat properties for the streaming cluster, and the ability to edit web service properties on a node-by-node basis.

Project Administration Enhancements (Changed) [page 19]

You can now force a hanging project to stop immediately.

2.3.1 Cluster Configuration Enhancements (New)

There are two new heartbeat properties for the streaming cluster, and the ability to edit web service properties on a node-by-node basis.

Controller Heartbeat Properties (New)

There are two new heartbeat properties on the cluster configuration page in the SAP HANA cockpit:

● Controller Heartbeat Timeout: The time, in milliseconds, for the cluster to wait for a response to a heartbeat check before timing out. The value must be at least 4500.

● Controller Heartbeat Timeout Retry: The number of times to retry a heartbeat check in case of a timeout.

The value must be 5 or lower.

More Flexibility in Editing Streaming Web Service and Web Services Provider Properties (New)

You can now edit configuration properties for the Streaming Web Service or Web Services Provider on a node- by-node basis. Prior to 2.0 SP 03 Revision 030, any edits you made to their properties were applied to the entire cluster. Now, you can select any of the nodes on the cluster and configure properties specifically for that node.

This gives you more flexibility when configuring the Streaming Web Service and Web Services Provider. For example, security limitations may require you to use different port numbers for instances that reside on different hosts. Be sure to keep track of your port numbers to avoid conflicts with ports that are already in use.

(19)

2.3.2 Project Administration Enhancements (Changed)

You can now force a hanging project to stop immediately.

If you have a frozen project and stopping it normally doesn't work, you can now force the project to stop, which immediately shuts down all project and related processes. You can do this in one of two ways:

● Using the streamingclusteradmin utility, use the --stop_project command with the timeout option set to a negative value:

streamingclusteradmin --uri=esps://<host>:<port> --username=<username> -- password=<password> --stop_project --workspace-name=<workspace> --project- name=<project> --timeout -1

● Using the SAP HANA studio, open the SAP HANA Streaming Run-Test perspective. In the stream view, right-click on the frozen project and select Force Stop Project.

(20)

3 SAP HANA Streaming Analytics 2.0 SP 02 Features

New and changed features in 2.0 SP 02.

Important SAP Notes: SP 02

Read the central SAP Note 2471676 before you start the installation. This note contains the latest information about the installation, including functional restrictions.

In this section:

Product Name Change [page 20]

2.0 SP 02 introduces a change in the SAP HANA option name from SAP HANA smart data streaming to SAP HANA streaming analytics to better reflect its capabilities.

Development (New and Changed) [page 20]

SAP HANA streaming analytics 2.0 SP 02 introduces new and changed features for development.

3.1 Product Name Change

2.0 SP 02 introduces a change in the SAP HANA option name from SAP HANA smart data streaming to SAP HANA streaming analytics to better reflect its capabilities.

This change does not impact releases prior to 2.0 SP 02 - the documentation and user interfaces will remain the same in those versions.

3.2 Development (New and Changed)

SAP HANA streaming analytics 2.0 SP 02 introduces new and changed features for development.

SP 02 Feature Added in SP 02 Revision Date Released

Input adapter polling capability. See Adapter Enhancements (New and Changed) [page 22].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

(21)

SP 02 Feature Added in SP 02 Revision Date Released

Changed GDMode property ID. See Adapter Enhancements (New and Changed) [page 22].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

Changed steps for enabling SAP Web IDE features. See SAP Web IDE and Streaming Analytics Runtime Tool En­

hancements (New and Changed) [page 23].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

Changed CCL and CCR file names in SAP Web IDE. See SAP Web IDE and Streaming Analytics Runtime Tool En­

hancements (New and Changed) [page 23].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

Custom workspaces in SAP Web IDE.

See SAP Web IDE and Streaming Ana­

lytics Runtime Tool Enhancements (New and Changed) [page 23].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

Detailed object properties in SAP Web IDE graphical viewer. See SAP Web IDE and Streaming Analytics Runtime Tool Enhancements (New and Changed) [page 23].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

Project monitoring and debugging in the streaming analytics runtime tool.

See SAP Web IDE and Streaming Ana­

lytics Runtime Tool Enhancements (New and Changed) [page 23].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

Guaranteed delivery support for the Streaming Web Service using the Web­

Socket protocol. See Streaming Web Service Enhancements (New) [page 24].

SAP HANA Streaming Analytics 2.0 Re­

vision 020

26 July, 2017

In this section:

Adapter Enhancements (New and Changed) [page 22]

The Database Input adapter and File/Hadoop Input adapters now support a way to persist polling status to a file so that in case of a restart, the adapter can resume polling from where it left off.

SAP Web IDE and Streaming Analytics Runtime Tool Enhancements (New and Changed) [page 23]

(22)

The streaming analytics plugin for SAP Web IDE now lets you set custom project names, build projects to any streaming server, and view detailed properties for elements in the graphical viewer. As well, the streaming analytics runtime tool introduces two new features: a monitor and an event tracer.

Streaming Web Service Enhancements (New) [page 24]

The Streaming Web Service now has examples, supports guaranteed delivery to projects when using the WebSocket protocol, and has new settings for throttling control.

3.2.1 Adapter Enhancements (New and Changed)

The Database Input adapter and File/Hadoop Input adapters now support a way to persist polling status to a file so that in case of a restart, the adapter can resume polling from where it left off.

Input Adapter Polling Capability (New)

The Database Input and File/Hadoop Input adapters have a new property, persistPollStatus, that allows them to persist their polling status to a file. If set to true, the adapter resumes reading a file from the last recorded line upon restart, rather than from the beginning. This greatly lowers the amount of duplicated rows being published.

For the Database Input Adapter, if set to false the adapter resumes polling from the value specified for the recordCounterInitValue or the msdateSequenceInitValue property. The default value is false.

For the File/Hadoop Input adapters, the following adapters are affected: File/Hadoop CSV, File/Hadoop Event XML, and File/Hadoop JSON. For these adapters, persistPollStatus refers to a second new property, persistInterval, to determine how often the current reading position is recorded. Only local files support persistence. Files stored on a Hadoop Distributed File System (HDFS) are not supported by this feature. The default value is false.

GDMode Property ID (Changed)

The GDMode property ID is changed to enableGdMode for managed input adapters, and EnableGdMode for unmanaged input adapters. If you are using these properties in your projects, you need to manually change the property ID when you upgrade.

(23)

3.2.2 SAP Web IDE and Streaming Analytics Runtime Tool Enhancements (New and Changed)

The streaming analytics plugin for SAP Web IDE now lets you set custom project names, build projects to any streaming server, and view detailed properties for elements in the graphical viewer. As well, the streaming analytics runtime tool introduces two new features: a monitor and an event tracer.

Enabling SAP Web IDE Features (Changed)

Starting in this release, the streaming analytics plugin for SAP Web IDE is not enabled when you first log in to the SAP Web IDE, even if you have installed all the required components. You have to enable the plugin, and the link to the streaming analytics runtime tool, through Preferences

→ Features.

CCL and CCR File Names (Changed)

When you create a streaming module in SAP Web IDE, the name you choose for the module now carries forward to the CCL and CCR files. Previously, these files were always named model.ccl and model.ccr. Now, for example, if you name your streaming module mymodule, the files are named mymodule.ccl and

mymodule.ccr.

Using Custom Workspaces (New)

You can now build streaming modules to any streaming server and workspace, provided you know the endpoint for the project. When you select Build in the top Web IDE menu, you now have two options:

● Build: this is the old method, which builds to the current XSA space, creating a new workspace and sending the module to the streaming analytics runtime tool.

● Build to...: the first time you use this method, it asks for a host, port, workspace, and user credentials. All subsequent times, all fields except the password remain filled in. If you enter the name of a workspace that doesn't exist, a new workspace gets automatically created (provided you have write permissions on the server). By default, this workspace doesn't build to the streaming analytics runtime tool, but you can manually add it later.

If you use the Build to... option, you can then manually register the workspace in the streaming analytics runtime tool. You can also add any existing streaming workspaces this way, even if they don't contain projects created using the SAP Web IDE. This way, you can manage and monitor streaming projects from multiple streaming hosts in one place.

To register a workspace, right-click on the Streaming Workspaces folder, and select Register Custom Workspace. Just as in the SAP Web IDE, this feature asks for for a host, port, workspace, and user credentials.

(24)

Viewing Object Properties in the Graphical Viewer (New)

The CCL graphical viewer can now display detailed properties for any object in the diagram. Enable the properties pane by clicking the

icon, then selecting the checkbox. Within this pane, you can also search for a specific expression, an input, or an output.

To see the properties for an element, open this pane, then select an element in the diagram.

Monitoring and Debugging Projects (New)

Through the streaming analytics runtime tool, you can now monitor streams and windows in a running project, and use an event tracer to see project workflow.

You can monitor project performance through the streams monitor, which outlines the streams and windows in a project with a workflow diagram. Each shape in the diagram corresponds to a stream or window, while the arrows outline the path the data flows through. The color of each node represents either queue depth or rows processed per second, depending on your specifications.

If you want to see a more general overview of the whole project, then you can use the event tracer, which lets you see the impact of each incoming event on every stream and window in a project. This can be useful for debugging data flow during project development. Nodes in the event tracer diagram are colour-coded depending on the type of operation: green for an insert, yellow for an update, and red for a delete.

To use either of these tools, open the streaming analytics runtime tool, and find your project in the workspace pane. Then, right-click the project and select Monitor or Event Tracer.

3.2.3 Streaming Web Service Enhancements (New)

The Streaming Web Service now has examples, supports guaranteed delivery to projects when using the WebSocket protocol, and has new settings for throttling control.

Examples for Publishing with Guaranteed Delivery

The server and client packages now include examples for publishing with guaranteed delivery via both REST and WebSocket. These examples and a readme with instructions for running them are located at

STREAMING_HOME/examples/python/swsgd.

Guaranteed Delivery Support Using WebSocket

When using a WebSocket client, you can now establish connections in the following three modes:

(25)

simplex Does not receive response messages from the Streaming Web Service. Use this mode for higher throughput. This is the default mode.

duplex Receives response messages from the Streaming Web Service indicating whether or not messages publish successfully.

commit Receives response messages from the Streaming Web Service indicating whether or not messages publish successfully, and can issue commits. On a commit failure or connection error, the Streaming Web Service drops subsequent messages until it receives a connection-reset message.

For guaranteed delivery, use commit mode and issue commits when publishing data.

When using the Streaming Web Output adapter, if both the source and destination projects are configured for guaranteed delivery, the Streaming Web Service now guarantees delivery to the destination project.

Throttling Control Properties

As of 2.0 SP 02 revision 024.03, you can configure the Streaming Web Service to delay responses to failed authentication attempts after a certain number of attempts are made, using the following new properties:

● Failed Authentications Threshold (requests/second)

● Failed Authentication Delay (milliseconds) Configuring the Streaming Web Service

(26)

4 SAP HANA Smart Data Streaming 2.0 SP 01 Features

New and changed features in 2.0 SP 01.

Important SAP Notes: SP 01

Read the central SAP Note 2439589 before you start the installation. This note contains the latest information about the installation, including functional restrictions.

In this section:

Installation and Update (Changed) [page 26]

SAP HANA smart data streaming includes new and changed installation features.

Development (New and Changed) [page 28]

SAP HANA smart data streaming includes new and changed development features.

System Administration (New and Changed) [page 35]

SAP HANA smart data streaming includes a new system administration feature.

4.1 Installation and Update (Changed)

SAP HANA smart data streaming includes new and changed installation features.

SP 01 Feature Added in SP 01 Revision Date Released

Changes to the SAP HANA Smart Data Streaming: Installation and Update Guide. See Documentation (Changed) [page 27].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

All SAP HANA systems are now tenant database systems. See Installation and Update Process (New and Changed) [page 27].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

In this section:

Documentation (Changed) [page 27]

(27)

The SAP HANA Smart Data Streaming: Installation and Update Guide now assumes that you are adding smart data streaming to a fully configured SAP HANA system.

Installation and Update Process (New and Changed) [page 27]

In previous releases, you could have a single or multiple-container SAP HANA system with SAP HANA smart data streaming installed. As of 2.0 SP 01, SAP HANA no longer supports single-container installations. All SAP HANA systems are multi-tenant container systems, and they are referred to as tenant database systems.

4.1.1 Documentation (Changed)

The SAP HANA Smart Data Streaming: Installation and Update Guide now assumes that you are adding smart data streaming to a fully configured SAP HANA system.

4.1.2 Installation and Update Process (New and Changed)

In previous releases, you could have a single or multiple-container SAP HANA system with SAP HANA smart data streaming installed. As of 2.0 SP 01, SAP HANA no longer supports single-container installations. All SAP HANA systems are multi-tenant container systems, and they are referred to as tenant database systems.

New Installations

When you perform a new installation of SAP HANA, the installer creates a single tenant database by default.

You can add additional tenant databases afterwards using the SAP HANA cockpit. See Create a Tenant Database in the SAP HANA Administration Guide for complete instructions.

When you add a smart data streaming host to an SAP HANA system with a single tenant database, specify the -auto_initialize_services flag to automatically initialize the connection between the smart data streaming service and the tenant. Without this flag, you will need to manually initialize the connection following the installation. See Initializing the Connection Between a Tenant Database and a Streaming Service in the SAP HANA Streaming Analytics: Configuration and Administration Guide for detailed steps.

Note

The smart data streaming service is provisioned automatically for a single tenant installation regardless of whether or not this flag is specified.

However, when you add a smart data streaming host to an SAP HANA system with multiple tenant databases, you will need to manually provision and initialize smart data streaming services to the tenants. For complete instructions, see Provisioning the Smart Data Streaming Service to a Tenant Database and Initializing the Connection Between a Tenant Database and a Streaming Service in the SAP HANA Streaming Analytics:

Configuration and Administration Guide.

(28)

Updates

When you upgrade a single-container SAP HANA system with smart data streaming, the installer creates a single tenant database and automatically provisions and initializes the smart data streaming service to the tenant.

When you upgrade a multiple-container SAP HANA system with smart data streaming, the installer upgrades the tenant databases (same as before) and automatically provisions and initializes the smart data streaming services to the tenants.

Streaming Directories

For a complete smart data streaming file and directory infrastructure in a tenant database system, see File and Directory Infrastructure in the SAP HANA Streaming Analytics: Configuration and Administration Guide.

Related Information

Overview of SAP HANA Tenant Databases

SAP HANA Server Installation and Update (New and Changed) Updating a Single-Container System

SAP HANA Streaming Analytics: Configuration and Administration Guide SAP HANA Administration Guide

4.2 Development (New and Changed)

SAP HANA smart data streaming includes new and changed development features.

SP 01 Feature Added in SP 01 Revision Date Released

Support for gzip compression for REST requests using the Streaming Web Service. See Streaming Web Service Enhancements (New) [page 30].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

New properties for the Streaming Web Service. See Streaming Web Service Enhancements (New) [page 30].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

(29)

SP 01 Feature Added in SP 01 Revision Date Released

New and changed preferences for the SAP HANA Streaming Run-Test per­

spective in studio. See Studio Enhance­

ments (New and Changed) [page 31].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

CCL graphical viewer enhancements in the SAP Web IDE. See Smart Data Streaming and Web IDE Enhancements (New and Changed) [page 31].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

Support for importing and scoring Deci­

sion Tree models. See Machine Learn­

ing Enhancements (New) [page 32].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

New steps for enabling the SAP HANA Repository activation plugin. See Ena­

bling the SAP HANA Repository Activa­

tion Plugin and Initializing the SAP HANA Smart Data Streaming Server (Changed) [page 33].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

CLOB and NCLOB datatypes for the SAP HANA Output adapter. See Adapter Enhancements (New) [page 34].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

New .NET SDK API to support connec­

tions to streaming lite projects. See SDK Enhancements (New) [page 35].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

In this section:

Streaming Web Service Enhancements (New) [page 30]

The Streaming Web Service now supports gzip compression with REST requests, and two new configuration parameters.

Studio Enhancements (New and Changed) [page 31]

The SAP HANA Streaming Run-Test perspective contains a new preference, and some default behaviour has changed.

Smart Data Streaming and Web IDE Enhancements (New and Changed) [page 31]

You can now add notes to diagrams using the CCL graphical viewer in the SAP Web IDE. The viewer also has a few visual upgrades.

Machine Learning Enhancements (New) [page 32]

You can now import a trained Decision Tree model from an SAP HANA database, and use a new scoring function to score the data. You can also create and manage machine learning models through the streaming runtime tool.

(30)

Enabling the SAP HANA Repository Activation Plugin and Initializing the SAP HANA Smart Data Streaming Server (Changed) [page 33]

The activation plugin allows you to activate smart data streaming content in the SAP HANA Repository.

For single-container systems prior to 2.0 SP 01, the product installer automatically enabled the activation plugin. However, in multiple-container systems, the plugin was enabled automatically when you executed the ALTER SYSTEM INITIALIZE SERVICE statement as part of initializing the connection between a tenant and the smart data streaming service. As of 2.0 SP 01, with the move to tenant databases, the ways you do both have changed.

Adapter Enhancements (New) [page 34]

The SAP HANA output adapter now supports two new LOB datatypes: CLOB (Character Large Object) and NCLOB (National Character Large Object).

SDK Enhancements (New) [page 35]

The .NET SDK has a new API to support connections to standalone projects in streaming lite.

4.2.1 Streaming Web Service Enhancements (New)

The Streaming Web Service now supports gzip compression with REST requests, and two new configuration parameters.

Gzip Compression with REST Requests

Use the Content-Encoding header to indicate if the request body is compressed. Use the Accept-Encoding header to indicate if the response body is compressed.

For the complete REST request syntax, see the Streaming Web Service section in the SAP HANA Smart Data Streaming: Adapters Guide.

TLS Configuration and Subscription Buffer Queue Size

If you have SSL enabled, use the new TLS parameter to specify which TLS version to allow for client connections.

Use the Subscription Buffer Queue Size parameter to specify how many events a worker process can buffer at any given time. When the number of buffered events reaches the maximum, indicating that either subscription data is being produced too quickly or clients are not consuming events fast enough, the

Streaming Web Service will stop processing new received events. Publishers are resumed when the number of buffered events drops to 70% of the maximum.

Edit these parameters using the SAP HANA cockpit or the Streaming Web Service configuration xml file. For complete information, see Configuring the Streaming Web Service in the SAP HANA Smart Data Streaming:

Adapters Guide

(31)

Related Information

SAP HANA Streaming Analytics: Adapters Guide

4.2.2 Studio Enhancements (New and Changed)

The SAP HANA Streaming Run-Test perspective contains a new preference, and some default behaviour has changed.

The new and changed preferences can be found in Window Preferences Run Test . They are both unchecked by default:

● (New) Automatically reconnect to all projects when connecting to a server – Your projects will no longer connect automatically when you connect to a server. You must now manually connect and disconnect from individual projects by right-clicking them and selecting Connect to Project or Disconnect from Project.

Disconnecting from a project means that you will no longer be able to view current project activity in studio, but the project will continue to run. The default behaviour significantly reduces the time it takes studio to connect, especially when there are multiple projects running. Checking this option may negatively affect performance.

● (Changed) Always start previously running run-test views on project start – Any Run-Test views you previously had open with a project will no longer reopen automatically when you start that project. This change significantly reduces the time it takes studio to connect, especially when there are multiple projects running.

For more information on connecting to a project in studio, see Connecting to a Project in the SAP HANA Smart Data Streaming: Developers Guide.

Related Information

SAP HANA Streaming Analytics: Developer Guide

4.2.3 Smart Data Streaming and Web IDE Enhancements (New and Changed)

You can now add notes to diagrams using the CCL graphical viewer in the SAP Web IDE. The viewer also has a few visual upgrades.

The CCL graphical viewer icons have an upgraded look and feel:

(32)

Icon Functionality

Creates a visual comment on the diagram. This comment does not appear in the CCL file.

To add a note to the diagram, click on this icon, then click anywhere on the diagram.

Filters the visible elements based on your selection. By default, all elements are visible.

Arranges all shapes in the diagram vertically, from top to bottom.

Arranges all shapes in the diagram horizontally, from left to right.

Collapses all elements in the diagram into smaller shapes, with only the names visible.

Expands all elements in the diagram, showing detailed information about each element.

In addition, the CCL graphical viewer now displays log stores, memory stores, and schemas. In streams and windows, there are new compartments that show elements such as filters and joins.

Note

Some elements, such as the GROUP BY clause, do not appear in these compartments.

For more information, see Developing Streaming Projects in SAP Web IDE in the SAP HANA Smart Data Streaming: Developers Guide.

4.2.4 Machine Learning Enhancements (New)

You can now import a trained Decision Tree model from an SAP HANA database, and use a new scoring function to score the data. You can also create and manage machine learning models through the streaming runtime tool.

After importing a model, you can reference it in a smart data streaming Decision Tree scoring model. You can then use the scoring model directly in streaming projects. This capability appears in both SAP HANA studio, and the streaming runtime tool for SAP Web IDE.

Note

You can't use imported training models directly in streaming projects. You can only use these as references for Decision Tree scoring models.

SAP HANA Streaming Analytics Plugin for SAP HANA Studio

To import and score the imported model in SAP HANA studio:

1. Through the data services view of the SAP HANA Streaming Development perspective, import a trained Decision Tree model from SAP HANA.

(33)

2. On the same data service, create a new model using the Decision Tree scoring function, and enter the imported model name in the Referenced Model field.

3. Add the model to your CCL project using either the visual editor or the text editor.

Streaming Runtime Tool for SAP Web IDE

You can now create, update, rename, delete, or reset machine learning (PAL) models through the streaming runtime tool, then use the models in CCL projects developed through SAP Web IDE.

To import and score the imported model in the streaming runtime tool:

1. In the Streaming Workspaces pane, open a workspace, then open the PAL Models folder.

2. Right-click on a data service and select Import Model.

3. On the same data service, create a new model using the Decision Tree scoring function, and enter the imported model name in the Referenced Model field.

4. Switch over to SAP Web IDE, and add the model to your project using the CCL text editor.

For more information, see Workflow: Using Machine Learning with Streaming in the Streaming Runtime Tool and Streaming Runtime Tool in the SAP HANA Smart Data Streaming: Developers Guide.

For complete details on importing and scoring Decision Tree models, see Importing a Model in the SAP HANA Smart Data Streaming: Developers Guide.

Related Information

SAP HANA Streaming Analytics: Developer Guide

4.2.5 Enabling the SAP HANA Repository Activation Plugin and Initializing the SAP HANA Smart Data Streaming Server (Changed)

The activation plugin allows you to activate smart data streaming content in the SAP HANA Repository. For single-container systems prior to 2.0 SP 01, the product installer automatically enabled the activation plugin.

However, in multiple-container systems, the plugin was enabled automatically when you executed the ALTER SYSTEM INITIALIZE SERVICE statement as part of initializing the connection between a tenant and the smart data streaming service. As of 2.0 SP 01, with the move to tenant databases, the ways you do both have changed.

Prior to 2.0 SP 01, you were required to open HTTP(S) access to the tenant database before executing the ALTER SYSTEM INITIALIZE SERVICE statement. You no longer need to do this as this was only required for enabling the activation plugin. See Initialize a Connection Between the Tenant Database and Streaming Server in the SAP HANA Streaming Analytics: Configuration and Administration Guide for complete, updated

instructions.

(34)

Enabling the plugin is fully optional. If you do wish to enable it, follow the steps outlined in Activating Content in the SAP HANA Repository in the SAP HANA Smart Data Streaming: Configuration and Administration Guide.If you have system replication enabled and the secondary site takes over as the primary site, you'll need to make some updates to the plugin. See Enabling the Activation of Content in the SAP HANA Repository in the SAP HANA Smart Data Streaming: Configuration and Administration Guide for complete instructions.

You only need to enable the plugin once for each tenant database that you want to have the ability to activate content. If you want to disable the plugin at any point, follow the instructions in Disabling the Activation of Content in the SAP HANA Repository in the SAP HANA Smart Data Streaming: Configuration and Administration Guide. Do this for each tenant you no longer wish to have the ability to activate content.

Related Information

SAP HANA Streaming Analytics: Configuration and Administration Guide Installation and Update Process (New and Changed) [page 27]

4.2.6 Adapter Enhancements (New)

The SAP HANA output adapter now supports two new LOB datatypes: CLOB (Character Large Object) and NCLOB (National Character Large Object).

New Datatypes

● CLOB: Stores large amounts of ASCII character data.

● NCLOB: Stores a large Unicode character object.

These datatypes map to the string datatype in streaming analytics.

When using CLOB and NCLOB datatypes, we recommend using the SAP HANA Output adapter rather than the Database Output adapter as it has a more efficient mechanism for processing these datatypes. Also, since these datatypes are larger and more resource-intensive than other datatypes, consider lowering the value of the maxCommitSize property from the default value of 25,000 to something that your machine can most effectively handle for maximum performance. Leaving the maxCommitSize at too high of a value while working with such large datatypes may overload the memory capacity of your machine, and lead to problems running your project.

For more information on maximizing performance with the SAP HANA Smart Data Streaming: Adapters Guide adapter, see Performance and Tuning Tips for the SAP HANA Adapter in the SAP HANA Smart Data Streaming:

Adapters Guide

(35)

Related Information

SAP HANA Streaming Analytics: Adapters Guide Streaming Data to SAP HANA

4.2.7 SDK Enhancements (New)

The .NET SDK has a new API to support connections to standalone projects in streaming lite.

This is the API:

NetEspServer (String^ host, int32_t port, NetEspCredentials^ creds, NetEspServerOptions^ options)

For more information, launch index.html (the API level documentation) located at STREAMING_HOME/doc/sdk/net.

Related Information

Streaming Lite

4.3 System Administration (New and Changed)

SAP HANA smart data streaming includes a new system administration feature.

SP 01 Feature Added in SP 01 Revision Date Released

Support for registering tenant data­

bases through the streaming service broker. See Streaming Service Broker Enhancements (New) [page 36].

SAP HANA Smart Data Streaming 2.0 Revision 010

12 April, 2017

In this section:

Streaming Service Broker Enhancements (New) [page 36]

You can now register tenant databases through the streaming service broker.

(36)

4.3.1 Streaming Service Broker Enhancements (New)

You can now register tenant databases through the streaming service broker.

Starting in 2.0 SP 01, the streaming service broker can connect streaming servers associated with tenant databases to XS Advanced (XSA) spaces. With this, you can build smart data streaming modules through the SAP Web IDE for the registered database, then manage deployed smart data streaming projects through the streaming runtime tool.

Before registering any databases, complete the following tasks:

1. Make sure all components are installed: XSA, the smart data streaming plugin for SAP Web IDE, and the streaming service broker.

2. Log in to the XS Advanced (XSA) Administration Tool using either:

1. The SYSTEM user.

2. Another user with the SAP HANA role XSA_SUPPORT_VIEW, and the CATALOG READ and the CREATE SCHEMA privileges.

3. Grant the XSA application role collection XS_CONTROLLER_ADMIN to your user.

4. In the SAP HANA Logical Database Setup tile, enable the tenant database for XSA.

5. In the SAP HANA Service Broker Configuration tile, map the tenant database to an XSA space or organization.

Once you have completed these tasks, you can register the tenant database through the Service Broker Configuration tile. See Configure the SAP SDS Service Broker in the SAP HANA Smart Data Streaming:

Configuration and Administration Guide guide for the complete instructions.

Related Information

Ensure that SAP HANA Streaming Analytics Works with Web IDE

SAP HANA Streaming Analytics: Configuration and Administration Guide

(37)

5 SAP HANA Smart Data Streaming 2.0 SP 00 Revision 002 Features

New features in 2.0 SP 00 Revision 002.

In this section:

Development (New) [page 37]

There is a new feature available for development as of 2.0 SP 00 Revision 002.

5.1 Development (New)

There is a new feature available for development as of 2.0 SP 00 Revision 002.

In this section:

Studio Enhancements (New and Changed) [page 37]

As of 2.0 SP 00 Revision 002, the SAP HANA Streaming Run-Test perspective in studio includes a new preference and changed default behaviour.

5.1.1 Studio Enhancements (New and Changed)

As of 2.0 SP 00 Revision 002, the SAP HANA Streaming Run-Test perspective in studio includes a new preference and changed default behaviour.

Studio Preferences

The new and changed preferences can be found in Window Preferences Run Test . They are both unchecked by default:

● (New) Automatically reconnect to all projects when connecting to a server – Your projects will no longer connect automatically when you connect to a server. You must now manually connect and disconnect from individual projects by right-clicking them and selecting Connect to Project or Disconnect from Project.

Disconnecting from a project means that you will no longer be able to view current project activity in studio, but the project will continue to run.

● (Changed) Always start previously running run-test views on project start– Any Run-Test views you previously had open with a project will no longer reopen automatically when you start that project.

For more information on connecting to a project in studio, see Connecting to a Project in the SAP HANA Smart Data Streaming: Developers Guide.

(38)

Related Information

SAP HANA Streaming Analytics: Developer Guide

(39)

6 SAP HANA Smart Data Streaming 2.0 SP 00 Features

New and changed features in 2.0 SP 00.

In this section:

Important SAP Notes [page 39]

Read the central SAP note SAP HANA Smart Data Streaming 2.0 SP 00 Release Note before you start the installation.

Installation and Update (Changed) [page 39]

As of this release, all extensions for developing and building streaming modules in SAP Web IDE are being delivered with the streaming analytics installer. However, you still need to install streaming analytics and SAP Web IDE components in a specific order.

Development (New) [page 40]

SAP HANA smart data streaming 2.0 includes new development features.

System Administration (New and Changed) [page 45]

SAP HANA smart data streaming 2.0 includes new and changed system administration features.

6.1 Important SAP Notes

Read the central SAP note SAP HANA Smart Data Streaming 2.0 SP 00 Release Note before you start the installation.

The SAP note contains the latest information about the installation, including restrictions and limitations.

SAP Note Number Title

2367236 SAP HANA Smart Data Streaming 2.0 SP 00 Release Note

6.2 Installation and Update (Changed)

As of this release, all extensions for developing and building streaming modules in SAP Web IDE are being delivered with the streaming analytics installer. However, you still need to install streaming analytics and SAP Web IDE components in a specific order.

For more information, see the topic Troubleshooting > Ensuring that Smart Data Streaming Works with Web IDE in the SAP HANA Streaming Analytics: Installation and Update Guide.

References

Related documents

Figure 13: Reference Architecture Hive Hive bI tools Hadoop Data warehouse analytics Archive Management Data exchange (SAP Data Services) Data warehouse/database (SAP HANA®,

High scores on the ethnic identity measure were significantly correlated to a measure of self-esteem for both Mexican-American students and European-American students, but did

use event marketing entertainment (like shows, contests, or parties) to reach consumers through direct hand-to-hand sampling or interactive displays.. The practice

Within the Bachelor of Education (Primary) courses, the time allocated for music is shared with other Arts areas leaving most ITE graduates with rather limited

SAP DB / HANA InfoCube Data Store Object BW Database / SAP HANA SAP Nearline Provider SAP DB / HANA PBS CBW NLS IQ Nearline Database MultiProvider PBS Nearline Services

For details on how to connect the databases for SAP HANA Smart Data Access as remote sources see the SAP HANA Administration Guide System Administration and Maintenance Information

In your examination, you find that the balance of Accounts Receivable represents sales of the current audit year only; that In your examination, you find that the balance of

Porta Caeli +.