Analytics data types and formats

Through Milestone AI Bridge, you can subscribe to three analytics data types from IVA applications. Each type has different analytics data formats, purposes, and expressions in the XProtect VMS.

Type Purpose, expression, and format
Events

If you subscribe to an analytics topic with the analytics data type Event, the IVA application sends an event to the XProtect VMS when the analytics topic discovers that something has happened. You can use the event in rules and for triggering alarms.

In XProtect Smart Client, alarms are available from the Alarm Manager tab.

On the Alarm Manager tab, the graphical elements from the analytics topics are displayed as an overlay on the video to assist the operator in identifying what the analytics topic was looking for and the object that caused the event. Depending on the IVA application, some analytics topics may not have graphical elements to display as overlays on the video.

This analytics data type has the format: analytics_event.

Metadata

If you subscribe to analytics topics with the analytics data type Metadata, a steady stream of metadata related to the analytics topic is sent to the XProtect VMS. In XProtect Smart Client, metadata can be displayed as bounding boxes around the metadata-related objects.

This analytics data type has the following formats:

  • deepstream_minimal: based on the NVIDIA deepstream_minimal format

  • onvif_analytics_frame: based on an ONVIF format

  • onvif_analytics: based on an ONVIF format

Video

If you subscribe to analytics topics with the analytics data type Video, the IVA application sends a steady stream of video to the XProtect VMS. Often the video is modified by the IVA application.

For instance, you can subscribe to receiving blurred anonymized video into XProtect Smart Client, and create a rule that displays the original video without blurring when the rule is triggered by an analytics event. This enables you to protect privacy but also allows your operators to take action when needed.

Each stream of video from the IVA application requires its own device license.

This analytics data type has the formats: MJPEG, H.264, or H.265.