Analytics data types and formats

Through Milestone AI Bridge, you can subscribe to three analytics data typesClosed The nature of the analytics data when the IVA application sends the data back to the XProtect VMS. Possible analytics data types are events, metadata, and video. from IVA applications. Each type has different analytics data formatsClosed The format of the analytics data when the data is sent back to the XProtect VMS. Each analytics data type has different formats. An example: the analytics data type Event has the analytics data format analytics_event., purposes, and expressions in the XProtect VMS.

Type Purpose, expression, and format
Events

If you subscribe to an analytics topic with the analytics data type Event, the IVA application sends an event to the XProtect VMS when the analytics topic discovers that something has happened. You can use the event in rules and for triggering alarms.

In XProtect Smart Client, alarms are available from the Alarm Manager tab.

On the Alarm Manager tab, the graphical elements from the analytics topics are displayed as an overlay on the video to assist the operator in identifying what the analytics topic was looking for and the objectClosed In connection with video analytics, an object is anything that IVA applications look for in the video. Typical examples are persons and vehicles. But it could also be smaller personal belongings like hats, coats, and luggage and the characteristics or behaviors of these, or a combination of all these. Examples: white cars, luggage left unattended, speeding vehicles, or vehicles moving in the wrong direction. that caused the event. Depending on the IVA application, some analytics topics may not have graphical elements to display as overlays on the video.

This analytics data type has the format: analytics_event.

Metadata

If you subscribe to analytics topics with the analytics data type Metadata, a steady stream of metadata related to the analytics topic is sent to the XProtect VMS. In XProtect Smart Client, metadata can be displayed as bounding boxes around the metadata-related objects.

This analytics data type has the following formats:

  • deepstream_minimal: based on the NVIDIA deepstream_minimal format

  • onvif_analytics_frame: based on an ONVIF format

  • onvif_analytics: based on an ONVIF format

Video

If you subscribe to analytics topics with the analytics data type Video, the IVA application sends a steady stream of video to the XProtect VMS. Often the video is modified by the IVA application.

For instance, you can subscribe to receiving blurred anonymized video into XProtect Smart Client, and create a rule that displays the original video without blurring when the rule is triggered by an analytics event. This enables you to protect privacy but also allows your operators to take action when needed.

Each stream of video from the IVA application requires its own device license.

This analytics data type has the formats: MJPEG, H.264, or H.265.