Deep Upstream : Hardware Agnostic GStreamer Analytics
Loading
0 %
Key | Action |
---|---|
K or space | Play / Pause |
M | Mute / Unmute |
C | Select next subtitles |
A | Select next audio track |
V | Show slide in full page or toggle automatic source change |
left arrow | Seek 5s backward |
right arrow | Seek 5s forward |
shift + left arrow or J | Seek 10s backward |
shift + right arrow or L | Seek 10s forward |
control + left arrow | Seek 60s backward |
control + right arrow | Seek 60s forward |
shift + down arrow | Decrease volume |
shift + up arrow | Increase volume |
shift + comma | Decrease playback rate |
shift + dot or shift + semicolon | Increase playback rate |
end | Seek to end |
beginning | Seek to beginning |
You can right click on slides to open the menu
Share this media
HLS video stream
You can use an external player to play this stream (like VLC).
HLS video stream
Subscribe to notifications
When subscribed to notifications, an email will be sent to you for all added annotations.
Your user account has no email address.
Information on this media
Links:
Number of views:
47 (this month: 2)Creation date:
Sept. 25, 2023Speakers:
Daniel MorinLicense:
CC BY-SA 3.0Description
With the growing power of machine-learning, the time has come for GStreamer to support complex, platform-independent analytic pipelines for tracking, super-resolution, noise filtering, speech recognition and more general analysis of timed data streams. We discuss a new flexible and efficient design to address these problems, without vendor or framework lock-in, which can easily interoperate with existing downstream approaches.
To achieve this goal, we have designed new framework-independent graph-based infrastructure using the existing GstMeta structure to store complex metadata and their relationships. We have also generalized the existing ONNX-based object detector to easily support many new inference models targeting a variety of hardware backends, and have built a new OSD to visualize the generated analytics metadata. Care has been taken to ensure efficient pipelines with support for batch processing and zero-copy. Finally, we have built a bridge to non-GStreamer land with a new cloud metadata sink that can send analytics results to cloud servers.
We will also present a demo at the end of the talk showcasing a complex two-phase video analysis pipeline.
Other media in the channel "GStreamer Conference 2023"
- 246 views, 246 this year, 11 this monthHow we are building a distributed multi-camera real-time sports tracking system using GStreamer and RustSeptember 26th, 2023
- 41 views, 41 this year, 3 this monthFlumes: Scan and index your multimedia filesSeptember 26th, 2023
- 168 views, 168 this year, 21 this monthGstWASM: GStreamer for the webSeptember 26th, 2023
- 60 views, 60 this year, 5 this monthVariations on a WebRTC relay architecture (featuring Janus and WebRTC{Src,Sink})September 26th, 2023
- 40 views, 40 this year, 2 this monthHYPE: HYbrid Parallel EncoderSeptember 26th, 2023
- 47 views, 47 this year, 3 this monthlibcamerasrc: Introduction and usage of libcamera's GStreamer elementSeptember 26th, 2023