Qt 5.4 Multimedia Backends: Difference between revisions

From Qt Wiki
Jump to navigation Jump to search
No edit summary
 
No edit summary
Line 1: Line 1:
=Qt Multimedia Backends=
[[Category:Developing_Qt::Qt_Multimedia]]


For most features, Qt Multimedia builds upon the multimedia framework of the underlying system. Therefore there are several multimedia backends based on different technologies and <span class="caps">API</span>s. The glue between platform specific libraries and Qt Multimedia is contained in a plugin. There are currently three kinds of plugins in Qt Multimedia:
= Qt Multimedia Backends =


* MediaService plugins, to provide media player, camera, radio, and recording features
For most features, Qt Multimedia builds upon the multimedia framework of the underlying system. Therefore there are several multimedia backends based on different technologies and APIs. The glue between platform specific libraries and Qt Multimedia is contained in a plugin. There are currently three kinds of plugins in Qt Multimedia:<br />* MediaService plugins, to provide media player, camera, radio, and recording features<br />* Audio plugins, to provide low-latency audio support<br />* PlaylistFormat plugins, to support a specific playlist file format
* Audio plugins, to provide low-latency audio support
* PlaylistFormat plugins, to support a specific playlist file format


Plugins do not necessarily implement all possible features and different backends have different capabilities.<br /> The following tables give an overview of what is supported by each backend in Qt 5.4.
Plugins do not necessarily implement all possible features and different backends have different capabilities.<br />The following tables give an overview of what is supported by each backend in Qt 5.4.


==MediaService plugins==
== MediaService plugins ==


====Supported media player features by backend====
==== Supported media player features by backend ====


{| class="infotable line"
{background:#009900}. |''. |''. DirectShow (Windows) |''. Media Foundation (Windows) |''. AV Foundation (Mac OS / iOS) |''. GStreamer (Unix) |''. Android |''. BlackBerry |<br />| MediaPlayer control| X | X | X | X | X | X |<br />| URL source (local and remote) | X | X | X | X | X | X |<br />| Stream source | X | X | | X | | |<br />| Metadata | X | X | partial | X | X | X |<br />| Playback rate | X | X | X | X | | X |<br />| Track selection | | | | X | | |<br />| HW decoding | | Only when using Angle | X | | X | X |<br />| Video window control | X | X | X | X | | X |<br />| Video widget control | | | X | X | | |<br />| Video renderer control (includes OpenGL textures) | X | X | X (only Mac OS) | X | X | X |<br />| Audio probe | | X | | X | | |<br />| Video Probe | | X | | X | | |
|- style="background: #009900"
<br />h4. Supported camera features by backend
!
<br />{background:#009900}. |''. |''. DirectShow (Windows) |''. Media Foundation (Windows) |''. AV Foundation (Mac OS / iOS) |''. GStreamer (Unix) |''. Android |''. BlackBerry |<br />| Camera control | X | | X | X | X | X |<br />| Video window control | | | | X | | |<br />| Video widget control | X | | | X | | |<br />| Video renderer control (includes OpenGL textures) | X | | X | X | X | X |<br />| ViewFinder settings | | | | resolution | | resolution, framerate, pixel format |<br />| Image capture | X | | X | X | X | X |<br />| Capture destination | File | | File | File, Buffer | File, Buffer | File, Buffer |<br />| Image settings | | | | resolution | resolution, quality | resolution, quality |<br />| Zoom | | | | X | X | X |<br />| Flash | | | | X | X | X |<br />| Focus | | | | only focused notification | mode, custom point | mode, custom point |<br />| Exposure | | | | Scene mode, compensation, ISO, aperture, ShutterSpeed | Scene mode, compensation | Scene mode |<br />| Image Processing | | | | White Balance, Contrast, Brightness, Saturation, | White Balance | White Balance |<br />| Locks | | | | Focus | Focus, Exposure, White Balance | Focus, Exposure, White Balance |
! DirectShow (Windows)
! Media Foundation (Windows)
! AV Foundation (Mac OS / iOS)
! GStreamer (Unix)
! Android
! BlackBerry
|-
| MediaPlayer control
| X
| X
| X
| X
| X
| X
|-
| <span class="caps">URL</span> source (local and remote)
| X
| X
| X
| X
| X
| X
|-
| Stream source
| X
| X
|
| X
|
|
|-
| Metadata
| X
| X
| partial
| X
| X
| X
|-
| Playback rate
| X
| X
| X
| X
|
| X
|-
| Track selection
|
|
|
| X
|
|
|-
| HW decoding
|
| Only when using Angle
| X
|
| X
| X
|-
| Video window control
| X
| X
| X
| X
|
| X
|-
| Video widget control
|
|
| X
| X
|
|
|-
| Video renderer control (includes OpenGL textures)
| X
| X
| X (only Mac OS)
| X
| X
| X
|-
| Audio probe
|
| X
|
| X
|
|
|-
| Video Probe
|
| X
|
| X
|
|
|}


====Supported camera features by backend====
==== Supported recording features by backend ====


{| class="infotable line"
{background:#009900}. |''. |''. DirectShow (Windows) |''. Media Foundation (Windows) |''. AV Foundation (Mac OS / iOS) |''. GStreamer (Unix) |''. Android |''. BlackBerry |<br />| Record camera | | | X | X | X | X |<br />| Record audio | Fallback to audio backend | Fallback to audio backend | Fallback to audio backend | X | X | Fallback to audio backend |<br />| MetaData writer | | | | X | | |<br />| Audio encoder settings | | | | X | X | X |<br />| Video encoder settings | | | | X | X | X |<br />| Container settings | | | | X | X | |
|- style="background: #009900"
<br />h4. Supported audio decoding features by backend<br />{background:#009900}. |''. |''. DirectShow (Windows) |''. Media Foundation (Windows) |''. AV Foundation (Mac OS / iOS) |''. GStreamer (Unix) |''. Android |''. BlackBerry |<br />| Decode audio | | X | | X | | |
!
! DirectShow (Windows)
! Media Foundation (Windows)
! AV Foundation (Mac OS / iOS)
! GStreamer (Unix)
! Android
! BlackBerry
|-
| Camera control
| X
|
| X
| X
| X
| X
|-
| Video window control
|
|
|
| X
|
|
|-
| Video widget control
| X
|
|
| X
|
|
|-
| Video renderer control (includes OpenGL textures)
| X
|
| X
| X
| X
| X
|-
| ViewFinder settings
|
|
|
| resolution
|
| resolution, framerate, pixel format
|-
| Image capture
| X
|
| X
| X
| X
| X
|-
| Capture destination
| File
|
| File
| File, Buffer
| File, Buffer
| File, Buffer
|-
| Image settings
|
|
|
| resolution
| resolution, quality
| resolution, quality
|-
| Zoom
|
|
|
| X
| X
| X
|-
| Flash
|
|
|
| X
| X
| X
|-
| Focus
|
|
|
| only focused notification
| mode, custom point
| mode, custom point
|-
| Exposure
|
|
|
| Scene mode, compensation, <span class="caps">ISO</span>, aperture, ShutterSpeed
| Scene mode, compensation
| Scene mode
|-
| Image Processing
|
|
|
| White Balance, Contrast, Brightness, Saturation,
| White Balance
| White Balance
|-
| Locks
|
|
|
| Focus
| Focus, Exposure, White Balance
| Focus, Exposure, White Balance
|}


====Supported recording features by backend====
== Audio plugins ==
 
{| class="infotable line"
|- style="background: #009900"
!
! DirectShow (Windows)
! Media Foundation (Windows)
! AV Foundation (Mac OS / iOS)
! GStreamer (Unix)
! Android
! BlackBerry
|-
| Record camera
|
|
| X
| X
| X
| X
|-
| Record audio
| Fallback to audio backend
| Fallback to audio backend
| Fallback to audio backend
| X
| X
| Fallback to audio backend
|-
| MetaData writer
|
|
|
| X
|
|
|-
| Audio encoder settings
|
|
|
| X
| X
| X
|-
| Video encoder settings
|
|
|
| X
| X
| X
|-
| Container settings
|
|
|
| X
| X
|
|}
 
====Supported audio decoding features by backend {| class="infotable line" |- style="background: #009900" !  ! DirectShow (Windows) ! Media Foundation (Windows) ! AV Foundation (Mac OS / iOS) ! GStreamer (Unix) ! Android ! BlackBerry |- | Decode audio |  | X |  | X |  |  |}====
 
==Audio plugins==


Audio backends implement QAudioInput, QAudioOutput, QAudioDeviceInfo and QSoundEffect
Audio backends implement QAudioInput, QAudioOutput, QAudioDeviceInfo and QSoundEffect


Here is the list of the current audio backends:
Here is the list of the current audio backends:<br />* Windows Multimedia<br />* CoreAudio (Mac OS / iOS)<br />* PulseAudio (Unix)<br />* Alsa (Unix)<br />* OpenSL ES (Android)<br />* QNX
 
* Windows Multimedia
* CoreAudio (Mac OS / iOS)
* PulseAudio (Unix)
* Alsa (Unix)
* OpenSL ES (Android)
* <span class="caps">QNX</span>
 
==PlaylistFormat plugins==
 
Only m3u is supported at the moment.
 
===Categories:===


* [[:Category:Developing Qt|Developing_Qt]]
== PlaylistFormat plugins ==
** [[:Category:Developing Qt::Qt Multimedia|Qt_Multimedia]]

Revision as of 14:34, 23 February 2015


Qt Multimedia Backends

For most features, Qt Multimedia builds upon the multimedia framework of the underlying system. Therefore there are several multimedia backends based on different technologies and APIs. The glue between platform specific libraries and Qt Multimedia is contained in a plugin. There are currently three kinds of plugins in Qt Multimedia:
* MediaService plugins, to provide media player, camera, radio, and recording features
* Audio plugins, to provide low-latency audio support
* PlaylistFormat plugins, to support a specific playlist file format

Plugins do not necessarily implement all possible features and different backends have different capabilities.
The following tables give an overview of what is supported by each backend in Qt 5.4.

MediaService plugins

Supported media player features by backend

{background:#009900}. |. |. DirectShow (Windows) |. Media Foundation (Windows) |. AV Foundation (Mac OS / iOS) |. GStreamer (Unix) |. Android |. BlackBerry |
| MediaPlayer control| X | X | X | X | X | X |
| URL source (local and remote) | X | X | X | X | X | X |
| Stream source | X | X | | X | | |
| Metadata | X | X | partial | X | X | X |
| Playback rate | X | X | X | X | | X |
| Track selection | | | | X | | |
| HW decoding | | Only when using Angle | X | | X | X |
| Video window control | X | X | X | X | | X |
| Video widget control | | | X | X | | |
| Video renderer control (includes OpenGL textures) | X | X | X (only Mac OS) | X | X | X |
| Audio probe | | X | | X | | |
| Video Probe | | X | | X | | |

h4. Supported camera features by backend
{background:#009900}. |. |. DirectShow (Windows) |. Media Foundation (Windows) |. AV Foundation (Mac OS / iOS) |. GStreamer (Unix) |. Android |. BlackBerry |
| Camera control | X | | X | X | X | X |
| Video window control | | | | X | | |
| Video widget control | X | | | X | | |
| Video renderer control (includes OpenGL textures) | X | | X | X | X | X |
| ViewFinder settings | | | | resolution | | resolution, framerate, pixel format |
| Image capture | X | | X | X | X | X |
| Capture destination | File | | File | File, Buffer | File, Buffer | File, Buffer |
| Image settings | | | | resolution | resolution, quality | resolution, quality |
| Zoom | | | | X | X | X |
| Flash | | | | X | X | X |
| Focus | | | | only focused notification | mode, custom point | mode, custom point |
| Exposure | | | | Scene mode, compensation, ISO, aperture, ShutterSpeed | Scene mode, compensation | Scene mode |
| Image Processing | | | | White Balance, Contrast, Brightness, Saturation, | White Balance | White Balance |
| Locks | | | | Focus | Focus, Exposure, White Balance | Focus, Exposure, White Balance |

Supported recording features by backend

{background:#009900}. |. |. DirectShow (Windows) |. Media Foundation (Windows) |. AV Foundation (Mac OS / iOS) |. GStreamer (Unix) |. Android |. BlackBerry |
| Record camera | | | X | X | X | X |
| Record audio | Fallback to audio backend | Fallback to audio backend | Fallback to audio backend | X | X | Fallback to audio backend |
| MetaData writer | | | | X | | |
| Audio encoder settings | | | | X | X | X |
| Video encoder settings | | | | X | X | X |
| Container settings | | | | X | X | |

h4. Supported audio decoding features by backend
{background:#009900}. |. |. DirectShow (Windows) |. Media Foundation (Windows) |. AV Foundation (Mac OS / iOS) |. GStreamer (Unix) |. Android |. BlackBerry |
| Decode audio | | X | | X | | |

Audio plugins

Audio backends implement QAudioInput, QAudioOutput, QAudioDeviceInfo and QSoundEffect

Here is the list of the current audio backends:
* Windows Multimedia
* CoreAudio (Mac OS / iOS)
* PulseAudio (Unix)
* Alsa (Unix)
* OpenSL ES (Android)
* QNX

PlaylistFormat plugins