androidx.media3.exoplayer.Renderer
Subclasses:
BaseRenderer, NoSampleRenderer, MetadataRenderer, MediaCodecAudioRenderer, DecoderAudioRenderer<T>, ImageRenderer, TextRenderer, MediaCodecVideoRenderer, DecoderVideoRenderer, CameraMotionRenderer, MediaCodecRenderer, FakeVideoRenderer, FakeMediaClockRenderer, FakeRenderer, FakeAudioRenderer, MidiRenderer
Gradle dependencies
compile group: 'androidx.media3', name: 'media3-exoplayer', version: '1.5.0-alpha01'
- groupId: androidx.media3
- artifactId: media3-exoplayer
- version: 1.5.0-alpha01
Artifact androidx.media3:media3-exoplayer:1.5.0-alpha01 it located at Google repository (https://maven.google.com/)
Overview
Renders media read from a SampleStream.
Internally, a renderer's lifecycle is managed by the owning ExoPlayer. The renderer is
transitioned through various states as the overall playback state and enabled tracks change. The
valid state transitions are shown below, annotated with the methods that are called during each
transition.
Format support
The player will select a renderer based on the
RendererCapabilities returned from
Renderer.getCapabilities(). If the capabilities indicate support for a
Format, the renderer is
expected to handle
SampleStream instances containing samples of this
Format.
Resource management
Renderers should acquire resources like codecs when entering Renderer.STATE_ENABLED for the
first time. As the renderer may transition quickly to and from Renderer.STATE_DISABLED, it is
recommended to hold onto resources even when entering Renderer.STATE_DISABLED. The player will
explicitly call Renderer.reset() if the renderer is no longer needed, at which point any acquired
limited resources should be released.
Configuration changes
As renderers are created once in the lifetime of a player, they may need to be re-configured
later based on user settings or other environmental changes. This is generally done by handling
player messages in PlayerMessage.Target.handleMessage(int, Object). There are many predefined
common reconfigurations in Renderer.MessageType, but custom renderers can add their own handling
as needed.
Reading and rendering samples
The renderer receives a SampleStream to read from when enabled.
When seamlessly transitioning from one item to another, the renderer may get new SampleStream instances via Renderer.replaceStream(Format[], SampleStream, long, long, MediaSource.MediaPeriodId). Note that Renderer.replaceStream(Format[], SampleStream, long, long, MediaSource.MediaPeriodId) may be
called as soon as the end-of-stream signal has been read
from the current SampleStream to allow reading new samples as early as possible. At this
point, the renderer may still be processing samples from the previous stream(s). Once the current
stream has been marked as final, no further calls to Renderer.replaceStream(Format[], SampleStream, long, long, MediaSource.MediaPeriodId) are allowed to happen without first disabling the renderer
again.
The player will regularly call Renderer.render(long, long) to let the renderer make progress. Once the
renderer has prepared its internal pipeline to handle continuous playback progress, it should
report itself as Renderer.isReady(). The player will only transition the renderer to Renderer.STATE_STARTED if it reports itself as ready. If the renderer is blocked from making progress,
it should return false from Renderer.isReady(), which will result in a Renderer.stop()
operation back to Renderer.STATE_ENABLED.
As long as it is in Renderer.STATE_STARTED, the renderer is expected to actively output the
data it is processing in line with the current playback position passed to Renderer.render(long, long). The
only exception is the very first sample (for example the first video frame), that is allowed to
be output in Renderer.STATE_ENABLED if the mayRenderStartOfStream flag was set in Renderer.enable(RendererConfiguration, Format[], SampleStream, long, boolean, boolean, long, long, MediaSource.MediaPeriodId) or later set via Renderer.enableMayRenderStartOfStream().
Once the renderer finished all processing it needs to do (that is, no further call to Renderer.render(long, long) is needed) and the current stream is final, it
should report itself as Renderer.isEnded().
Timestamps and offsets
The renderer deals with potentially multiple consecutive input streams and has to handle
position updates and stream transitions. This means there are multiple types of timestamps and
offsets relevant in the context of this class:
- SampleStream timestamp: The timestamp associated with each sample read from
a SampleStream. This corresponds to the time in the this
stream belongs to. The current playback context can be obtained by using the Timeline and the MediaSource.MediaPeriodId provided together with each SampleStream.
- Renderer timestamp: The timestamp of the overall playback. This is a continuously
increasing value across all input sample streams and what it passed to Renderer.render(long, long) as
the current positionUs.
- Stream offset: The constant offset between the current SampleStream
timestamps and the renderer timestamp. This value is provided when setting a new
stream in Renderer.enable(RendererConfiguration, Format[], SampleStream, long, boolean, boolean, long, long, MediaSource.MediaPeriodId) or Renderer.replaceStream(Format[], SampleStream, long, long, MediaSource.MediaPeriodId).
- Stream start position: The renderer timestamp at which the current SampleStream first starts playing. This value is provided when setting a new stream in
Renderer.enable(RendererConfiguration, Format[], SampleStream, long, boolean, boolean, long, long, MediaSource.MediaPeriodId) or Renderer.replaceStream(Format[], SampleStream, long, long, MediaSource.MediaPeriodId). Note that it may be different from the Stream
offset as streams can start at non-zero SampleStream timestamps.
- Reset position: The Renderer timestamp at which continuous playback last
started. This is either the stream start position provided in Renderer.enable(RendererConfiguration, Format[], SampleStream, long, boolean, boolean, long, long, MediaSource.MediaPeriodId), or
the position set in any subsequent Renderer.resetPosition(long) call. Note that this value is not
changed when playback transitions seamlessly to a new stream after calling Renderer.replaceStream(Format[], SampleStream, long, long, MediaSource.MediaPeriodId). After any position reset, the samples read next are those needed to start
playback at the intended reset position. In some cases, the renderer will encounter
output data before the intended reset position (for example video frames starting
from the previous keyframe). In these cases, the renderer should drop data internally and
only start producing output at the intended reset position.
Summary
Methods |
---|
public void | disable()
Disable the renderer, transitioning it to the Renderer.STATE_DISABLED state. |
public void | enable(RendererConfiguration configuration, Format formats[], SampleStream stream, long positionUs, boolean joining, boolean mayRenderStartOfStream, long startPositionUs, long offsetUs, MediaSource.MediaPeriodId mediaPeriodId)
Enables the renderer to consume from the specified SampleStream. |
public void | enableMayRenderStartOfStream()
Enables this renderer to render the start of the stream even if the state is not Renderer.STATE_STARTED yet. |
public RendererCapabilities | getCapabilities()
Returns the capabilities of the renderer. |
public long | getDurationToProgressUs(long positionUs, long elapsedRealtimeUs)
Returns minimum amount of playback clock time that must pass in order for the Renderer.render(long, long)
call to make progress. |
public MediaClock | getMediaClock()
If the renderer advances its own playback position then this method returns a corresponding
MediaClock. |
public java.lang.String | getName()
Returns the name of this renderer, for logging and debugging purposes. |
public long | getReadingPositionUs()
Returns the renderer time up to which the renderer has read samples, in microseconds, or C.TIME_END_OF_SOURCE if the renderer has read the current SampleStream to the end. |
public int | getState()
Returns the current state of the renderer. |
public SampleStream | getStream()
Returns the SampleStream being consumed, or null if the renderer is disabled. |
public int | getTrackType()
Returns the track type that the renderer handles. |
public boolean | hasReadStreamToEnd()
Returns whether the renderer has read the current SampleStream to the end. |
public void | init(int index, PlayerId playerId, Clock clock)
Initializes the renderer for playback with a player. |
public boolean | isCurrentStreamFinal()
Returns whether the current SampleStream will be the final one supplied before the
renderer is next disabled or reset. |
public boolean | isEnded()
Whether the renderer is ready for the ExoPlayer instance to transition to Player.STATE_ENDED. |
public boolean | isReady()
Whether the renderer is able to immediately render media from the current position. |
public void | maybeThrowStreamError()
Throws an error that's preventing the renderer from reading from its SampleStream. |
public void | release()
Releases the renderer. |
public void | render(long positionUs, long elapsedRealtimeUs)
Incrementally renders the SampleStream. |
public void | replaceStream(Format formats[], SampleStream stream, long startPositionUs, long offsetUs, MediaSource.MediaPeriodId mediaPeriodId)
Replaces the SampleStream from which samples will be consumed. |
public void | reset()
Forces the renderer to give up any resources (e.g. |
public void | resetPosition(long positionUs)
Signals to the renderer that a position discontinuity has occurred. |
public void | setCurrentStreamFinal()
Signals to the renderer that the current SampleStream will be the final one supplied
before it is next disabled or reset. |
public void | setPlaybackSpeed(float currentPlaybackSpeed, float targetPlaybackSpeed)
Indicates the playback speed to this renderer. |
public void | setTimeline(Timeline timeline)
Sets the timeline that is currently being played. |
public void | start()
Starts the renderer, meaning that calls to Renderer.render(long, long) will cause media to be
rendered. |
public void | stop()
Stops the renderer, transitioning it to the Renderer.STATE_ENABLED state. |
Fields
public static final long
DEFAULT_DURATION_TO_PROGRESS_USDefault minimum duration that the playback clock must advance before Renderer.render(long, long) can make
progress.
See also: Renderer.getDurationToProgressUs(long, long)
public static final int
MSG_SET_VIDEO_OUTPUTThe type of a message that can be passed to a video renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload is normally a , however some video renderers may accept other outputs (e.g., VideoDecoderOutputBufferRenderer).
If the receiving renderer does not support the payload type as an output, then it will clear
any existing output that it has.
public static final int
MSG_SET_VOLUMEA type of a message that can be passed to an audio renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be a java.lang.Float
with 0 being silence and 1 being unity gain.
public static final int
MSG_SET_AUDIO_ATTRIBUTESA type of a message that can be passed to an audio renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be an AudioAttributes instance that will configure the underlying audio track. If not set, the
default audio attributes will be used. They are suitable for general media playback.
Setting the audio attributes during playback may introduce a short gap in audio output as
the audio track is recreated. A new audio session id will also be generated.
If tunneling is enabled by the track selector, the specified audio attributes will be
ignored, but they will take effect if audio is later played without tunneling.
If the device is running a build before platform API version 21, audio attributes cannot be
set directly on the underlying audio track. In this case, the usage will be mapped onto an
equivalent stream type using Util.getStreamTypeForAudioUsage(int).
To get audio attributes that are equivalent to a legacy stream type, pass the stream type to
Util.getAudioUsageForStreamType(int) and use the returned to build
an audio attributes instance.
public static final int
MSG_SET_SCALING_MODEThe type of a message that can be passed to a MediaCodec
-based video renderer via
ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be one of the
integer scaling modes in .
Note that the scaling mode only applies if the targeted by the renderer is
owned by a .
public static final int
MSG_SET_CHANGE_FRAME_RATE_STRATEGYThe type of a message that can be passed to a video renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be one of the
integer strategy constants in .
public static final int
MSG_SET_AUX_EFFECT_INFOA type of a message that can be passed to an audio renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be an AuxEffectInfo instance representing an auxiliary audio effect for the underlying audio track.
public static final int
MSG_SET_VIDEO_FRAME_METADATA_LISTENERThe type of a message that can be passed to a video renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be a VideoFrameMetadataListener instance, or null.
public static final int
MSG_SET_CAMERA_MOTION_LISTENERThe type of a message that can be passed to a camera motion renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be a CameraMotionListener instance, or null.
public static final int
MSG_SET_SKIP_SILENCE_ENABLEDThe type of a message that can be passed to an audio renderer via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be a java.lang.Boolean
instance telling whether to enable or disable skipping silences in the audio stream.
public static final int
MSG_SET_AUDIO_SESSION_IDThe type of a message that can be passed to audio and video renderers via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be an java.lang.Integer
instance representing the audio session ID that will be attached to the underlying
audio track. Video renderers that support tunneling will use the audio session ID when
tunneling is enabled.
public static final int
MSG_SET_WAKEUP_LISTENERThe type of a message that can be passed to a Renderer via ExoPlayer.createMessage(PlayerMessage.Target), to inform the renderer that it can schedule
waking up another component.
The message payload must be a Renderer.WakeupListener instance.
public static final int
MSG_SET_PREFERRED_AUDIO_DEVICEThe type of a message that can be passed to audio renderers via ExoPlayer.createMessage(PlayerMessage.Target). The message payload should be an instance representing the preferred audio device, or null to
restore the default.
public static final int
MSG_SET_VIDEO_EFFECTSThe type of a message that can be passed to a video renderer. The message payload should be a
java.util.List
containing video effects.
public static final int
MSG_SET_VIDEO_OUTPUT_RESOLUTIONThe type of a message that can be passed to a video renderer to set the desired output
resolution. The message payload should be a Size of the desired output width and
height. Use this method only when playing with video effects.
public static final int
MSG_SET_IMAGE_OUTPUTThe type of message that can be passed to an image renderer to set a desired image output. The
message payload should be an ImageOutput, or null to clear a previously set image
output.
public static final int
MSG_SET_PRIORITYThe type of message that can be passed to a renderer to set its priority. The message payload
should be an java.lang.Integer
instance for the priority of the renderer. See C.PRIORITY_
constants for predefined values.
public static final int
MSG_CUSTOM_BASEApplications or extensions may define custom MSG_* constants that can be passed to
renderers. These custom constants must be greater than or equal to this value.
public static final int
STATE_DISABLEDThe renderer is disabled. A renderer in this state will not proactively acquire resources that
it requires for rendering (e.g., media decoders), but may continue to hold any that it already
has. Renderer.reset() can be called to force the renderer to release such resources.
public static final int
STATE_ENABLEDThe renderer is enabled but not started. A renderer in this state may render media at the
current position (e.g. an initial video frame), but the position will not advance. A renderer
in this state will typically hold resources that it requires for rendering (e.g. media
decoders).
public static final int
STATE_STARTEDThe renderer is started. Calls to Renderer.render(long, long) will cause media to be rendered.
Methods
public java.lang.String
getName()
Returns the name of this renderer, for logging and debugging purposes. Should typically be the
renderer's (un-obfuscated) class name.
Returns:
The name of this renderer.
public int
getTrackType()
Returns the track type that the renderer handles.
Returns:
The .
See also: ExoPlayer.getRendererType(int)
Returns the capabilities of the renderer.
Returns:
The capabilities of the renderer.
Initializes the renderer for playback with a player.
Parameters:
index: The renderer index within the player.
playerId: The PlayerId of the player.
clock: The Clock.
If the renderer advances its own playback position then this method returns a corresponding
MediaClock. If provided, the player will use the returned MediaClock as its
source of time during playback. A player may have at most one renderer that returns a MediaClock from this method.
Returns:
The MediaClock tracking the playback position of the renderer, or null.
Returns the current state of the renderer.
Returns:
The current state. One of Renderer.STATE_DISABLED, Renderer.STATE_ENABLED and Renderer.STATE_STARTED.
Enables the renderer to consume from the specified SampleStream.
This method may be called when the renderer is in the following states: Renderer.STATE_DISABLED.
Parameters:
configuration: The renderer configuration.
formats: The enabled formats.
stream: The SampleStream from which the renderer should consume.
positionUs: The player's current position.
joining: Whether this renderer is being enabled to join an ongoing playback.
mayRenderStartOfStream: Whether this renderer is allowed to render the start of the
stream even if the state is not Renderer.STATE_STARTED yet.
startPositionUs: The start position of the stream in renderer time (microseconds).
offsetUs: The offset to be added to timestamps of buffers read from stream before
they are rendered.
mediaPeriodId: The MediaSource.MediaPeriodId of the MediaPeriod producing the stream.
Starts the renderer, meaning that calls to Renderer.render(long, long) will cause media to be
rendered.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED.
Replaces the SampleStream from which samples will be consumed.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
Parameters:
formats: The enabled formats.
stream: The SampleStream from which the renderer should consume.
startPositionUs: The start position of the new stream in renderer time (microseconds).
offsetUs: The offset to be added to timestamps of buffers read from stream before
they are rendered.
mediaPeriodId: The MediaSource.MediaPeriodId of the MediaPeriod producing the stream.
Returns the SampleStream being consumed, or null if the renderer is disabled.
public boolean
hasReadStreamToEnd()
Returns whether the renderer has read the current SampleStream to the end.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
public long
getReadingPositionUs()
Returns the renderer time up to which the renderer has read samples, in microseconds, or C.TIME_END_OF_SOURCE if the renderer has read the current SampleStream to the end.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
public long
getDurationToProgressUs(long positionUs, long elapsedRealtimeUs)
Returns minimum amount of playback clock time that must pass in order for the Renderer.render(long, long)
call to make progress.
The default return time is Renderer.DEFAULT_DURATION_TO_PROGRESS_US.
Parameters:
positionUs: The current render position in microseconds, measured at the start of the
current iteration of the rendering loop.
elapsedRealtimeUs: in microseconds,
measured at the start of the current iteration of the rendering loop.
Returns:
Minimum amount of playback clock time that must pass before renderer is able to make
progress.
public void
setCurrentStreamFinal()
Signals to the renderer that the current SampleStream will be the final one supplied
before it is next disabled or reset.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
public boolean
isCurrentStreamFinal()
Returns whether the current SampleStream will be the final one supplied before the
renderer is next disabled or reset.
public void
maybeThrowStreamError()
Throws an error that's preventing the renderer from reading from its SampleStream. Does
nothing if no such error exists.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
public void
resetPosition(long positionUs)
Signals to the renderer that a position discontinuity has occurred.
After a position discontinuity, the renderer's SampleStream is guaranteed to provide
samples starting from a key frame.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
Parameters:
positionUs: The new playback position in microseconds.
public void
setPlaybackSpeed(float currentPlaybackSpeed, float targetPlaybackSpeed)
Indicates the playback speed to this renderer.
The default implementation is a no-op.
Parameters:
currentPlaybackSpeed: The factor by which playback is currently sped up.
targetPlaybackSpeed: The target factor by which playback should be sped up. This may be
different from currentPlaybackSpeed, for example, if the speed is temporarily
adjusted for live playback.
public void
enableMayRenderStartOfStream()
Enables this renderer to render the start of the stream even if the state is not Renderer.STATE_STARTED yet.
This is used to update the value of mayRenderStartOfStream passed to Renderer.enable(RendererConfiguration, Format[], SampleStream, long, boolean, boolean, long, long, MediaSource.MediaPeriodId).
public void
setTimeline(
Timeline timeline)
Sets the timeline that is currently being played.
public void
render(long positionUs, long elapsedRealtimeUs)
Incrementally renders the SampleStream.
If the renderer is in the Renderer.STATE_ENABLED state then each call to this method will do
work toward being ready to render the SampleStream when the renderer is started. If the
renderer is in the Renderer.STATE_STARTED state then calls to this method will render the
SampleStream in sync with the specified media positions.
The renderer may also render the very start of the media at the current position (e.g. the
first frame of a video stream) while still in the Renderer.STATE_ENABLED state, unless it's the
initial start of the media after calling Renderer with mayRenderStartOfStream set to false.
This method should return quickly, and should not block if the renderer is unable to make
useful progress.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
Parameters:
positionUs: The current media time in microseconds, measured at the start of the current
iteration of the rendering loop.
elapsedRealtimeUs: in microseconds,
measured at the start of the current iteration of the rendering loop.
Whether the renderer is able to immediately render media from the current position.
If the renderer is in the Renderer.STATE_STARTED state then returning true indicates that
the renderer has everything that it needs to continue playback. Returning false indicates that
the player should pause until the renderer is ready.
If the renderer is in the Renderer.STATE_ENABLED state then returning true indicates that
the renderer is ready for playback to be started. Returning false indicates that it is not.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
Returns:
Whether the renderer is ready to render media.
Whether the renderer is ready for the ExoPlayer instance to transition to Player.STATE_ENDED. The player will make this transition as soon as true is returned
by all of its renderers.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED, Renderer.STATE_STARTED.
Returns:
Whether the renderer is ready for the player to transition to the ended state.
Stops the renderer, transitioning it to the Renderer.STATE_ENABLED state.
This method may be called when the renderer is in the following states: Renderer.STATE_STARTED.
Disable the renderer, transitioning it to the Renderer.STATE_DISABLED state.
This method may be called when the renderer is in the following states: Renderer.STATE_ENABLED.
Forces the renderer to give up any resources (e.g. media decoders) that it may be holding. If
the renderer is not holding any resources, the call is a no-op.
This method may be called when the renderer is in the following states: Renderer.STATE_DISABLED.
Releases the renderer.
The renderer must not be used after calling this method.
Source
/*
* Copyright (C) 2016 The Android Open Source Project
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
package androidx.media3.exoplayer;
import static java.lang.annotation.ElementType.TYPE_USE;
import android.media.MediaCodec;
import android.view.Surface;
import androidx.annotation.IntDef;
import androidx.annotation.Nullable;
import androidx.media3.common.AudioAttributes;
import androidx.media3.common.AuxEffectInfo;
import androidx.media3.common.C;
import androidx.media3.common.Effect;
import androidx.media3.common.Format;
import androidx.media3.common.Player;
import androidx.media3.common.Timeline;
import androidx.media3.common.util.Clock;
import androidx.media3.common.util.Size;
import androidx.media3.common.util.UnstableApi;
import androidx.media3.common.util.Util;
import androidx.media3.exoplayer.analytics.PlayerId;
import androidx.media3.exoplayer.image.ImageOutput;
import androidx.media3.exoplayer.source.MediaPeriod;
import androidx.media3.exoplayer.source.MediaSource.MediaPeriodId;
import androidx.media3.exoplayer.source.SampleStream;
import androidx.media3.exoplayer.video.VideoDecoderOutputBufferRenderer;
import androidx.media3.exoplayer.video.VideoFrameMetadataListener;
import androidx.media3.exoplayer.video.spherical.CameraMotionListener;
import java.io.IOException;
import java.lang.annotation.Documented;
import java.lang.annotation.Retention;
import java.lang.annotation.RetentionPolicy;
import java.lang.annotation.Target;
import java.util.List;
/**
* Renders media read from a {@link SampleStream}.
*
* <p>Internally, a renderer's lifecycle is managed by the owning {@link ExoPlayer}. The renderer is
* transitioned through various states as the overall playback state and enabled tracks change. The
* valid state transitions are shown below, annotated with the methods that are called during each
* transition.
*
* <p style="align:center"><img
* src="https://developer.android.com/static/images/reference/androidx/media3/exoplayer/renderer-states.svg"
* alt="Renderer state transitions">
*
* <h2>Format support</h2>
*
* The player will select a renderer based on the {@link RendererCapabilities} returned from {@link
* #getCapabilities()}. If the capabilities indicate support for a {@link Format}, the renderer is
* expected to handle {@link SampleStream} instances containing samples of this {@link Format}.
*
* <h2>Resource management</h2>
*
* <p>Renderers should acquire resources like codecs when entering {@link #STATE_ENABLED} for the
* first time. As the renderer may transition quickly to and from {@link #STATE_DISABLED}, it is
* recommended to hold onto resources even when entering {@link #STATE_DISABLED}. The player will
* explicitly call {@link #reset()} if the renderer is no longer needed, at which point any acquired
* limited resources should be released.
*
* <h2>Configuration changes</h2>
*
* <p>As renderers are created once in the lifetime of a player, they may need to be re-configured
* later based on user settings or other environmental changes. This is generally done by handling
* {@linkplain PlayerMessage player messages} in {@link #handleMessage}. There are many predefined
* common reconfigurations in {@link MessageType}, but custom renderers can add their own handling
* as needed.
*
* <h2>Reading and rendering samples</h2>
*
* <p>The renderer receives a {@link SampleStream} to read from when {@linkplain #enable enabled}.
* When seamlessly transitioning from one item to another, the renderer may get new {@link
* SampleStream} instances via {@link #replaceStream}. Note that {@link #replaceStream} may be
* called as soon as the {@linkplain C#BUFFER_FLAG_END_OF_STREAM end-of-stream signal} has been read
* from the current {@link SampleStream} to allow reading new samples as early as possible. At this
* point, the renderer may still be processing samples from the previous stream(s). Once the current
* stream has been {@linkplain #setCurrentStreamFinal() marked as final}, no further calls to {@link
* #replaceStream} are allowed to happen without first {@link #disable disabling} the renderer
* again.
*
* <p>The player will regularly call {@link #render} to let the renderer make progress. Once the
* renderer has prepared its internal pipeline to handle continuous playback progress, it should
* report itself as {@link #isReady()}. The player will only transition the renderer to {@link
* #STATE_STARTED} if it reports itself as ready. If the renderer is blocked from making progress,
* it should return {@code false} from {@link #isReady()}, which will result in a {@link #stop()}
* operation back to {@link #STATE_ENABLED}.
*
* <p>As long as it is in {@link #STATE_STARTED}, the renderer is expected to actively output the
* data it is processing in line with the current playback position passed to {@link #render}. The
* only exception is the very first sample (for example the first video frame), that is allowed to
* be output in {@link #STATE_ENABLED} if the {@code mayRenderStartOfStream} flag was set in {@link
* #enable} or later set via {@link #enableMayRenderStartOfStream()}.
*
* <p>Once the renderer finished all processing it needs to do (that is, no further call to {@link
* #render} is needed) and the current stream is {@linkplain #isCurrentStreamFinal() final}, it
* should report itself as {@link #isEnded()}.
*
* <h2>Timestamps and offsets</h2>
*
* <p>The renderer deals with potentially multiple consecutive input streams and has to handle
* position updates and stream transitions. This means there are multiple types of timestamps and
* offsets relevant in the context of this class:
*
* <ul>
* <li><b>{@link SampleStream} timestamp</b>: The timestamp associated with each sample read from
* a {@link SampleStream}. This corresponds to the time in the {@link Timeline.Period} this
* stream belongs to. The current playback context can be obtained by using the {@link
* #setTimeline Timeline} and the {@link MediaPeriodId} provided together with each {@link
* SampleStream}.
* <li><b>Renderer timestamp</b>: The timestamp of the overall playback. This is a continuously
* increasing value across all input sample streams and what it passed to {@link #render} as
* the current {@code positionUs}.
* <li><b>Stream offset</b>: The constant offset between the current <i>{@link SampleStream}
* timestamps</i> and the <i>renderer timestamp</i>. This value is provided when setting a new
* stream in {@link #enable} or {@link #replaceStream}.
* <li><b>Stream start position</b>: The <i>renderer timestamp</i> at which the current {@link
* SampleStream} first starts playing. This value is provided when setting a new stream in
* {@link #enable} or {@link #replaceStream}. Note that it may be different from the <i>Stream
* offset</i> as streams can start at non-zero <i>{@link SampleStream} timestamps</i>.
* <li><b>Reset position</b>: The <i>Renderer timestamp</i> at which continuous playback last
* started. This is either the <i>stream start position</i> provided in {@link #enable}, or
* the position set in any subsequent {@link #resetPosition} call. Note that this value is not
* changed when playback transitions seamlessly to a new stream after calling {@link
* #replaceStream}. After any position reset, the samples read next are those needed to start
* playback at the intended <i>reset position</i>. In some cases, the renderer will encounter
* output data before the intended <i>reset position</i> (for example video frames starting
* from the previous keyframe). In these cases, the renderer should drop data internally and
* only start producing output at the intended <i>reset position</i>.
* </ul>
*/
@UnstableApi
public interface Renderer extends PlayerMessage.Target {
/**
* Default minimum duration that the playback clock must advance before {@link #render} can make
* progress.
*
* @see #getDurationToProgressUs
*/
long DEFAULT_DURATION_TO_PROGRESS_US = 10_000L;
/**
* Some renderers can signal when {@link #render(long, long)} should be called.
*
* <p>That allows the player to sleep until the next wakeup, instead of calling {@link
* #render(long, long)} in a tight loop. The aim of this interrupt based scheduling is to save
* power.
*/
interface WakeupListener {
/**
* The renderer no longer needs to render until the next wakeup.
*
* <p>Must be called from the thread ExoPlayer invokes the renderer from.
*/
void onSleep();
/**
* The renderer needs to render some frames. The client should call {@link #render(long, long)}
* at its earliest convenience.
*
* <p>Can be called from any thread.
*/
void onWakeup();
}
/**
* Represents a type of message that can be passed to a renderer. May be one of {@link
* #MSG_SET_VIDEO_OUTPUT}, {@link #MSG_SET_VOLUME}, {@link #MSG_SET_AUDIO_ATTRIBUTES}, {@link
* #MSG_SET_SCALING_MODE}, {@link #MSG_SET_CHANGE_FRAME_RATE_STRATEGY}, {@link
* #MSG_SET_AUX_EFFECT_INFO}, {@link #MSG_SET_VIDEO_FRAME_METADATA_LISTENER}, {@link
* #MSG_SET_CAMERA_MOTION_LISTENER}, {@link #MSG_SET_SKIP_SILENCE_ENABLED}, {@link
* #MSG_SET_AUDIO_SESSION_ID}, {@link #MSG_SET_WAKEUP_LISTENER}, {@link #MSG_SET_VIDEO_EFFECTS},
* {@link #MSG_SET_VIDEO_OUTPUT_RESOLUTION} or {@link #MSG_SET_IMAGE_OUTPUT}. May also be an
* app-defined value (see {@link #MSG_CUSTOM_BASE}).
*/
@Documented
@Retention(RetentionPolicy.SOURCE)
@Target(TYPE_USE)
@IntDef(
open = true,
value = {
MSG_SET_VIDEO_OUTPUT,
MSG_SET_VOLUME,
MSG_SET_AUDIO_ATTRIBUTES,
MSG_SET_SCALING_MODE,
MSG_SET_CHANGE_FRAME_RATE_STRATEGY,
MSG_SET_AUX_EFFECT_INFO,
MSG_SET_VIDEO_FRAME_METADATA_LISTENER,
MSG_SET_CAMERA_MOTION_LISTENER,
MSG_SET_SKIP_SILENCE_ENABLED,
MSG_SET_AUDIO_SESSION_ID,
MSG_SET_WAKEUP_LISTENER,
MSG_SET_VIDEO_EFFECTS,
MSG_SET_VIDEO_OUTPUT_RESOLUTION,
MSG_SET_IMAGE_OUTPUT,
MSG_SET_PRIORITY
})
public @interface MessageType {}
/**
* The type of a message that can be passed to a video renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload is normally a {@link
* Surface}, however some video renderers may accept other outputs (e.g., {@link
* VideoDecoderOutputBufferRenderer}).
*
* <p>If the receiving renderer does not support the payload type as an output, then it will clear
* any existing output that it has.
*/
int MSG_SET_VIDEO_OUTPUT = 1;
/**
* A type of a message that can be passed to an audio renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be a {@link Float}
* with 0 being silence and 1 being unity gain.
*/
int MSG_SET_VOLUME = 2;
/**
* A type of a message that can be passed to an audio renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be an {@link
* AudioAttributes} instance that will configure the underlying audio track. If not set, the
* default audio attributes will be used. They are suitable for general media playback.
*
* <p>Setting the audio attributes during playback may introduce a short gap in audio output as
* the audio track is recreated. A new audio session id will also be generated.
*
* <p>If tunneling is enabled by the track selector, the specified audio attributes will be
* ignored, but they will take effect if audio is later played without tunneling.
*
* <p>If the device is running a build before platform API version 21, audio attributes cannot be
* set directly on the underlying audio track. In this case, the usage will be mapped onto an
* equivalent stream type using {@link Util#getStreamTypeForAudioUsage(int)}.
*
* <p>To get audio attributes that are equivalent to a legacy stream type, pass the stream type to
* {@link Util#getAudioUsageForStreamType(int)} and use the returned {@link C.AudioUsage} to build
* an audio attributes instance.
*/
int MSG_SET_AUDIO_ATTRIBUTES = 3;
/**
* The type of a message that can be passed to a {@link MediaCodec}-based video renderer via
* {@link ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be one of the
* integer scaling modes in {@link C.VideoScalingMode}.
*
* <p>Note that the scaling mode only applies if the {@link Surface} targeted by the renderer is
* owned by a {@link android.view.SurfaceView}.
*/
int MSG_SET_SCALING_MODE = 4;
/**
* The type of a message that can be passed to a video renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be one of the
* integer strategy constants in {@link C.VideoChangeFrameRateStrategy}.
*/
int MSG_SET_CHANGE_FRAME_RATE_STRATEGY = 5;
/**
* A type of a message that can be passed to an audio renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be an {@link
* AuxEffectInfo} instance representing an auxiliary audio effect for the underlying audio track.
*/
int MSG_SET_AUX_EFFECT_INFO = 6;
/**
* The type of a message that can be passed to a video renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be a {@link
* VideoFrameMetadataListener} instance, or null.
*/
int MSG_SET_VIDEO_FRAME_METADATA_LISTENER = 7;
/**
* The type of a message that can be passed to a camera motion renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be a {@link
* CameraMotionListener} instance, or null.
*/
int MSG_SET_CAMERA_MOTION_LISTENER = 8;
/**
* The type of a message that can be passed to an audio renderer via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be a {@link Boolean}
* instance telling whether to enable or disable skipping silences in the audio stream.
*/
int MSG_SET_SKIP_SILENCE_ENABLED = 9;
/**
* The type of a message that can be passed to audio and video renderers via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be an {@link
* Integer} instance representing the audio session ID that will be attached to the underlying
* audio track. Video renderers that support tunneling will use the audio session ID when
* tunneling is enabled.
*/
int MSG_SET_AUDIO_SESSION_ID = 10;
/**
* The type of a message that can be passed to a {@link Renderer} via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}, to inform the renderer that it can schedule
* waking up another component.
*
* <p>The message payload must be a {@link WakeupListener} instance.
*/
int MSG_SET_WAKEUP_LISTENER = 11;
/**
* The type of a message that can be passed to audio renderers via {@link
* ExoPlayer#createMessage(PlayerMessage.Target)}. The message payload should be an {@link
* android.media.AudioDeviceInfo} instance representing the preferred audio device, or null to
* restore the default.
*/
int MSG_SET_PREFERRED_AUDIO_DEVICE = 12;
/**
* The type of a message that can be passed to a video renderer. The message payload should be a
* {@link List} containing {@linkplain Effect video effects}.
*/
int MSG_SET_VIDEO_EFFECTS = 13;
/**
* The type of a message that can be passed to a video renderer to set the desired output
* resolution. The message payload should be a {@link Size} of the desired output width and
* height. Use this method only when playing with video {@linkplain Effect effects}.
*/
int MSG_SET_VIDEO_OUTPUT_RESOLUTION = 14;
/**
* The type of message that can be passed to an image renderer to set a desired image output. The
* message payload should be an {@link ImageOutput}, or null to clear a previously set image
* output.
*/
int MSG_SET_IMAGE_OUTPUT = 15;
/**
* The type of message that can be passed to a renderer to set its priority. The message payload
* should be an {@link Integer} instance for the priority of the renderer. See {@code C.PRIORITY_}
* constants for predefined values.
*/
int MSG_SET_PRIORITY = 16;
/**
* Applications or extensions may define custom {@code MSG_*} constants that can be passed to
* renderers. These custom constants must be greater than or equal to this value.
*/
int MSG_CUSTOM_BASE = 10000;
/**
* The renderer states. One of {@link #STATE_DISABLED}, {@link #STATE_ENABLED} or {@link
* #STATE_STARTED}.
*/
@Documented
@Retention(RetentionPolicy.SOURCE)
@Target(TYPE_USE)
@IntDef({STATE_DISABLED, STATE_ENABLED, STATE_STARTED})
@interface State {}
/**
* The renderer is disabled. A renderer in this state will not proactively acquire resources that
* it requires for rendering (e.g., media decoders), but may continue to hold any that it already
* has. {@link #reset()} can be called to force the renderer to release such resources.
*/
int STATE_DISABLED = 0;
/**
* The renderer is enabled but not started. A renderer in this state may render media at the
* current position (e.g. an initial video frame), but the position will not advance. A renderer
* in this state will typically hold resources that it requires for rendering (e.g. media
* decoders).
*/
int STATE_ENABLED = 1;
/**
* The renderer is started. Calls to {@link #render(long, long)} will cause media to be rendered.
*/
int STATE_STARTED = 2;
/**
* Returns the name of this renderer, for logging and debugging purposes. Should typically be the
* renderer's (un-obfuscated) class name.
*
* @return The name of this renderer.
*/
String getName();
/**
* Returns the track type that the renderer handles.
*
* @see ExoPlayer#getRendererType(int)
* @return The {@link C.TrackType track type}.
*/
@C.TrackType
int getTrackType();
/**
* Returns the capabilities of the renderer.
*
* @return The capabilities of the renderer.
*/
RendererCapabilities getCapabilities();
/**
* Initializes the renderer for playback with a player.
*
* @param index The renderer index within the player.
* @param playerId The {@link PlayerId} of the player.
* @param clock The {@link Clock}.
*/
void init(int index, PlayerId playerId, Clock clock);
/**
* If the renderer advances its own playback position then this method returns a corresponding
* {@link MediaClock}. If provided, the player will use the returned {@link MediaClock} as its
* source of time during playback. A player may have at most one renderer that returns a {@link
* MediaClock} from this method.
*
* @return The {@link MediaClock} tracking the playback position of the renderer, or null.
*/
@Nullable
MediaClock getMediaClock();
/**
* Returns the current state of the renderer.
*
* @return The current state. One of {@link #STATE_DISABLED}, {@link #STATE_ENABLED} and {@link
* #STATE_STARTED}.
*/
@State
int getState();
/**
* Enables the renderer to consume from the specified {@link SampleStream}.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_DISABLED}.
*
* @param configuration The renderer configuration.
* @param formats The enabled formats.
* @param stream The {@link SampleStream} from which the renderer should consume.
* @param positionUs The player's current position.
* @param joining Whether this renderer is being enabled to join an ongoing playback.
* @param mayRenderStartOfStream Whether this renderer is allowed to render the start of the
* stream even if the state is not {@link #STATE_STARTED} yet.
* @param startPositionUs The start position of the stream in renderer time (microseconds).
* @param offsetUs The offset to be added to timestamps of buffers read from {@code stream} before
* they are rendered.
* @param mediaPeriodId The {@link MediaPeriodId} of the {@link MediaPeriod} producing the {@code
* stream}.
* @throws ExoPlaybackException If an error occurs.
*/
void enable(
RendererConfiguration configuration,
Format[] formats,
SampleStream stream,
long positionUs,
boolean joining,
boolean mayRenderStartOfStream,
long startPositionUs,
long offsetUs,
MediaPeriodId mediaPeriodId)
throws ExoPlaybackException;
/**
* Starts the renderer, meaning that calls to {@link #render(long, long)} will cause media to be
* rendered.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}.
*
* @throws ExoPlaybackException If an error occurs.
*/
void start() throws ExoPlaybackException;
/**
* Replaces the {@link SampleStream} from which samples will be consumed.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*
* @param formats The enabled formats.
* @param stream The {@link SampleStream} from which the renderer should consume.
* @param startPositionUs The start position of the new stream in renderer time (microseconds).
* @param offsetUs The offset to be added to timestamps of buffers read from {@code stream} before
* they are rendered.
* @param mediaPeriodId The {@link MediaPeriodId} of the {@link MediaPeriod} producing the {@code
* stream}.
* @throws ExoPlaybackException If an error occurs.
*/
void replaceStream(
Format[] formats,
SampleStream stream,
long startPositionUs,
long offsetUs,
MediaPeriodId mediaPeriodId)
throws ExoPlaybackException;
/** Returns the {@link SampleStream} being consumed, or null if the renderer is disabled. */
@Nullable
SampleStream getStream();
/**
* Returns whether the renderer has read the current {@link SampleStream} to the end.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*/
boolean hasReadStreamToEnd();
/**
* Returns the renderer time up to which the renderer has read samples, in microseconds, or {@link
* C#TIME_END_OF_SOURCE} if the renderer has read the current {@link SampleStream} to the end.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*/
long getReadingPositionUs();
/**
* Returns minimum amount of playback clock time that must pass in order for the {@link #render}
* call to make progress.
*
* <p>The default return time is {@link #DEFAULT_DURATION_TO_PROGRESS_US}.
*
* @param positionUs The current render position in microseconds, measured at the start of the
* current iteration of the rendering loop.
* @param elapsedRealtimeUs {@link android.os.SystemClock#elapsedRealtime()} in microseconds,
* measured at the start of the current iteration of the rendering loop.
* @return Minimum amount of playback clock time that must pass before renderer is able to make
* progress.
*/
default long getDurationToProgressUs(long positionUs, long elapsedRealtimeUs) {
return DEFAULT_DURATION_TO_PROGRESS_US;
}
/**
* Signals to the renderer that the current {@link SampleStream} will be the final one supplied
* before it is next disabled or reset.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*/
void setCurrentStreamFinal();
/**
* Returns whether the current {@link SampleStream} will be the final one supplied before the
* renderer is next disabled or reset.
*/
boolean isCurrentStreamFinal();
/**
* Throws an error that's preventing the renderer from reading from its {@link SampleStream}. Does
* nothing if no such error exists.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*
* @throws IOException An error that's preventing the renderer from making progress or buffering
* more data.
*/
void maybeThrowStreamError() throws IOException;
/**
* Signals to the renderer that a position discontinuity has occurred.
*
* <p>After a position discontinuity, the renderer's {@link SampleStream} is guaranteed to provide
* samples starting from a key frame.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*
* @param positionUs The new playback position in microseconds.
* @throws ExoPlaybackException If an error occurs handling the reset.
*/
void resetPosition(long positionUs) throws ExoPlaybackException;
/**
* Indicates the playback speed to this renderer.
*
* <p>The default implementation is a no-op.
*
* @param currentPlaybackSpeed The factor by which playback is currently sped up.
* @param targetPlaybackSpeed The target factor by which playback should be sped up. This may be
* different from {@code currentPlaybackSpeed}, for example, if the speed is temporarily
* adjusted for live playback.
* @throws ExoPlaybackException If an error occurs handling the playback speed.
*/
default void setPlaybackSpeed(float currentPlaybackSpeed, float targetPlaybackSpeed)
throws ExoPlaybackException {}
/**
* Enables this renderer to render the start of the stream even if the state is not {@link
* #STATE_STARTED} yet.
*
* <p>This is used to update the value of {@code mayRenderStartOfStream} passed to {@link
* #enable}.
*/
default void enableMayRenderStartOfStream() {}
/** Sets the timeline that is currently being played. */
void setTimeline(Timeline timeline);
/**
* Incrementally renders the {@link SampleStream}.
*
* <p>If the renderer is in the {@link #STATE_ENABLED} state then each call to this method will do
* work toward being ready to render the {@link SampleStream} when the renderer is started. If the
* renderer is in the {@link #STATE_STARTED} state then calls to this method will render the
* {@link SampleStream} in sync with the specified media positions.
*
* <p>The renderer may also render the very start of the media at the current position (e.g. the
* first frame of a video stream) while still in the {@link #STATE_ENABLED} state, unless it's the
* initial start of the media after calling {@link #enable(RendererConfiguration, Format[],
* SampleStream, long, boolean, boolean, long, long, MediaPeriodId)} with {@code
* mayRenderStartOfStream} set to {@code false}.
*
* <p>This method should return quickly, and should not block if the renderer is unable to make
* useful progress.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*
* @param positionUs The current media time in microseconds, measured at the start of the current
* iteration of the rendering loop.
* @param elapsedRealtimeUs {@link android.os.SystemClock#elapsedRealtime()} in microseconds,
* measured at the start of the current iteration of the rendering loop.
* @throws ExoPlaybackException If an error occurs.
*/
void render(long positionUs, long elapsedRealtimeUs) throws ExoPlaybackException;
/**
* Whether the renderer is able to immediately render media from the current position.
*
* <p>If the renderer is in the {@link #STATE_STARTED} state then returning true indicates that
* the renderer has everything that it needs to continue playback. Returning false indicates that
* the player should pause until the renderer is ready.
*
* <p>If the renderer is in the {@link #STATE_ENABLED} state then returning true indicates that
* the renderer is ready for playback to be started. Returning false indicates that it is not.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*
* @return Whether the renderer is ready to render media.
*/
boolean isReady();
/**
* Whether the renderer is ready for the {@link ExoPlayer} instance to transition to {@link
* Player#STATE_ENDED}. The player will make this transition as soon as {@code true} is returned
* by all of its renderers.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}, {@link #STATE_STARTED}.
*
* @return Whether the renderer is ready for the player to transition to the ended state.
*/
boolean isEnded();
/**
* Stops the renderer, transitioning it to the {@link #STATE_ENABLED} state.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_STARTED}.
*/
void stop();
/**
* Disable the renderer, transitioning it to the {@link #STATE_DISABLED} state.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_ENABLED}.
*/
void disable();
/**
* Forces the renderer to give up any resources (e.g. media decoders) that it may be holding. If
* the renderer is not holding any resources, the call is a no-op.
*
* <p>This method may be called when the renderer is in the following states: {@link
* #STATE_DISABLED}.
*/
void reset();
/**
* Releases the renderer.
*
* <p>The renderer must not be used after calling this method.
*/
default void release() {}
}