HLS discontinuity support #1335

joeyparrish · 2018-03-05T18:59:18Z

We need to add support for EXT-X-DISCONTINUITY and EXT-X-DISCONTINUITY-SEQUENCE to improve support for server-side ad insertion.

https://tools.ietf.org/html/draft-pantos-http-live-streaming-20#section-4.3.2.3
https://tools.ietf.org/html/draft-pantos-http-live-streaming-20#section-4.3.3.3

sandersaares · 2018-03-06T06:53:54Z

What would be your expectations to HLS content that has a server-side ad inserted that has a different set of tracks than the main content. For example, main content has 3 audio languages and 5 video quality levels, whereas ad might have just one video and one audio track. How would such content need to be structured for Shaka to consume it without issues? How should the change in tracks be signaled at discontinuity time?

joeyparrish · 2018-03-06T20:02:57Z

Since discontinuities happen inside the media playlist, I expect that the ad segments would need to be the same across media playlists. Any matching of N content streams to M ad streams would have to be done server-side.

The same thing in DASH is more complex, because the matching on N content streams in one period to M ad streams in the next period would have to be done client-side.

Here's an example using your scenario, where there is only one ad resolution and language, but multiple video resolutions and audio languages for the main content:

# Media playlist, 720p video
#EXTINF:2
v-720-500.mp4
#EXTINF:2
v-720-501.mp4

#EXT-X-DISCONTINUITY
#EXTINF:7
v-ad-1.mp4
#EXTINF:7
v-ad-2.mp4
#EXTINF:7
v-ad-3.mp4

#EXT-X-DISCONTINUITY
#EXTINF:2
v-720-502.mp4
#EXTINF:2
v-720-503.mp4

# Media playlist, 480p video
#EXTINF:2
v-480-500.mp4
#EXTINF:2
v-480-501.mp4

#EXT-X-DISCONTINUITY
#EXTINF:7
v-ad-1.mp4
#EXTINF:7
v-ad-2.mp4
#EXTINF:7
v-ad-3.mp4

#EXT-X-DISCONTINUITY
#EXTINF:2
v-480-502.mp4
#EXTINF:2
v-480-503.mp4

# Media playlist, English audio
#EXTINF:2
a-en-500.mp4
#EXTINF:2
a-en-501.mp4

#EXT-X-DISCONTINUITY
#EXTINF:7
a-ad-1.mp4
#EXTINF:7
a-ad-2.mp4
#EXTINF:7
a-ad-3.mp4

#EXT-X-DISCONTINUITY
#EXTINF:2
a-en-502.mp4
#EXTINF:2
a-en-503.mp4

# Media playlist, French audio
#EXTINF:2
a-fr-500.mp4
#EXTINF:2
a-fr-501.mp4

#EXT-X-DISCONTINUITY
#EXTINF:7
a-ad-1.mp4
#EXTINF:7
a-ad-2.mp4
#EXTINF:7
a-ad-3.mp4

#EXT-X-DISCONTINUITY
#EXTINF:2
a-fr-502.mp4
#EXTINF:2
a-fr-503.mp4

damienlevin · 2018-11-07T14:04:16Z

@joeyparrish Quick note, for fMP4 you also want to add support for multiple EXT-X-MAP. In the case of ad insertion the encoding setting as well as the timestamp/timescale of the ad and content is likely not going to match (which is why you have a discontinuity in the first place). So you will need to reinitialize the decoder setting by loading the initialization segment present in the EXT-X-MAP following any DISCONTINUITY. A fmp4/cmaf style playlist should look like this:

#EXT-X-MAP:URI="content-init.mp4"
#EXTINF:2
content-1.mp4
#EXTINF:2
content-2.mp4
#EXT-X-DISCONTINUITY
#EXT-X-MAP:URI="ad-init.mp4"
#EXTINF:2
ad-1.mp4
#EXTINF:2
ad-2.mp4
#EXTINF:7
ad-3.mp4
#EXT-X-DISCONTINUITY
#EXT-X-MAP:URI="content-init.mp4"
#EXTINF:2
content-3.mp4
#EXTINF:2
content-4.mp4

joeyparrish · 2018-11-12T05:32:11Z

@damienlevin, thanks! We will make sure not to miss that.

SVyatoslavG · 2019-08-15T20:11:05Z

This issue is still valid.
I am using #EXT-X-DISCONTINUITY tags to insert ads in .m3u8 manifest in the server. This provides a great user experience for the user watching videos (avoids flickering with ads overlays, delayed starts, etc). Would be really great to this feature in the next release!

joeyparrish · 2019-08-16T18:34:39Z

This feature will not make it into v2.6, but work in v2.6 will unblock the development of discontinuities, which could appear in v2.7+. It will be a priority once we begin that cycle, but I can't guarantee specifically v2.7. If some other major feature is completed first, then that would be the defining feature of v2.7, and discontinuity support might be completed in v2.8.

You can see our rough plans on our roadmap doc: https://github.com/google/shaka-player/blob/master/roadmap.md

MilosRasic · 2019-09-02T17:16:51Z

@joeyparrish is this something community contributors could help with and if it is, is there some "prior art" you could share?

joeyparrish · 2019-09-02T17:25:00Z

Potentially, but we're still working on the refactoring that will allow this feature to be implemented. Flattening DASH periods so that each track is a single list of segment references will allow us to finally add discontinuities for HLS.

Sorry this has taken so long!

jamescahall · 2019-12-12T18:06:02Z

Any update on this? This support is pretty critical not only for SSAI for linear streams but also for m3u8 manifests where multiple videos have been stitched together (such as for adding branding bumper videos dynamically). Currently, as soon as a discontinuity tag is hit, playback stops and the player gets confused about duration and position.

theodab · 2019-12-16T23:36:35Z

Period flattening is still a work in progress; see #1339.

michellezhuogg · 2020-02-12T22:56:27Z

Hello @jamescahall @MilosRasic @SVyatoslavG ,
Do you have any example manifests to share with us, so that we can work on implementing and testing? Thank you!

jamescahall · 2020-02-13T00:01:53Z

Potentially but not posted here

michellezhuogg · 2020-02-13T00:05:41Z

@jamescahall ,
Could you please send the URIs to [email protected] if possible? Thank you!

MilosRasic · 2020-02-13T00:30:02Z

This might change over time so you can always get our latest data with

curl 'https://www.redbox.com/gapi/ondemand/hcgraphql' -H 'Accept-Encoding: gzip, deflate, br' -H 'Content-Type: application/json' -H 'Accept: application/json' -H 'Connection: keep-alive' -H 'DNT: 1' -H 'Origin: https://www.redbox.com' --data-binary '{"query":"\tquery avod($id: ID!, $pageNumber: Int!, $pageSize: Int!) {\n\t\treelCollection(id: $id) {\n\t\t\tcollectionId\n\t\t\tname\n\t\t\ttype\n\t\t\treels {\n\t\t\t\tid\n\t\t\t\tname\n\t\t\t\titems (paging: { number: $pageNumber, size: $pageSize }) {\n\t\t\t\t\t... on LiveTvReelItem {\n\t\t\t\t\t\tid\n\t\t\t\t\t\tname\n\t\t\t\t\t\ttype\n\t\t\t\t\t\tsource\n\t\t\t\t\t\tdescription\n\t\t\t\t\t\turl\n\t\t\t\t\t\tgenres\n\t\t\t\t\t\timages\n\t\t\t\t\t\t{\n\t\t\t\t\t\t\tmono\n\t\t\t\t\t\t\tstylized\n\t\t\t\t\t\t}\n\t\t\t\t\t\tonNow\n\t\t\t\t\t\t{\n\t\t\t\t\t\t\tid\n\t\t\t\t\t\t\ttitle\n\t\t\t\t\t\t\tepisodeTitle\n\t\t\t\t\t\t\tcontentType\n\t\t\t\t\t\t\tdescription\n\t\t\t\t\t\t\tstartTime\n\t\t\t\t\t\t\tendTime\n\t\t\t\t\t\t\tcontentType\n\t\t\t\t\t\t\tgenres\n\t\t\t\t\t\t\trating\n\t\t\t\t\t\t}\n\t\t\t\t\t\tonNext\n\t\t\t\t\t\t{\n\t\t\t\t\t\t\tid\n\t\t\t\t\t\t\ttitle\n\t\t\t\t\t\t\tepisodeTitle\n\t\t\t\t\t\t\tcontentType\n\t\t\t\t\t\t\tdescription\n\t\t\t\t\t\t\tstartTime\n\t\t\t\t\t\t\tendTime\n\t\t\t\t\t\t\tcontentType\n\t\t\t\t\t\t\tgenres\n\t\t\t\t\t\t\trating\n\t\t\t\t\t\t}\n\t\t\t\t\t}\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\t}","variables":{"id":"livetv-collection-id","pageNumber":1,"pageSize":50}}' --compressed

TimestampOffset will be used as a paramater to create the segment references with discontinuity tags. Issue #1335 Change-Id: If7dfb63766c2397256561e6668e98f9136f885b5

One playlist may contain multiple EXT-X-MAP tags, and each EXT-X-MAP tag represents the initalization information for the segments after it, until the next EXT-X-MAP tag or the end of the playlist. Issue #1335 Closes #2397 Change-Id: Ibb0b4f5da6a48f0303d205cb6bd3abad278527fd

joeyparrish added type: enhancement New feature or request component: HLS The issue involves Apple's HLS manifest format labels Mar 5, 2018

joeyparrish added this to the v2.5 milestone Mar 5, 2018

joeyparrish mentioned this issue Mar 6, 2018

Flatten periods and SegmentTemplate internally #1339

Closed

joeyparrish modified the milestones: v2.5, Backlog Jul 9, 2018

joeyparrish modified the milestones: Backlog, Backlog 2 Jan 28, 2020

avelad mentioned this issue Feb 10, 2020

Add initial DAI support #2382

Merged

TheModMaker mentioned this issue Feb 14, 2020

HLS - support manifest with several #EXT-X-MAP tags #2397

Closed

shaka-bot closed this as completed in 734d129 Apr 9, 2020

joeyparrish modified the milestones: Backlog, v2.6 Apr 13, 2020

michellezhuogg self-assigned this May 21, 2020

shaka-bot added the archived label Jun 8, 2020

shaka-project locked and limited conversation to collaborators Jun 8, 2020

shaka-bot added the status: archived Archived and locked; will not be updated label Apr 15, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HLS discontinuity support #1335

HLS discontinuity support #1335

joeyparrish commented Mar 5, 2018

sandersaares commented Mar 6, 2018 •

edited

Loading

joeyparrish commented Mar 6, 2018 •

edited

Loading

damienlevin commented Nov 7, 2018 •

edited

Loading

joeyparrish commented Nov 12, 2018

SVyatoslavG commented Aug 15, 2019

joeyparrish commented Aug 16, 2019

MilosRasic commented Sep 2, 2019

joeyparrish commented Sep 2, 2019

jamescahall commented Dec 12, 2019

theodab commented Dec 16, 2019

michellezhuogg commented Feb 12, 2020

jamescahall commented Feb 13, 2020

michellezhuogg commented Feb 13, 2020

MilosRasic commented Feb 13, 2020

HLS discontinuity support #1335

HLS discontinuity support #1335

Comments

joeyparrish commented Mar 5, 2018

sandersaares commented Mar 6, 2018 • edited Loading

joeyparrish commented Mar 6, 2018 • edited Loading

damienlevin commented Nov 7, 2018 • edited Loading

joeyparrish commented Nov 12, 2018

SVyatoslavG commented Aug 15, 2019

joeyparrish commented Aug 16, 2019

MilosRasic commented Sep 2, 2019

joeyparrish commented Sep 2, 2019

jamescahall commented Dec 12, 2019

theodab commented Dec 16, 2019

michellezhuogg commented Feb 12, 2020

jamescahall commented Feb 13, 2020

michellezhuogg commented Feb 13, 2020

MilosRasic commented Feb 13, 2020

sandersaares commented Mar 6, 2018 •

edited

Loading

joeyparrish commented Mar 6, 2018 •

edited

Loading

damienlevin commented Nov 7, 2018 •

edited

Loading