Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement] Adding the new hlsManifest #3318

Open
llsc12 opened this issue Sep 17, 2022 · 3 comments · May be fixed by #4118
Open

[Enhancement] Adding the new hlsManifest #3318

llsc12 opened this issue Sep 17, 2022 · 3 comments · May be fixed by #4118
Labels
enhancement Improvement of an existing feature

Comments

@llsc12
Copy link
Contributor

llsc12 commented Sep 17, 2022

A friend of mine discovered that the iOS player api returns links to m3u8 files to stream media.
It apparently contains 1080p+ formats compatible with iOS's AVPlayer (unverified atm)

Tested with this live stream

Example Request POST /youtubei/v1/player?key=AIzaSyAO_FJ2SlqU8Q4STEHLGCilw_Y9_11qcW8&prettyPrint=false HTTP/1.1 Cookie: CONSENT=YES+ Content-Type: text/plain; charset=utf-8 Host: www.youtube.com Connection: close Content-Length: 384

{
"context": {
"client": {
"hl": "en",
"gl": "GB",
"clientName": "IOS",
"clientVersion": "16.20",
"playbackContext": {
"contentPlaybackContext": {
"signatureTimestamp": "sts",
"html5Preference": "HTML5_PREF_WANTS"
}
}
}
},
"contentCheckOk": true,
"racyCheckOk": true,
"videoId": "jfKfPfyJRdk"
}

Example Response (partial) { "streamingData": {"expiresInSeconds":"21540","hlsManifestUrl":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_variant\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/source\/yt_live_broadcast\/requiressl\/yes\/tx\/24201799\/txs\/24200493%2C24200494%2C24200495%2C24201799%2C24201800\/playlist_duration\/3600\/manifest_duration\/3600\/demuxed\/1\/maudio\/1\/vprv\/1\/go\/1\/pacing\/0\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/dover\/11\/itag\/0\/playlist_type\/DVR\/sparams\/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Ctx%2Ctxs%2Cplaylist_duration%2Cmanifest_duration%2Cdemuxed%2Cmaudio%2Cvprv%2Cgo%2Citag%2Cplaylist_type\/sig\/AOq0QJ8wRgIhANcNUrSHVWn2jML8JAAW_RWwFI_glfX0uLRMULfhsTX3AiEA0GNP9UfQ7KAQwGAhaoaSapAD2O1qaoczuJVamlsAYM4%3D\/file\/index.m3u8","hlsFormats":[{"itag":229,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/229\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/sgovp\/gir%3Dyes%3Bitag%3D133\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Csgovp%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRQIgSoFA-ghBg6zM6xkso_gbnCnMOd6i9qLdO9fDFOMTyIkCIQDhD-Ha1W0gSRfo_E74Ggn9ZFlFIykjiYlM-AMCwDbKvQ%3D%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRQIgR47QFiNCDxW56rlWkOaDamLOptxMimr1nAzSCYhCDeMCIQDJRiQhzeno_GUTKtUkqsc-D1HSy-1u8y0Qs7QcxFEbiw%3D%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"avc1.4d4015\"","bitrate":479039,"width":426,"height":240,"lastModified":"1663375357827017","quality":"small","fps":30,"qualityLabel":"240p","projectionType":"RECTANGULAR"},{"itag":230,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/230\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/sgovp\/gir%3Dyes%3Bitag%3D134\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Csgovp%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRgIhAOeFFY2M_FUAju5atL1G6IHaTQBkOZqyRE4AO3TXJnOzAiEAmTOe0CCWTKmA83kV-STiv9joxX0AX2M-Fi6fj0QwxSo%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRAIgRbBLIN12lu4iHgH5dIeUZIMTDKfsmN9rNudpygnjBtoCIG4pLzCGWCuNanFC3rEQBblnKAdahRTclxdGz5PJXlVQ\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"avc1.4d401e\"","bitrate":1058662,"width":640,"height":360,"lastModified":"1663375357827018","quality":"medium","fps":30,"qualityLabel":"360p","projectionType":"RECTANGULAR","highReplication":true},{"itag":231,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/231\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/sgovp\/gir%3Dyes%3Bitag%3D135\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Csgovp%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRQIgTqu-phPZEsl7-UOeNQGS3NfWU1uZEtxt945F2Hm-OOMCIQDXmLLvDpLsaHRAyV2XJgMtuoxKQ7OEfqtbfD2FTeO8Yg%3D%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRQIhAKNF6KHhz6WJ_hz-fhTiPx_d7f6pU1TB7gIagftgGtScAiBw0EQb2qwj0d-3iKynlKcNypxOg3yZhqrfAOGLrbKl8A%3D%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"avc1.4d401f\"","bitrate":1417526,"width":854,"height":480,"lastModified":"1663375357827019","quality":"large","fps":30,"qualityLabel":"480p","projectionType":"RECTANGULAR"},{"itag":232,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/232\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/sgovp\/gir%3Dyes%3Bitag%3D136\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Csgovp%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRgIhAMA0lcueS65k2B7wZ6ey0ITauFmnTpKmuX747YfpEFAwAiEAjuDP0UL5wS-PPH45An1zxliUUAEYlUVMUaO-inV2u-o%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRQIgEV3XzWdCuJ0S6zZrDlMFBqF7qVEAnXbEOq72dbj_7uICIQC3fZ-ZQzX9zs4hdi1_8JGN67Yba2_iVCYV1csDpyCMAQ%3D%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"avc1.4d401f\"","bitrate":2818252,"width":1280,"height":720,"lastModified":"1663375357827020","quality":"hd720","fps":30,"qualityLabel":"720p","projectionType":"RECTANGULAR"},{"itag":270,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/270\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/sgovp\/gir%3Dyes%3Bitag%3D137\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Csgovp%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRgIhAKoMlRkFbYtOSLP3XdfS1g5R8cZCEbSH1nT1EpilEnXFAiEAkCpVa7C_OdykNrqwWtCKqUMegH_MsDVadFI8gPVRlM0%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRQIgSe1IZn50l3iw6ObDY05V-LZLXHeG0AOlvZZ5SMIXWQUCIQCBVVcDCu8_okNth_zydWDm-5HrlhPSfJbO8uW_nHzcfQ%3D%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"avc1.640028\"","bitrate":5269522,"width":1920,"height":1080,"lastModified":"1663375357827021","quality":"hd1080","fps":30,"qualityLabel":"1080p","projectionType":"RECTANGULAR"},{"itag":233,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/233\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/goi\/133\/sgoap\/gir%3Dyes%3Bitag%3D139\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Cgoi%2Csgoap%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRgIhAMH8MZSm6MaBlYigyW5rkCwyVtmxrAQjxG04SHJ9HlYmAiEAxdoK_1Ttm3mFhGaADKriXiw6xNmRm41BOentFfIMloY%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRQIhAMYExaqousa7juWX75coElQLJEI_fDYmAJL44EGcYjyuAiBkwPf6_UMzqO8LjK114ByCZeC0P8riXOGNfX89Rs6_nw%3D%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"mp4a.40.5\"","bitrate":64000,"lastModified":"1663375357827022","quality":"tiny","projectionType":"RECTANGULAR","audioQuality":"AUDIO_QUALITY_LOW","audioChannels":2},{"itag":234,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/234\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/goi\/133\/sgoap\/gir%3Dyes%3Bitag%3D140\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Cgoi%2Csgoap%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRAIgXjpVpAapkuUyeKj-d2RTmpzaBawJsAv4nzsCBhS8Fo0CIDXEzXxqIL8aYJp9fc-T7VDx9rQtosJcSVPK-HLPi4a9\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRgIhAOGq5MeNeTYsiLUSl4btGLTnRK8yLOYjl_hT9WYfGfDQAiEApLM7t2UkT3v0_3lUSdqz00ZdpLWH2HRG6XvxngmFVzE%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"mp4a.40.2\"","bitrate":144000,"lastModified":"1663375357827023","quality":"tiny","projectionType":"RECTANGULAR","highReplication":true,"audioQuality":"AUDIO_QUALITY_MEDIUM","audioChannels":2},{"itag":269,"url":"https:\/\/manifest.googlevideo.com\/api\/manifest\/hls_playlist\/expire\/1663445741\/ei\/jdYlY_XPCbTw1wa8vIvQAw\/ip\/e\/id\/jfKfPfyJRdk.1\/itag\/269\/source\/yt_live_broadcast\/requiressl\/yes\/ratebypass\/yes\/live\/1\/sgovp\/gir%3Dyes%3Bitag%3D160\/playback_host\/rr2---sn-uigxx03-ciml.googlevideo.com\/mh\/rr\/mm\/44%2C29\/mn\/sn-uigxx03-ciml%2Csn-aigzrnsl\/ms\/lva%2Crdu\/mv\/m\/mvi\/2\/pl\/23\/playlist_duration\/3600\/manifest_duration\/3600\/initcwndbps\/627500\/vprv\/1\/playlist_type\/DVR\/dover\/11\/pacing\/0\/mt\/1663423717\/fvip\/1\/nvgoi\/1\/short_key\/1\/keepalive\/yes\/fexp\/24001373%2C24007246\/sparams\/expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cratebypass%2Clive%2Csgovp%2Cplaylist_duration%2Cmanifest_duration%2Cvprv%2Cplaylist_type\/sig\/AOq0QJ8wRQIhAM_KrSODMbBXZhT7l0KtP5Gq_pde21fV5-9UHYAVAFA1AiBmEnv5Reh0_oMBWRorAb9N7M8gcQo0wSHsO1jddOqFXA%3D%3D\/lsparams\/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps\/lsig\/AG3C_xAwRgIhANpXbLLwuYvetkLQ7fVCYWph_SocrUNG5Dwumfi7rnAIAiEA3MRyKp76YKKelwVji8se5Ucjbrw0ettA5FIx9cob8Wk%3D\/playlist\/index.m3u8","mimeType":"application\/x-mpegURL; codecs=\"avc1.42c00b\"","bitrate":223088,"width":256,"height":144,"lastModified":"1663375357827025","quality":"tiny","fps":15,"qualityLabel":"144p","projectionType":"RECTANGULAR"}],"aspectRatio":1.7777778} }

streamingData.hlsManifest is a manifest containing more manifests for specific qualities, apparently there's also captions available in them too. This would probably be a useful addition alongside dashUrl in invidious's api.
@llsc12 llsc12 added the enhancement Improvement of an existing feature label Sep 17, 2022
@unixfox
Copy link
Member

unixfox commented Sep 17, 2022

apparently there's also captions available in them too.

Captions issue: #2567

This would probably be a useful addition alongside dashUrl in invidious's api.

Probably related: #2236

@SamantazFox
Copy link
Member

SamantazFox commented Sep 17, 2022 •
edited
Loading

streamingData.hlsManifest is a manifest containing more manifests for specific qualities, apparently there's also captions available in them too. This would probably be a useful addition alongside dashUrl in invidious's api.

On videos that have them, we already provide the HLS manifest.
For instance: https://test.invidious.io/api/v1/videos/jfKfPfyJRdk

@iv-org iv-org deleted a comment from llsc12 Sep 18, 2022
@llsc12
Copy link
Contributor Author

llsc12 commented Sep 20, 2022 •
edited
Loading

but I think the iOS client gets hls manifests for all videos
(tested with my own youtube client, no videos seem to not have a manifest)

@syeopite syeopite linked a pull request Sep 23, 2023 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Improvement of an existing feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add option for HLS quality in user preferences syeopite/invidious
3 participants
@unixfox @llsc12 @SamantazFox