-
Notifications
You must be signed in to change notification settings - Fork 11
/
Copy pathtalks.html
820 lines (776 loc) · 48.8 KB
/
talks.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Talks - W3C/SMPTE Joint Workshop on Professional Media Production on the Web</title>
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="stylesheet" href="style.css">
<meta name="twitter:site" content="@w3c">
<meta name="twitter:card" content="summary_large_image">
<meta property="og:title" content="W3C/SMPTE Joint Workshop on Professional Media Production on the Web">
<meta property="og:description" content="The workshop connects the web platform and the professional media production communities and explores evolutions of the Web platform to address professional media production requirements">
<meta property="og:image" content="https://www.w3.org/2021/03/media-production-workshop/media/social-banner.png">
</head>
<body>
<header class="header">
<div id="banner">
<div>
<p>
<a href="https://www.w3.org/"><img alt="W3C" src=
"media/w3c_home_nb-v.svg" height="48" width="72"></a>
<a href="https://www.smpte.org/"><img alt="SMPTE" src=
"media/smpte_logo.png" height="48"></a>
</p>
<div class="banner-title">
<h1>
W3C/SMPTE Joint Workshop on Professional Media Production on the Web
</h1>
</div>
<p class="attribution">
<span>Timeline photo by <a href="https://unsplash.com/@kineticbear?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText">Jacob Miller</a> on <a href="https://unsplash.com/s/photos/timeline?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText">Unsplash</a></span>
</p>
<p>8-19 November 2021; online event</p>
</div>
</div>
<nav class="menu" id="menu">
<ul>
<li><a href="./">Call for Participation</a></li>
<li><a class="active-tab">Pre-recorded talks</a></li>
<li><a href="agenda.html">Live sessions</a></li>
<li><a href="report.html">Report</a></li>
</ul>
</nav>
</header>
<aside class="box" id="sponsoring">
<h2 class="footnote">
Sponsor
</h2>
<p><a href="https://www.adobe.com/"><img src="media/adobe.png" alt="Adobe" width="70"></a></p>
</aside>
<main id="main" class="main">
<section id="talks">
<h2>Workshop talks and speakers</h2>
<p>
The <a href="./#pc">Program Committee</a> has identified the following speakers and talks as input to the Mid-November 2021 live discussions.
</p>
<p>
Discussions emerging from the talks are welcomed in our <a href="https://github.com/w3c/media-production-workshop/issues">GitHub repository issues</a>, either by creating a new issue or commenting on an existing one.
</p>
<section id="toc">
<h3>Table of Contents</h3>
<ol>
<li><a href="#integration">Integration of media production workflows</a></li>
<li><a href="#api">Web APIs for media production</a></li>
<li><a href="#app">Developing professional media production applications</a></li>
</ol>
<div data-action="toggle"></div>
</section>
<!-- Talks start (DO NOT REMOVE THIS COMMENT!) -->
<section id="integration">
<h3>Integration of media production workflows</h3>
<p>
These talks give an overview of media production workflows, the
opportunity that the web platform brings to this space, and
architectural and data management design considerations.
</p>
<div class="talks">
<details class="talk" id="pierre-anthony-lemieux-media-production">
<summary>
<div>
<div>
<h4>Lossless UHD videos in a browser</h4>
<span>by Pierre-Anthony Lemieux (Sandflow Consulting, supported by MovieLabs)</span>
<a href="talks/pierre-anthony-lemieux-media-production.html" class="button">View talk</a>
</div>
<img src="media/pierre-anthony-lemieux.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Something unimaginable just 5 years ago has happened: movie and TV production assets are processed and stored in the cloud. In parallel, the web has evolved from text pages with opaque plug-ins to a rich audio-visual medium. The time feels right for professional media production and the web platform to come together.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/pierre-anthony-lemieux.jpg" alt="" width="200" height="300">
<div>
<p><span>Pierre-Anthony Lemieux <br/>Sandflow Consulting, supported by MovieLabs</span>
<br/>Partner</p>
<p>Pierre has had a foot in both the web and professional media. Most recently, he led within SMPTE the development of the Interoperable Master Format (IMF) for the exchange of professional audio-visual masters, and served within W3C as editor of the IMSC recommendation for subtitles/captions. He lives in California and enjoys cycling and flying planes.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="steve-cronan-production-metaverse">
<summary>
<div>
<div>
<h4>The Production Metaverse</h4>
<span>by Steve Cronan (5th Kind)</span>
<a href="talks/steve-cronan-production-metaverse.html" class="button">View talk</a>
</div>
<img src="media/steve-cronan.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Modern productions are a collection of millions of files created by 100s of users around the world to create a single piece of content surrounded by an array of marketing, licensing and distribution needs. In this talk i'll focus on how information moves throughout the creator/production/studio ecosystem. The high velocity of files sizes, types, qualities all with Tier 1 security requirements and real time review expectations create an interesting mix of challenges.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/steve-cronan.jpg" alt="" width="200" height="200">
<div>
<p><span>Steve Cronan <br/>5th Kind</span>
</p>
<p>Steve Cronan, Founder and CEO of 5th Kind is the creator of the CORE product solution series developed to meet the evolving workflow challenges faced by studios and enterprises in the digital space. Building on a concept sparked in 2001 while working on the Matrix sequels, Steve has pioneered the field of secure real-time studio and production workflow management.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="bruce-devlin-metadata">
<summary>
<div>
<div>
<h4>Metadata in Production Workflows</h4>
<span>by Bruce Devlin (SMPTE)</span>
<a href="talks/bruce-devlin-metadata.html" class="button">View talk</a>
</div>
<img src="media/bruce-devlin.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>There are many interoperable solutions for video and audio pipelines that start or terminate in a browser and incorporate ingest, playback, editing and other workflows. When it comes to production metadata associated with video and audio, it's much more of a mess.</p>
<p>Metadata might be standardised like a GPS coordinate or time of day in ISO 8601 format. It might be proprietary like a tripod's gimbal position or characteristics of on-set lighting. Metadata might be bursty, slow and not synchronised to the video like a log of who's in shot or it might be high speed, binary and related to free-running clock like lens position or zoom setting. Metadata might be generated by a device like the velocity of a car, buggy, dolly or crane. Metadata might be derived from on-set stimuli such as the LED wall virtual set velocity.</p>
<p>The only common factor to all of this metadata is that none of it makes it to the VFX / Editor / Mastering suite unless you do a bunch of customs stuff in your workflow. I think we can do better. What do you think?</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/bruce-devlin.jpg" alt="" width="200" height="200">
<div>
<p><span>Bruce Devlin <br/>SMPTE</span>
</p>
<p>Bruce is the SMPTE Standards Vice President, founder of Mr MXF and has enjoyed award winning C-level positions at media companies over the years. He literally wrote the book on MXF and is a recognised world expert in media files and formats. Checkout his free Bruce's Shorts video series to improve your skills in the business of file based technology.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="massimiliano-dal-mas-ontology-matching">
<summary class="nopicture">
<div>
<div>
<h4>Ontology Matching for Workflows on Media Production on the Web</h4>
<span>by Massimiliano Dal Mas </span>
<a class="button">Upcoming</a>
</div>
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Consumer and professional media web applications used for creating and managing different media content require integrated collaboration applications to aggregate and generate new media content.</p>
<p>Due to the rapid growth of structured/unstructured data and user-generated media content the volume of data is becoming too big or it moves too fast.</p>
<p>For an evolving environment it is necessary to understand what knowledge is required for a task domain with an adaptive ontology matching.</p>
</dd>
<dt>Speaker</dt>
<dd class="speaker">
<div>
<p><span>Massimiliano Dal Mas </span>
</p>
<p>An engineer working on webservices and knowledge eng. - RDF/OWL</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="julian-fernandez-campon-ipaas">
<summary>
<div>
<div>
<h4>The Power of an iPaaS for Media</h4>
<span>by Julian Fernandez-Campon (Tedial)</span>
<a href="talks/julian-fernandez-campon-ipaas.html" class="button">View talk</a>
</div>
<img src="media/julian-fernandez-campon.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Content supply chain for media production includes nowadays several use cases, including localization, validations and in an open-collaborative environment using multiple systems: transcoder, editing tools, AutoQC and even AI tools. Using a Media Integration platform will leverage the implementation of these use cases as it will be possible to define these workflows using a LowCode/NoCode paradigm and most importantly future proof. In this talk we will present the challenges and what barriers will break focus on the need of standardization on the APIs and Datamodels.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/julian-fernandez-campon.jpg" alt="" width="200" height="200">
<div>
<p><span>Julian Fernandez-Campon <br/>Tedial</span>
</p>
<p>Julian is CTO at Tedial a company with 20+ years in the market specialized in Systems Integrations and Media Asset Management Solutions for the Broadcast Industry. Julian has a deep technical background now with 25+ of experience and has been in Tedial from the origins, where his contributions have had a major impact on all aspects of the company’s solutions. He’s been key in leading the transition in recent years to meet the new challenges in the market, with the adoption of the latest technologies in Tedial’s portfolio and the company’s transformation to DevOps. He lives in Malaga (Spain) and enjoys Cycling in the mountains and running in the beach.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="ed-gray-accessibility">
<summary>
<div>
<div>
<h4>Accessibility in creative tools discussion</h4>
<span>by Ed Gray (AVID)</span>
<a href="talks/ed-gray-accessibility.html" class="button">View talk</a>
</div>
<img src="media/ed-gray.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Ed Gray talks about the business case for excellence in accessibility, development directions driving accessibility, some key lessons learnt and lastly shows how a user of native creative tools with accessibility needs can benefit from thoughtful design.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/ed-gray.jpg" alt="" width="200" height="200">
<div>
<p><span>Ed Gray <br/>AVID</span>
<br/>Consulting developer evangelist and accessibility Director</p>
<p>Leads audio third-party developer program and efforts to drive accessibility into AVID products and services.</p>
</div>
</dd>
</dl>
</details>
</div>
</section>
<section id="api">
<h3>Web APIs for media production</h3>
<p>
These talks present some of the existing and emerging web platform
technologies that can be used to build media production applications
on the web, with practical suggestions for developers and open
questions from browser vendors' perspectives.
</p>
<div class="talks">
<details class="talk" id="chris-cunningham-hello-webcodecs">
<summary>
<div>
<div>
<h4>Hello WebCodecs</h4>
<span>by Chris Cunningham (Google)</span>
<a href="talks/chris-cunningham-hello-webcodecs.html" class="button">View talk</a>
</div>
<img src="media/chris-cunningham.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>This talk offers a real time coding demo to familiarize viewers with the core interfaces of WebCodecs. The demo will demux, decode, and render video from an mp4.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/chris-cunningham.jpg" alt="" width="200" height="200">
<div>
<p><span>Chris Cunningham <br/>Google</span>
<br/>Tech Lead WebCodecs</p>
<p>Chris is a software engineer at Google, working on Chrome's videostack team. He also serves as a co-editor of the WebCodecs and MediaCapabilities web specifications. He formerly worked as a full stack engineer at an ecommerce startup and as a videostack engineer on Microsoft's Skype (then Lync team). Chris enjoys skiing with his family in mountains outside Seattle.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="chris-cunningham-webcodecs-videoencoderconfig">
<summary>
<div>
<div>
<h4>WebCodecs VideoEncoderConfig</h4>
<span>by Chris Cunningham (Google)</span>
<a href="talks/chris-cunningham-webcodecs-videoencoderconfig.html" class="button">View talk</a>
</div>
<img src="media/chris-cunningham.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>In this talk I'll present the current state of VideoEncoderConfig dictionary. The idea is to show you what we have so you can tell me what we're missing.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/chris-cunningham.jpg" alt="" width="200" height="200">
<div>
<p><span>Chris Cunningham <br/>Google</span>
<br/>Tech Lead WebCodecs</p>
Chris is a software engineer at Google, working on Chrome's videostack team. He also serves as a co-editor of the WebCodecs and MediaCapabilities web specifications. He formerly worked as a full stack engineer at an ecommerce startup and as a videostack engineer on Microsoft's Skype (then Lync team). Chris enjoys skiing with his family in mountains outside Seattle.
</div>
</dd>
</dl>
</details>
<details class="talk" id="paul-adenot-webcodecs-performance">
<summary>
<div>
<div>
<h4>Memory access patterns in Web Codecs</h4>
<span>by Paul Adenot (Mozilla)</span>
<a href="talks/paul-adenot-webcodecs-performance.html" class="button">View talk</a>
</div>
<img src="media/paul-adenot.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>This talk discusses memory access patterns when WebCodecs is used in conjunction with other APIs, what WebCodecs does today to minimize memory access overhead, and envisioned solutions for further improvement in the near- and longer-term future so that WebCodecs' performance profile can match that in a native application.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/paul-adenot.jpg" alt="" width="200" height="200">
<div>
<p><span>Paul Adenot <br/>Mozilla</span>
<br/>Staff Software Engineer</p>
<p>Paul Adenot is a platform engineer at Mozilla, working on the Firefox web browser, primarily on anything related to audio and video. He also co-edits the Web Audio API and Web Codecs specification at the W3C.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="hongchan-choi-building-audio-apps">
<summary>
<div>
<div>
<h4>Thoughts and considerations on building audio apps on the web</h4>
<span>by Hongchan Choi (Google)</span>
<a href="talks/hongchan-choi-building-audio-apps.html" class="button">View talk</a>
</div>
<img src="media/hongchan-choi.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>"What are the things that you need to think about if you were to build an audio app on the web today?" In this presentation, we discuss how to take advantage of Web Audio API by understanding its architecture and the performance charactereistics. Also it is followed by the introduction of a set of tools named "Web Audio perf toolkit", which allows you to debug, profile, and measure your application from several different angles. We also briefly touches critical problem areas such as privacy and input/output latency.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/hongchan-choi.jpg" alt="" width="200" height="300">
<div>
<p><span>Hongchan Choi <br/>Google</span>
<br/>Tech Lead, Google Chrome
W3C Audio WG Co-chair</p>
<p>Hongchan is the Technical Lead of the Chrome Web Audio team and a co-chair of W3C Audio Working Group. He codes, writes, and speaks about Web Audio. His mission at Google is making audio better on web. He also care about building a healthy ecosystem with developers and industry partners. Before Google, Hongchan studied computer music at CCRMA, Stanford University and spent years creating and teaching computer music in South Korea.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="sergio-garcia-murillo-whip">
<summary>
<div>
<div>
<h4>It's time to WHIP WebRTC into shape</h4>
<span>by Sergio Garcia Murillo (Cosmo Software)</span>
<a href="talks/sergio-garcia-murillo-whip.html" class="button">View talk</a>
</div>
<img src="media/sergio-garcia-murillo.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>For many in broadcast and streaming, WebRTC is not “complete”, as it lacks a standard signaling protocol to make it work like RTMP or RTSP.</p>
<p>WHIP, the WebRTC HTTP Ingest Protocol, was developed to solve the biggest pain point with adopting WebRTC as a serious, professional, robust contribution protocol: Media Ingest. WHIP enables WebRTC to retain its technical advantages over older protocols like RTMP when it comes to resiliency over bad network conditions, adaptability, end-to-end encryption, and new codec support (hello AV1 SVC). It also removes the barrier WebRTC had with a lack of standard signaling protocol that has made it hard to support as a software solution, and difficult for hardware encoders to implement WebRTC.</p>
<p>Developers love WebRTC because it is an IETF & W3C standard that makes it easy to write client applications with native broadcast and playback support on billions of devices worldwide. And the WISH working group at the IETF is currently reviewing WHIP with a milestone to publish it as a standard by December 2021.</p>
<p>Implementing the open source WHIP library in your software or hardware encoder is all you need to support the entire WebRTC stack on the sender side.</p>
<p>It’s time to WHIP WebRTC into shape and take advantage of WebRTC end-to-end, as it was meant to be, natively on every device.</p>
</dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/sergio-garcia-murillo.jpg" alt="" width="200" height="200">
<div>
<p><span>Sergio Garcia Murillo <br/>Cosmo Software</span>
</p>
<p>Sergio Garcia Murillo is a technology enthusiast, long time media server developer and WebRTC expert. He is the founder of Medooze, CoSMo Software Media Server Tech Lead, and Millicast CTO.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="qiang-fu-video-transcoding">
<summary>
<div>
<div>
<h4>Video Transcoding in Browser using WebAssembly/WebCodecs</h4>
<span>by Qiang Fu (Bilibili)</span>
<a href="talks/qiang-fu-video-transcoding.html" class="button">View talk</a>
</div>
<img src="media/qiang-fu.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Introduce some possible ways for web developers to do video-transcoding based on WebAssembly and WebCodecs, and the chance if we could make video-transcoding easier to achieve by WebCodecs APIs.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/qiang-fu.jpg" alt="" width="200" height="200">
<div>
<p><span>Qiang Fu <br/>Bilibili</span>
<br/>Senior Front-End Developer</p>
<p>Qiang's work is serving for the video-creators on Bilibili, committed to providing some convenient authoring tools on browser. He has some experience in multimedia production and its workflow.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="patrick-brosset-eyedropper-api">
<summary>
<div>
<div>
<h4>The EyeDropper API</h4>
<span>by Patrick Brosset (Microsoft)</span>
<a href="talks/patrick-brosset-eyedropper-api.html" class="button">View talk</a>
</div>
<img src="media/patrick-brosset.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>On the web today, creative applications can't implement tools that allows users to select colors from any pixels on their screens. Microsoft is proposing (and has implemented in Chromium) a new API that enables authors to use a browser-supplied eyedropper. This talk describes the problem that this API solves, shows a little demo of the feature in action, and describes the API.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/patrick-brosset.jpg" alt="" width="200" height="243">
<div>
<p><span>Patrick Brosset <br/>Microsoft</span>
<br/>Senior PM</p>
<p>Patrick works on DevTools, PWAs and web platform.</p>
</div>
</dd>
</dl>
</details>
</div>
</section>
<section id="app">
<h3>Developing professional media production applications</h3>
<p>
These talks cover developer perspectives and experiences of building
web-based media production application, using technologies such as
WebAssembly, WebCodecs, WebRTC, highlighting the capabilities
already available as well as challenges and limitations that
highlight requirements for future development.
</p>
<div class="talks">
<details class="talk" id="kevin-streeter-creative-expression">
<summary>
<div>
<div>
<h4>Bringing Desktop-Class Creative Expression to the Web</h4>
<span>by Kevin Streeter (Adobe)</span>
<a href="talks/kevin-streeter-creative-expression.html" class="button">View talk</a>
</div>
<img src="media/kevin-streeter.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Creative tools have long been able to push the boundaries of performance on desktop PCs by taking full advantage of hardware capabilities, often by interfacing directly with hardware. This talk describes many of the challenges that exist with building tools based on the web platform that are just as capable as existing desktop tools. We will also cover some of the current and proposed APIs that will help overcome these challenges.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/kevin-streeter.jpg" alt="" width="200" height="250">
<div>
<p><span>Kevin Streeter <br/>Adobe</span>
<br/>Principal Scientist</p>
<p>Kevin is a principal scientist at Adobe, working on video, cloud, and network technologies. Kevin has been an active member of the standard community for many years, working in both MPEG and W3C on video and media standards. His current focus is developing tools and systems for creative expression and collaboration on the web and in the cloud, with a particular emphasis on video production.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="james-pearce-browser-hosted-video-editing">
<summary>
<div>
<div>
<h4>Browser Hosted Video Editing</h4>
<span>by James Pearce (Grass Valley)</span>
<a href="talks/james-pearce-browser-hosted-video-editing.html" class="button">View talk</a>
</div>
<img src="media/james-pearce.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Initially using WebAssembly to run cross compiled codecs, we have just ported to using WebCodecs instead. The talk discusses the impact of WebCodecs for Browser Hosted Video Editing and how WebCodecs interacts with the wider browser development environment.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/james-pearce.jpg" alt="" width="200" height="200">
<div>
<p><span>James Pearce <br/>Grass Valley</span>
<br/>Principal Engineer</p>
<p>James's background with Grass Valley stretches back 20 years, working initially on broadcast video server products, before moving into media asset management. Lately, as part of the company’s pivot to cloud, he's been part of the team building Grass Valley’s new cloud-based media asset management system, with a responsibility for browser-based media editing, logging and play-back. His recent focus has been on the design and development of a browser-based agile player engine and then applying that to build a non-linear editor.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="junyue-cao-non-linear-video-editor">
<summary>
<div>
<div>
<h4>A Non-linear Video Editor built with WebAssembly</h4>
<span>by Junyue Cao (ByteDance)</span>
<a href="talks/junyue-cao-non-linear-video-editor.html" class="button">View talk</a>
</div>
<img src="media/junyue-cao.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>WebAssembly makes it possible for us to migrate our C++ video editing engine to the web, but the development experience is not perfect. I want to talk about some possible improvements.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/junyue-cao.jpg" alt="" width="200" height="288">
<div>
<p><span>Junyue Cao <br/>ByteDance</span>
<br/>Senior Software Engineer</p>
<p>Junyue works for media team in Bytedance. He is currently working on a web video editor migrating from C++ engine with WebAssembly.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="sacha-guddoy-media-element-accuracy">
<summary>
<div>
<div>
<h4>Media Element accuracy and synchronization with the DOM</h4>
<span>by Sacha Guddoy (Grabyo)</span>
<a href="talks/sacha-guddoy-media-element-accuracy.html" class="button">View talk</a>
</div>
<img src="media/sacha-guddoy.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>This focuses on accuracy when working with media on the web. Accuracy is crucial In professional media workflows and Web media APIs can be lacking in this area.</p>
</dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/sacha-guddoy.jpg" alt="" width="200" height="200">
<div>
<p><span>Sacha Guddoy <br/>Grabyo</span>
</p>
<p>Sacha is the Lead Frontend Engineer at Grabyo, working on bringing high-end video production workflows to the cloud.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="sacha-guddoy-webrtc">
<summary>
<div>
<div>
<h4>WebRTC in live media production</h4>
<span>by Sacha Guddoy (Grabyo)</span>
<a href="talks/sacha-guddoy-webrtc.html" class="button">View talk</a>
</div>
<img src="media/sacha-guddoy.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>This talk focuses on the use of WebRTC in professional live broadcast workflows. In a live production environment, users need to rely on their tools being accurate and performant. Furthermore, greater flexibility in the WebRTC API would allow novel workflows and optimisation.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/sacha-guddoy.jpg" alt="" width="200" height="200">
<div>
<p><span>Sacha Guddoy <br/>Grabyo</span>
</p>
<p>Sacha is the Lead Frontend Engineer at Grabyo, working on bringing high-end video production workflows to the cloud.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="soeren-balko-clipchamp-webcodecs">
<summary>
<div>
<div>
<h4>Improving Clipchamp's in-browser video editing pipeline with WebCodecs</h4>
<span>by Soeren Balko (Clipchamp)</span>
<a href="talks/soeren-balko-clipchamp-webcodecs.html" class="button">View talk</a>
</div>
<img src="media/soeren-balko.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Clipchamp's mission is to enable everyone to tell stories worth sharing through the power of video. To live up to that goal, we have built a video editor that runs fully in-browser. This also means running the full video processing pipeline on the client and engineering around the challenges that the browser still poses for resource-intensive workloads. Offering access to hardware-accelerated video decoding and encoding, the Clipchamp team has started integrating WebCodecs into our video processing stack early on. In the production version, we wrap the WebCodecs API into custom codec plugins. These form a part of the FFmpeg WebAssembly port that is the beating heart of Clipchamp. This talk covers some of the challenges we encountered along the way and discusses the engineering decisions that we made in response to that. We also make suggestions for some future iterations of the standard, hoping to see it further improve over time.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/soeren-balko.jpg" alt="" width="200" height="200">
<div>
<p><span>Soeren Balko <br/>Clipchamp</span>
</p>
<p>Soeren was a co-founder of Clipchamp and its CTO until his company was recently acquired by Microsoft. He passionately believes in the in-browser paradigm of edge computing, which is the backbone of Clipchamp's video editor today. Before joining Clipchamp (now Microsoft), Soeren had a six year tenure at SAP, learning the ropes while working on enterprise computing middleware. Soeren holds a PhD in computer science from Magdeburg University (Germany). With his wife and son, he is living in sunny Brisbane (Australia).</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="he-zhi-production-olympics">
<summary>
<div>
<div>
<h4>Live and post production for Sports Broadcasting</h4>
<span>by HE Zhi (MIGU - China Mobile)</span>
<a href="talks/he-zhi-production-olympics.html" class="button">View talk</a>
</div>
<img src="media/he-zhi.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>This talk will reflect on Olympics 2021 experiences in media assets productions and
distribution from China Mobile, as the solo live broadcaster for new media
in China, and explore the combination of 5G-based remote production,
lightweight web system as well as HDR features.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/he-zhi.jpg" alt="" width="200" height="264">
<div>
<p><span>HE Zhi <br/>MIGU - China Mobile</span>
</p>
<p>R&D, Multimedia technologies in China Mobile and Nokia, leading the web-based media production team at China Mobile - Migu</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="oleg-sidorkin-distributed-content-review">
<summary>
<div>
<div>
<h4>Distributed multi-party media-rich content review</h4>
<span>by Oleg Sidorkin (Bluescape)</span>
<a href="talks/oleg-sidorkin-distributed-content-review.html" class="button">View talk</a>
</div>
<img src="media/oleg-sidorkin.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Classic video conferencing and assets sharing tools are not adapted for group work when it comes to high fidelity content such as art, animations, video. We created a novel approach where virtually any website or web-enabled tool can gain additional functionality for live co-experience in viewing (common operating picture), commenting, and editing creative content. The desired web resource is loaded and operated in the cloud, while exact incremental changes are broadcasting to all connected clients.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/oleg-sidorkin.jpg" alt="" width="200" height="200">
<div>
<p><span>Oleg Sidorkin <br/>Bluescape</span>
<br/>Principal Lead Software Architect</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="christoph-guttandin-all-that-can-be-done">
<summary>
<div>
<div>
<h4>Whatever can be done, will be done</h4>
<span>by Christoph Guttandin </span>
<a href="talks/christoph-guttandin-all-that-can-be-done.html" class="button">View talk</a>
</div>
<img src="media/christoph-guttandin.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>This talk presents a wishlist of common needs when developing media editing applications, along with relevant API features that could be used if they were supported across web browsers.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/christoph-guttandin.jpg" alt="" width="200" height="200">
<div>
<p><span>Christoph Guttandin </span>
</p>
<p>Christoph is a freelance web developer specialized in multimedia web applications. He has recently worked on streaming solutions and interactive music applications for clients like TV stations, streaming services, synthesizer vendors, and artists.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="peter-salomonsen-webassembly-music">
<summary>
<div>
<div>
<h4>WebAssembly Music - latency/stability across platforms </h4>
<span>by Peter Salomonsen </span>
<a href="talks/peter-salomonsen-webassembly-music.html" class="button">View talk</a>
</div>
<img src="media/peter-salomonsen.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>WebAssembly is great for audio plugins, AudioWorklet deliver real time experience for music production. Still latency, stability and audioworklet resource priority is essential to give a usable experience. I'll demonstrate how it should work on my M1 macbook Air (in chrome) with demos from the WebAssembly music project.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/peter-salomonsen.jpg" alt="" width="200" height="209">
<div>
<p><span>Peter Salomonsen </span>
</p>
<p>Peter has been playing with playing with computer music since the 80s, always chasing the vision of a portable, compact, yet limitless music production environment. After decades of efforts in Assembly, C/C++, Java (the Frinika project), finally the Web emerge as a viable path. Combining WebAssembly with Web Audio, he has created a web app for live coding and synthesizing instruments in real time. This was demonstrated at the WebAssembly summit in 2020 and has caught attention in the Web Audio and WebAssembly communities. He is using the app to create music for various digital art projects.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="ulf-hammarqvist-audio-latency">
<summary>
<div>
<div>
<h4>Audio latency in browser-based DAWs</h4>
<span>by Ulf Hammarqvist (Soundtrap/Spotify)</span>
<a href="talks/ulf-hammarqvist-audio-latency.html" class="button">View talk</a>
</div>
<img src="media/ulf-hammarqvist.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>Soundtrap implements a collaborative Digital Audio Workstation (DAW) in the browser and makes heavy use of WebAudio and other web APIs. We highlight two needs for audio/midi recording use case:</p>
<ul>
<li>Low latency for 'monitoring'. Ex, feeding the input through effects or playing a software instrument.</li>
<li>Accurate latency information to perform 'latency compensation' when recording multiple 'tracks'.</li>
</ul></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/ulf-hammarqvist.jpg" alt="" width="200" height="214">
<div>
<p><span>Ulf Hammarqvist <br/>Soundtrap/Spotify</span>
</p>
<p>Ulf has a backround in audio-related software engineering for RTC, music streaming as well as music production tools. Interested in both the integration/architecture aspects and deeper ADSP subjects. Currently working with the beating audio heart of Soundtrap.</p>
</div>
</dd>
</dl>
</details>
<details class="talk" id="max-grosse-openexr">
<summary>
<div>
<div>
<h4>Reviewing Production OpenEXR files on the Web for ML</h4>
<span>by Max Grosse (Disney Research)</span>
<a href="talks/max-grosse-openexr.html" class="button">View talk</a>
</div>
<img src="media/max-grosse.jpg" alt="" width="100">
</div>
</summary>
<dl>
<dt>Abstract</dt>
<dd><p>In the DisneyResarch|Studios (DRS) machine learning pipeline DRS frequently works with production assets in the OpenEXR format. Monitoring the training, inspecting results, and eventually judging the quality of these new approaches require tracking and comparing those assets. DRS decided for an approach where a server provides high dynamic range results as EXR files and compiled OpenEXR using emscripten to allow in-browser decoding and viewing. Using WebGL, simple adjustments and a visualization of per pixel error metrics can be performed by the client on the fly. In this talk, DRS will present the problem, the chosen solution, challenges that DRS has encountered, and demonstrate JERI.io, the web-based EXR viewer, which DRS has released as open source.</p></dd>
<dt>Speaker</dt>
<dd class="speaker">
<img src="media/max-grosse.jpg" alt="" width="200" height="200">
<div>
<p><span>Max Grosse <br/>Disney Research</span>
</p>
<p>Max is principal software engineer at DisneyResearch|Studios. There he works in a variety of areas, ranging from developing simple prototypes to full production systems, always at the interface between research and production use. While most of his daily work involve either performance critical media applications or complex machine learning set-ups, he is also passionate about web technology and tries to combine these different worlds wherever it makes sense.</p>
</div>
</dd>
</dl>
</details>
</div>
</section>
<!-- Talks end (DO NOT REMOVE THIS COMMENT!) -->
<p role="navigation" id="back-to-top">
<a href="#banner"><abbr title="Back to Top">↑</abbr></a>
</p>
<section id="sponsors">
<h2>
Sponsor
</h2>
<p><a href="https://www.adobe.com/"><img src="media/adobe.png" alt="Adobe" width="70"></a></p>
<p class="small">Interested in sponsoring the workshop?<br/>Please check the <a href="sponsors.html">sponsorship package</a>.</p>
</section>
</section>
</main>
<footer class="footer" id="footer">
<p>
W3C is proud to be an open and inclusive organization, focused on
productive discussions and actions. Our <a href=
"https://www.w3.org/Consortium/cepc/">Code of Ethics and Professional
Conduct</a> ensures that all voices can be heard.
</p>
<p>Questions? Contact François Daoust
<<a href="mailto:[email protected]">[email protected]</a>>.
</p>
<p>
Suggestions for improving this workshop page, such as fixing typos or
adding specific topics, can be made by opening a <a href=
"https://github.com/w3c/media-production-workshop/">pull request on
GitHub</a>, or by emailing François Daoust
<<a href="mailto:[email protected]">[email protected]</a>>.
</p>
</footer>
<script src="script.js"></script>
</body>
</html>