[DMP 2024]: Use of 3D/Augmented Glasses to provide Accessibility Support in Movie Theaters

[arvind-planetread]

Ticket Contents

People with accessibility needs find it difficult to enjoy the movies in a theater since the theaters usually don't offer accessibility friendly features like Same Language Subtitles or additional Sign Language videos as the regular users do not require them.
With the majority of revenue coming from the regular users, the theater owners do not have any incentive to add the above features. Plus even if they have, the accessibility shows are on a time which like first show in the morning of a weekday or other inconvenient times etc.

This prevents the visually impaired population from enjoying their movies. The solution we propose is to add coded subtitles, ISL video to the film which are invisible for naked eye and then use a 3D/Augmented glasses to show the hidden Subtitles, ISL video part during the film screening. The accessibility features are baked in to the film screening and people who actually need it can use a special glass to view them. That way both users are enjoying the movies at the same time. This will impact 63 million people in India with hearing difficulties.

Goals & Mid-Point Milestone

Goals:

Goal 1: Use the glasses to decode/show the Same Language Subtitles in the screened film.
Goal 2: Use the glasses to decode/show the ISL video which is shown the bottom right corner of the film screen.

Goal 1 has to be achieved By Mid-point Milestone.

Setup/Installation

No response

Expected Outcome

The user gets access to an augmented/3D glass and uses it to decode/see the extra items which are usually invisible to the regular watchers without the 3D glasses.

Acceptance Criteria

Clear visibility of the Subtitles and the ISL video in the film screen.

Implementation Details

Any relevant tech stack which best supports Augmented Glasses can be used. We are open to suggestions.

Mockups/Wireframes

No response

Product Name

Accessibility with Augmented Glasses

Organisation Name

Planet Read

Domain

⁠Education

Tech Skills Needed

Virtual Reality

Mentor(s)

@arvind-planetread

Category

Research

[River-unknown]

Hi, I am Atreyee Saha, currently in second year pursuing Btech in Computer Science and Engineering from NIT Rourkela. I am proficient in Unity and also have worked in some of the projects of Virtual Reality using the same. I found myself interested in this issue and I think I would be able to contribute to this ticket with my current knowledge and experience in Virtual Reality.

[TheMystic07]

Hi @arvind-planetread sir ,
I'm Gurshabadpal Singh, a second-year Computer Science student at Chandigarh University with a Diploma in the field. I'm excited about this project using augmented glasses to make movies more accessible!

My studies and a separate project I'm working on have given me a basic understanding of computers and virtual reality (VR) technologies. I'm also interested in augmented reality (AR) and mixed reality (MR).

Making movies accessible for everyone is a great idea, and I believe my skills in building apps and knowledge of VR can be helpful.

I'd love to learn more about the project and see how I can contribute. Please let me know if there's anything I can do to help.

[AbhimanyuSamagra]

Do not ask process related questions about how to apply and who to contact in the above ticket. The only questions allowed are about technical aspects of the project itself. If you want help with the process, you can refer instructions listed on Unstop and any further queries can be taken up on our Discord channel titled DMP queries.

[kartikf4]

Hi @arvind-planetread sir, I am really interested in contributing to this project, I have some experience with augmented reality in unity. I have some ideas that I am currently working on related to project, and I would like to have our opinion. so can you mention your email or something so I can discuss my ideation.

[anuragyadav04]

Hello @arvind-planetread Sir, This side Anurag Yadav 3rd year B.tech(computer science & information technology) student at KIET Group of Instituions. I am proficient in Unity and also have worked in some of the projects of Virtual Reality using the same. I found myself interested in this issue and I think I would be able to contribute to this ticket with my current knowledge and experience in Virtual Reality.

[Sumitnitrkl]

Hi, I am Sumit Kumar, currently in my second year of pursuing a Btech in Computer Science and Engineering from NIT Rourkela. I am proficient in Unity and have also worked on some of the projects of virtual reality using the same. I found myself interested in this issue, and I think I would be able to contribute to this ticket with my current knowledge and experience in virtual reality.

[arvind-planetread]

Hi @River-unknown @TheMystic07 @kartikf4 @anuragyadav04 @Sumitnitrkl

Thank you all for expressing your interest. :)
I found an excellent article for proposal creation. Please refer to it and create your version of the proposal.Then email it to arvind[at]planetread.org

Thank you.

[sohaib7899434980]

Hi @arvind-planetread sir ,

I'm a first-year BTech student, passionate about contributing to this project. I've previously worked on wearable computing projects, presented at conferences, and even won the Best Paper Award at a prestigious university, NIRF 1-ranked IIT Madras (IITM), twice. However, I've understood the challenge but visually impaired individuals may not benefit directly from visual aids like glasses. Therefore, it's essential to consider inclusive solutions. Looking forward to discussing further!

[arvind-planetread]

@sohaib7899434980
Thanks for your interest. Please write to me: arvind[at]planetread.org

[NagarjunaVatti1999]

Hi @arvind-planetread,

I am Nagarjuna Vatti. I am IIT Roorkee certified Unity3D developer and AICTE certified Unreal developer. I have 2+ years of professional experience in Unity3D AR/VR development. I found this problem statement interesting and an interesting use case for Augmented Reality. I am looking forward to contribute for this project. However I need some clarifications regarding the problem statement.
Thank You

[arvind-planetread]

@NagarjunaVatti1999
Thanks for your interest. Please write to me arvind[at]planetread.org.

[kanahia1]

Hello @arvind-planetread sir, I am an undergraduate student of IIT-P (one of the prestigious institutes of our country) and also an active open-source contributor at Wikimedia Commons (Parent Organization of Wikipedia). I have found this project to be pretty relevant as it correlates with my research area of AR/VR.

Past Experience -

• Research Intern, Sveučilište u Zagrebu
• Research Intern, CSE Department IITP

Achievements -

• Received offer for research intern at IMT Atlantique, Nantes, France
• Won scholarship for Wikimedia Hackathon which will be held in Tallinn, Estonia, Europe
• Got selected for the finals in Smart India Hackathon’23
• Worked on a research project funded by the Department of Science and Technology, Government of India
• Showcased research projects at India Mobile Congress, at Pragati Maidan, Delhi

Letter of Recommendation by HoD, CSE Department, IIT Patna - https://drive.google.com/file/d/1zQBu_m_vLpLvng1WZNG1fGTc5zZj8SkE/view

[kanahia1]

@arvind-planetread sir, I have few points to discuss Can I share it worh you?

[arvind-planetread]

@kanahia1 Please write to arvind[at]planetread.org

Thank you. 👍

[imxade]

I have some queries:

Is this project going to heavily rely on GPU? (It doesn't seem like we need to work on 3D models)

Are we supposed to own our own AR glasses?

[arvind-planetread]

@imxade
Please send an email to arvind[at]planetread.org
Thank you.

[AbhimanyuSamagra]

Do not ask process related questions about how to apply and who to contact in the above ticket. The only questions allowed are about technical aspects of the project itself. If you want help with the process, you can refer instructions listed on Unstop and any further queries can be taken up on our Discord channel titled DMP queries. Here's a Video Tutorial on how to submit a proposal for a project.