Hi !

We are a team representing the voice of persons with disability. Our team includes people with disability. 4 of us are person with visual impairment. 2 of us are from non-profit working for the cause of people with disabilities in india. Our team name is "Inspire" .

Is this entry for idea or technical track?

This entry is for the technical track.

What is the best way to review your submission?

  1. First, request you check out this 12 minute video. Click this link for the introductory video. This video has audio commentary, hence accessible by persons with visual impairment.
  2. Based on your topic of interest, review the paragraphs below.
  3. Experience the Try out demos as we have put in enormous effort to bring you 7 functional AI innovations - Check out Try out link

Inspiration

This is an idea generated by a team who went out to find out what is needed by the community of people with disabilities. Our team includes many persons with disabilities. We listened to different individuals with disabilities across cities, age groups, and types of disabilities. We listened deeply by visiting people at their doors. We went to school for the blind, non-profits, and institutes working for the cause of disabilities, and interviewed many leaders with disabilities.

What was your approach to creating appropriate solutions for person with disabilities?

As our team comprises people with disabilities, and as we went to meet different individuals with disabilities, we listened to many insights. We listened, We prototyped and we took feedback. Based on face-to-face field visits to different communities (vision, hearing, and physical, spactics, cognitive) at four different cities, we listened to their needs sincerely. Then we came to the drawing board & prototyped solutions to solve the pressing needs of people with disabilities. The set of ideas and needs represent the voice of people with disabilities. We attempted to address these pressing needs by applying Artificial Intelligence. The credit for these ideas belongs to the community.

What types of disabilities are relevant in your entry?

We made an attempt to address the needs of

  1. persons with visual impairment.
  2. persons with mental health conditions.
  3. persons with cerebral palsy.
  4. persons diagnosed with movement disorders.
  5. acid attack victims.
  6. persons with acquired deaf-blindness.
  7. persons in early stages of depression.
  8. persons in early-stage cognitive conditions.
  9. persons with temporary/situational disability (e.g person with arm injury).
  10. persons with sign language from any country. (person with hearing impairment)
  11. All persons with disability (Beautiful dreams).

Food for thought

  1. It is all about the rights of people with disabilities.
  2. Systemic thinking to create the path for sustainable accessible beauty.
  3. Human-centered design thinking approach.
  4. Tap into advances in AI to solve the needs of people with disability.
  5. Access to beauty begins with the inclusion of persons with disability and upholding their human rights.

What did you create?

We put in an enormous amount of quality thinking, effort, time in creating this. Given we wanted to contribute to persons with different disabilities, we developed 7 innovation themes in this single submission.

What are the 7 themes in your hackathon entry?

This one entry weaves together a set of 7 ideas together into one powerful story. These ideas are implemented & demonstrated with respective functional AI innovations.

Breakthrough Solutions for Person with a Disability by creative use of AI.

  1. Innovation 1: Inclusive user experience while shopping online. Demo shows how person with visual impairment may speak to an AI copilot to find what he needs. Here is a video recording of functional web with speech interaction.
  2. Innovation 2: Inner beauty spa: Improve Mental health for millions. Here is a video recording of a functional AI-based mental wellness coach nurturing beautiful inner beliefs.
  3. Innovation 3: AI assistive tech to support the employment of persons with visual impairment in the beauty industry.(Supports Disability Inclusion commitment of ELC leadership.) Here is a video recording of functional AI powered Assistive tech to enable employment of a person with visual impairment in the industry
  4. Innovation 4: Accessible beauty rooms at Estee Lauder offices. Here is video recording of showcasing the experience of an accessible beauty room by invited guests with visual impairment.
  5. Innovation 5: Access to beauty for persons with cerebral palsy or persons with movement disorders. Here is video showing how an AI can observe the user & thus recommend the purchase of appropriate assistive devices that suits the assistive needs of the individual. This transforms daily beauty experience into accessible.
  6. Innovation 6: Access to creative beauty for Acid attack victims. Here is a video recording of AI.
  7. Innovation 7: AI powered self-empowerment. Using generative AI, beautiful vision and beautiful dreams of future is painted. Here is a video recording of a functional AI app helping you dream about a happy & beautiful leadership role.

All these 7 ideas are implemented and demonstrated. You can Try it out now!

You said you have 7 sub-themes in this single entry. Did you create functional apps for all 7 ideas?

Yes, we demonstrated all 7 ideas in this single submission towards this hackathon. In case you wish to validate this, please visit our supplementary website created as part of this hackathon. In this website, we share the complete source code. More importantly, we even made a dedicated video guide to help you Try it out all the 7 themes one by one. Please move ahead to experience all 7 functional AI innovations. Click the link for "Try it out".


Why your entry is special?

What is special? A human rights approach to promote inclusion of persons with disability.

Our functional apps upholds the human rights of persons with disability as per UN Convention of Rights of persons with disability. We took a human rights based approach to inclusion of person with disability to the beauty industry. Here is a compilation to highlight how our entry promotes the protection of rights of persons with disability. Check out a 2 minute video compilation on "How your solution protects human rights of persons with disability?".

As a person interested in advocacy and empowerment of persons with disability, how can i extend your AI innovations? What is your thoughts on applying technology to uplift the community?

Beyond the beauty use cases presented below, this tech can be extended to serve the needs of the people in need. Here is the extended use case...

  1. It can be extended to educate about human rights of women with disabilites across countries/languages. Here is a video of a solution to protect women with intellectual disabilities in care homes.
  2. It can be extended to tackle self-esteem. Here we train a GPT-based AI model to perform the role of a trusted well-wisher to support a person to recover from a humiliating loss through a powerful talking therapy based on the established science of CBT.
  3. It can be extended to transform the education of person with disability. Imagine a teacher who adapts to the needs of the child. Here is a video recording from the school for the blind.
  4. It can be used to address barriers to employment. Here is a video showcasing employees with visual impairment using AI to create an inclusive work environment.
  5. A inclusive world requires people with disabilities in positions of power. See how Generative AI can not only help dream, but portray persons with disability in leadership roles to the world. Here is a video.

Inclusive beauty solutions

Please explain your 7 apps to a leader from the beauty industry?

Here are the many ways this entry contributes to the beauty industry. This entry does a holistic job of inclusive beauty. First, it caters to many types of disability as mentioned above. Then, we applied the power of AI to address the many needs. Did you try out the 7 functional apps? We recommend trying out all 7 innovative AI themes 1st hand.

  1. How about having a AI based beauty advisor who helps you to shop online. Video of Personalized recommendation of beauty products for consumers based on universal design
  2. Do you know the needs of person who is shopping at your online store?. Is there a way to discover the person's needs? . Once you discover the needs, you can recommend appropriate assistive beauty devices. Here video of how AI discovers the assistive needs of the individual with cerebral palsy and then finds recommends an appropriate design for an assistive makeup brush
  3. How can you innovate accessible products?. Employment of persons with disability promotes collaboration and innovation. video
  4. How are feeling today? Feeling beautiful inside?. Video
  5. Experience trying out new beauty products in an unmanned beauty kiosk in the airport boarding gate. Video
  6. Beautiful dreams. Video
  7. How about providing tools for your makeup influencers? This tool can be used for social media campaigns. It is based on Creative AI. Have you checked out the images created by this AI yet? Click here to discover the beautiful visions.

How are you doing on judging criteria?

What is the potential impact? Specify the number of individuals whose lives are improved, the scale and the type of positive impact?

The video demonstrated the potential impact on persons with disabilities across many types of disabilities, age groups, and local languages. The try out app demonstrated a breakthrough AI to include everyone from all parts of the world.. This video showed how you can include person in France to person with Indian sign language . The video covered the experience of both teenagers & the elderly. You might have taken note of the universal design that opens up for all ELC consumers including persons with disability. The mental health solution can nurture inner beauty for 1 billion people across the planet, given depression is a leading cause of disability. Given 70% of women with disabilities haven't been exercised their human right to work, our app provides a solution to enable an inclusive workplace and thus accelerate the employment of persons with disability.

How technically impressive is the solution?

  1. We have applied all the recent breakthroughs in the field of AI to make a difference for the community. We creatively employed the latest AI technologies to solve the most pressing needs of persons with disabilities.
  2. We employed an AI breakthrough in the field of Multimodal AI. This AI augments the barriers to the perception of persons with acquired deaf-blindness. Check the Try out link to experience a functional app.
  3. We respect the privacy of person with disability. We developed an GPT based AI architecture that is 100% privacy safe. Privacy is a critical requirement in mental health solution, where the persons shares personal experiences with a AI coach. These thoughts can't be sent over the internet, and neither can be processed by a chatGPT as it runs on cloud based AI. So we designed an tiny derivative of GPT-2 based AI model that can fit into your smartphone. You can note our custom GPT model only takes 134 millions parameters, hence can be run on a smartphone. For constrast, big models like GPT4 and chatGPT have billions of parameters and hence can only be processed on cloud. We even trained a GPT2 model to speak like a caring mental health coach. Check out the source code for our unique technology.
  4. We applied Generative AI such as Stable Diffusion to create beautiful visions of the future. We applied advanced techniques like in-painting and BeautyGAN. Did you see the images generated?
  5. We implemented the next generation of web accessibility by implementing W3C speech recognition on the web.
  6. For completeness, we covered many types of disabilities. Did you check the Try out link ?

Does your solution respect the privacy of the person?

  1. Yes, we respect the privacy of the person with disability. Hence we designed our AI architecture to be privacy safe.
  2. The mental health AI is based GPT2 model with 134 Millions parameters that can installed into a smartphone. Every computation is completed on the personal smartphone of the user. So data is NOT sent to the cloud. Data is not transmitted to the cloud. Data is not stored anywhere. This is a big contrast to chatGPT styled cloud AI model. This is a smartphone GPT model and not cloud based GPT. We carefully designed the size of the GPT model to be small enough to fit into the smartphone. The fine-tunning of GPT for the custom use was also demonstrated in the Try out link.
  3. The solution of Access to beauty for Persons with cerebral palsy is based on TensorFlow.JS. So the processing of webcamera is done within the laptop web browser. No data about the user is transmitted back to the server. The app only works after the user gives consent to turn on the web camera. Further, we demonstrated the masking of skin to further remove privacy concerns. Every computation is completed on the personal laptop of the user. So, the data is not stored and not transmitted to the cloud.

Try it out

Experience some amazing innovations by going to the Try out website

Here are the breakthrough Solutions for Persons with Disability.

We have 7 innovations to try out.. Enjoy!

Recommend to visit the main website link for Try out. Click this link https://sites.google.com/view/inclusiveapproach

Try out these 7 amazing innovations in this single hackathon entry..

  1. Be empowered. You have the right to a beautiful life. Use AI to visuvalize a beautiful future for oneself. Try it
  2. Got a challenging problem? How to enable a Person with acquired deaf-blindness? Give access to info? Two missing biological senses, namely eyes and ears can be augmented with this AI technology. Check out this functional AI app that sees the world on your behalf, and interacts with you in text. You can ask any question about the visuals, and the AI will see the image on your behalf, then understand your question, then think on your behalf, find answer to your question about the visual, and thus respond to you with an answer. Try it
  3. Access to beauty for persons with cerebral palsy. The Estee Lauder website analyzes movements from web camera. Try it
  4. Accessible user experience while visiting beauty shops on the web. How about simply speaking to an AI beauty advisor? Just speak to find the right products. Try it. (beta version for users with Indian English accent, alpha version for rest)
  5. Everyone goes through those depressing moments of life. Do you know someone who needs a caring message? Is social stigma preventing an open discussion on that topic? Here is a AI counsellor. This AI is trained on Cognitive sciences and can perform Cognitive Behaviour Therapy. Help build that self-esteem. Try it
  6. This is an accelerator for the employment of persons with visual impairment. Try it
  7. Inclusive of everyone? This AI just allows you to talk to anyone.. Talk any topic from human rights to beauty. Try it now

Question from a person with visual impairment. "i heard from my friend that all the demos are functioning. Can you walk me through the demos?"

We cater to a wide spectrum of disability. The Try out website provides you with step by step instructions on running the demos. You are welcome to visit the Try out website. For simplicity, you can experience all the demos by just playing this 15-minute video. This 15 minute video is primarily a narrated screen recording. While the earlier recommended 12 minute video gave a good introduction, this 15 minute video is screen recording of someone trying out the demos. This entire 15 minute has a good audio commentary. Here is the link to the 15 minute video.

Question from an independent jury. "I want to try out all the AI demos. How i can check them out?"

Request you to try out all the 7 demos. We have step by step video guidance for each one of them in the respective webpage.

Here are the 7 try out links

  1. https://sites.google.com/view/inclusiveapproach/try-it-a
  2. https://sites.google.com/view/inclusiveapproach/try-it-b
  3. https://sites.google.com/view/inclusiveapproach/try-it-c
  4. https://sites.google.com/view/inclusiveapproach/try-it-d
  5. https://sites.google.com/view/inclusiveapproach/try-it-e
  6. https://sites.google.com/view/inclusiveapproach/try-it-f
  7. https://sites.google.com/view/inclusiveapproach/try-it-g

Built With

Share this project:

Updates