Blog Post

Exploring Bing AI with Screen Readers

Carolina Cohoon • Oct 18, 2023

A Conversation Over Coffee

Artificial Intelligence (AI) has been a game-changer in many aspects of our lives, and one of its most promising applications is in the field of accessibility. Microsoft’s Bing AI, an intelligent chatbot, is one such example. It is designed to enhance search results, provide summarized responses, facilitate an engaging chat experience, generate creative content, aid in writing, and even produce remarkable copyright-free images from text. But the question arises - how user-friendly is it for those who depend on screen readers to navigate the internet?

To answer this question, we invited Nina Amegashitsi, a member of the blind community, to test Bing AI using VoiceOver, a screen reader feature on iOS devices. Over a cup of coffee, we downloaded the Bing AI app on an iPad and iPhone and embarked on a journey to explore its accessibility features.


Navigating the Interface

At first glance, the Bing AI app appears simple and clean to sighted users. However, for Nina, the interface was cluttered with irrelevant information such as ads and links. Despite using multiple gestures to navigate the screen, finding what she was looking for proved tricky. When she tried using the microphone to voice her queries, the screen reader repeated “generating response” several times, resulting in duplicated text. There was also no way to skip to relevant sections by headings or landmarks.


A Workaround and Its Limitations

Nina found a workaround by typing her queries into a note pad app and pasting them into the Bing AI app with the rotor. She was impressed by the bot’s ability to generate ideas and responses. However, she was disappointed that she could not copy and paste the responses back into the note pad app.


The Road Ahead

Nina’s experience with Bing AI revealed some of the accessibility barriers that screen reader users may face when using AI technologies. When compared to other chatbot services like Google Assistant and Siri, she found Bing AI to be less accessible and user-friendly.


However, this experience also highlights the immense potential of AI to enhance accessibility and foster inclusion across all products. By incorporating the insights of users with firsthand experience into the development process, diversifying the data used to train AI models, assessing potential impacts on diverse users, and prioritizing usability in design - we can work towards making AI more accessible and equitable for everyone.

Nina’s conversation serves as a reminder that the field of AI in a constant state of evolution, and there is a wealth of research waiting to be explored in AI technologies. As innovation and refinement of these technologies continue across various sectors, including Education, it becomes increasingly crucial for adult educators to advocate for more research and collaboration. Such efforts will pave the way towards achieving greater digital access that is both equitable and fair.

By Jeremy Marks 31 Jan, 2024
A conversation with Jaime Hooper & Christine Melehes
By Tamara Kaattari 23 Nov, 2023
The LLSC team shares how literacy plays a role in their holidays...
By Sherry Lippincott, Carolina Cohoon, Jeremy Marks 18 Oct, 2023
Collecting educated opinions on the use of Artificial Intelligence in the field of Literacy
By Carolina Cohoon 30 Aug, 2023
A Conversation with Mike
By Carolina Cohoon 29 Aug, 2023
Celebrating Krissy’s Achievement
By Summer Burton 13 Jul, 2023
The Skills for Success are the nine skills the Canadian government has identified everyone needs to be successful in work, learning and life. Today we're continuing our look at the Skills for Success by talking about Writing . According to the Canadian government, writing is how we share information using written words, symbols, and images. For example, we use this skill to fill out forms and applications, and write emails, reports and social media posts. Learn more about writing and the other Skills for Success here , and think about the writing you do on an average day, from grocery lists to reminders to homework. If you'd like to build your reading, writing, creativity, problem solving, and other Skills for Success, Ontario's adult literacy programs offer free, individualized training that can help. Contact us to find a program in your area!
By Summer Burton 30 Jun, 2023
The Skills for Success are the nine skills the Canadian government has identified everyone needs to be successful in work, learning and life. Today we're continuing our look at the Skills for Success by talking about Reading . According to the Canadian government, reading skills are important so we can find, understand, and use information presented through words, symbols, and images. For example, we use this skill to locate information on forms and drawings, and to read items such as emails, reports, news articles, blog posts and instructions. Strong reading skills allow you to do your job and to work safely, and efficiently. Reading is also important in day-to-day activities, like understanding the instructions on medication bottles and interpreting weather advisories. Learn more about reading and the other Skills for Success here , and think about the different kinds of reading you do every day, including reading this blog! Did you know that adult literacy programs offer free, individualized training that can help you build all of your Skills for Success, including reading? Contact us to find a program in your area!
By Summer Burton 15 Jun, 2023
The team at Literacy Link South Central (LLSC) has been growing over the past several months. Have you met our new staff and contract team? Please join us in welcoming: Project Manager Carolina Cohoon Carolina joins LLSC bringing years of experience in the fields of education and rehabilitation. Formerly with CNIB Deafblind Community Services, she is an advocate for inclusion and accessibility. We look forward to Carolina bringing her years of experience in public education, developing unique and inclusive programs, and project management to the team! Carolina will be supporting LLSC with a focus on our Skills for Success initiatives - please reach out to Carolina at carolina@llsc.on.ca . Project Manager Jan Gourley Jan brings her professional background in technical support, customer care, business management, operation and Early Childhood Education to LLSC. Jan is a trained Roots of Empathy instructor, MindUp curriculum educator, and Registered Early Childhood Educator who will be supporting LLSC with a focus on our Pathways into a Child Care and Early Years Career project. Please contact Jan at jan@llsc.on.ca . Program and Partnership Developer Rick Townend Rick joins LLSC with extensive experience in education serving school boards and post-secondary institutions across Ontario, most recently as an Academic Advisor and Consultant at Fanshawe College’s School of Access Studies. Rick truly demonstrates a passion for helping people achieve their goals, and his energy, vision and partnership development skills will be a great addition to our team! Please reach out to Rick at rick@llsc.on.ca . Marketing and Communications Specialist Sherry Lippincott Sherry brings years of content development, graphic design, social media management, marketing, and documentation experience to LLSC. She has a passion for producing quality communications, editing copy, and thinking of new ways to express ideas and concepts. Sherry will be supporting all of LLSC's projects, and will take a lead on our social media, marketing, and promotional initiatives. Please contact Sherry at sherry@llsc.on.ca . We are excited that our team is continuing to grow, and look forward to working with these excellent staff members in the year ahead! 
By Summer Burton 12 Jun, 2023
The Skills for Success are the nine skills the Canadian government has identified everyone needs to be successful in work, learning and life. Today we're look at another one of the Skills for Success: Problem Solving . According to the Canadian government, we use identify and think about a problem, come up with solutions, and make decisions. Problem solving helps you to address issues, monitor success, and learn from the experience. For example, we use this skill to decide what tool we need for a job, how to fix things that aren't working, and how to get through a conflict with another person. Learn more about problem solving and the other Skills for Success here , and think about all of the problems you've solved recently. If you still have problems you'd like to solve, or you'd like to build your writing, digital, math, creativity, reading, and other Skills for Success, Ontario's adult literacy programs offer free, individualized training that can help. Contact us to find a program in your area!
By Summer Burton 30 May, 2023
The Skills for Success are the nine skills the Canadian government has identified everyone needs to be successful in work, learning and life. Today we're continuing our look at the Skills for Success by talking about Numeracy . According to the Canadian government, numeracy skills are used to find, understand, use, and communicate mathematical information presented through words, numbers, symbols, and graphics. For example, we use this skill to perform calculations, manage budgets, analyze data and make estimations. Many jobs require the ability to work with numbers and math, and we use it in our lives at home too. Learn more about numeracy and the other Skills for Success here , and think about the different ways you use math in your daily life! Did you know that adult literacy programs offer free, individualized training that can help you build all of your Skills for Success, including numeracy? Contact us to find a program in your area!
Show More
Share by: