• Print

Scientist in Residence Activities

Clayton Lewis, PhD, Professor of Computer Science, University of Colorado Boulder, has served since 2005 as the Institute's Scientist in Residence, helping to ignite the Institute’s Cloud Computing initiative, among other things. He is currently on leave from the Institute and is helping to develop an initiative in cloud computing for people with disabilities at the National Institute on Disability and Rehabilitation Research (NIDRR).

The role of the scientist in residence is to identify and support the most promising efforts in shaping mainstream technology to serve the interests of people with cognitive disabilities. Current efforts are centered on the following areas:

  1. Workshops on cognitive technology
  2. Encouraging student projects in cognitive technology development
  3. Cognitive accessibility on the World Wide Web
  4. Personal mobile platforms
  5. Vocabulary enhancement
  6. Social software
  7. Dissemination through presentation and publications

Workshops on Cognitive Technology

The Scientist in Residence office has organized a series of workshops, held in conjunction with the Coleman Institute Annual Conferences, at which leaders in the field of accessible technologies meet to share ideas and to shape a cooperative agenda for research, development, and advocacy.

2011 - Implications of Cloud Computing for Residential Supports and Community Services

On October 12, 2011, a roundtable on “Implications of Cloud Computing for Residential Supports and Community Services” was held with invited leaders from industry, higher education, information technology, public policy, and disability, as well as self-advocates, family members, providers of disability services, and directors of federal government agencies. The discussion explored how cloud computing could support the development of innovative, inclusive, comprehensive, and cost-effective residential supports and community services for people with cognitive disabilities. The roundtable participants were charged with framing an agenda that would allow policy makers, industry leaders, and disability advocates to explore how cloud computing could provide strategic opportunities to improve the lives of people with disabilities and their families and whose realization would generate partnership opportunities and address public policy issues. A whitepaper summary of the roundtable is available online here.

2010 - Implications of Cloud Computing for People with Cognitive Disabilities

In 2010, two events were held to discuss the implications of cloud computing technology for people with cognitive disabilities. On July 30, 2010, the Coleman Institute for Cognitive Disabilities in partnership with the Silicon Flatirons Center for Law, Technology, and Entrepreneurship hosted a roundtable on “Cloud Computing and Disability Communities: How Can Cloud Computing Support a More Accessible Information Age and Society?” The roundtable brought together leaders in industry, education, public policy, disability advocacy, and government to explore emerging opportunities and challenges presented by “cloud computing, ” specifically how it might help or hinder a more “accessible” future for people with special access needs. A whitepaper summarizing the event is available online here.

The 2010 workshop was held on October 20, 2010, in partnership with the Silicon Flatirons Center for Law, Technology, and Entrepreneurship, with the theme, “Implications of Cloud Computing for People with Cognitive Disabilities.” The workshop brought together leaders from industry, education, public policy, disability advocacy, and government with a shared interest in shaping our national infrastructure for computing and communication to explore opportunities for improving the lives and increasing the independence of people with disabilities, particularly those with cognitive disabilities. The program began with introductory presentations on cloud technology, cognitive accessibility, and policy considerations, followed by interactive panel discussions on technical directions; the potential benefits, opportunities, and challenges of cloud computing from the viewpoint of people with disabilities, families, caregivers, and advocates; and legal and regulatory barriers to accessibility technology in “the cloud.” Presenters included leading figures from industry, academe, government, and advocacy organizations. The workshop agenda is available online with session video recordings, audio recordings, and presentation slides.

2009 - Web Technologies for People with Cognitive Disabilities

A summary of the 2009 workshop on “Web Technologies for People with Cognitive Disabilities” is available online and as a PDF file. The workshop explored emerging research projects, industry developments, and international standards and practices that have the potential to support inclusive and accessible Web technologies for people with cognitive disabilities. Participants were charged with identifying the best of what they knew, to explore new ideas, and to allow a forward-looking free flow of ideas and discussion. The workshop reviewed recent technology developments and projects promoting universal Web accessibility including the “Raising the Floor” initiative, HTML 5, and the Web Content Accessibility Guidelines. Workshop participants agreed to continue discussion, debate, and exploration of collaborative activities in a newly formed Raising the Floor Cognitive Language and Learning Discussion Group.

2008 - Mobile Technologies and Web Accessibility

A summary of the 2008 workshops on mobile technology and the Web is available online. Results were presented in a panel at the CSUN 2009 conference by Lewis, David Dzumba (Nokia), Michael Paciello (The Paciello Group) and Gregg Vanderheiden (TRACE Center). A presentation focussing on mobile technology was presented at RESNA and at the HCII Conference in July 2009.

For information about participating in future workshops, please contact jeffery.hoehl@colorado.edu.

Encouraging Student Projects in Cognitive Technology Development

Students have much to offer in shaping technology to increase independence and improve the quality of life for people with cognitive disabilities. Coleman Institute for Cognitive Disabilities Design Awards Program offers recognition to students who carry out projects of this kind. Undergraduate and graduate students are eligible and must be working on such a project in a technical, engineering or social impact course or independent study. One such course was offered at the University of Colorado Boulder, with Institute support, and focused on developing applications for the Google Android platform. Projects included a word finding therapy application for people with aphasia, and a calendar system offering remote management by family and caregivers.

Coleman Institute Announces First Student Design Award

The Coleman Institute for Cognitive Disabilities is pleased to announce that Joshua Hailpern, a doctoral student at the University of Illinois at Urbana-Champaign, will receive a "Gold" Student Design Award for his research project called the " Aphasia Characteristics Emulation Software [pdf, 473k]" or ACES. ACES is a software system that allows students, caregivers, and Aphasia therapists to understand some of the problems which face people with Aphasia when trying to communicate with others. Aphasia is an acquired language disorder that results in difficulty producing or comprehending spoken or written language, and affects approximately 1,000,000 people in the United States. The Coleman Institute for Cognitive Disabilities established a Coleman Institute for Cognitive Disabilities Design Awards for Technologies to Benefit People with Cognitive Disabilities to encourage, recognize and reward group and individual student projects that result in technical prototypes, or a vision of future technologies, to enhance and support the cognitive function and adaptive behavior of people with cognitive disabilities.

Cognitive Accessibility on the World Wide Web

The Web has become a critical channel for information, participation, and services of all kinds. The Institute advocates support for people with cognitive disabilities in their efforts to utilize technology. One effort has been to provide specific input about regulations and standards to such groups as the Telecommunications and Electronic and Information Technology Advisory Committee (TEITAC) of the US Access Board, the Web Content Accessibility Guidelines (WCAG) of the World Wide Web Consortium, and the Accessibility Directorate of Ontario. Lewis contributed to the drafting of a policy statement by the Association for Computing Machinery calling for enhanced Web accessibility that was adopted in 2008.

The Institute is participating in the Raising the Floor Initiative, an international effort to build needed accessibility into the fabric of our information infrastructure, including the Web and mobile technology, led by Gregg Vanderheiden and Jim Fruchterman. Lewis is serving as lead for the Working Group on Cognition, Language, and Learning. Please email clayton.lewis@colorado.edu if you would like to participate.

Lewis has also participated in the Fluid Project, a family of interrelated Web technology efforts aimed at enhancing the accessibility of Web applications for higher education and museums. The Fluid Project, directed by Jutta Treviranus, has been funded by the Mellon Foundation.

Personal Mobile Platforms

The communication facilities of the mobile phone and the computer are blended in a new class of powerful handheld devices. The Institute has supported a number of initiatives that are related to these emerging technological breakthroughs. These include ChatPC Communicator, a prototype that links Saltillo Corporation's ChatPC communication aid to a Nokia phone, and a project course at the University of Colorado Boulder in which students developed applications for the open-source Android smart phone platform. Student projects included a mobility aid, a reminder system with remote caregiver input, a location-aware prompting system, and a naming practice tool for people with aphasia.

The naming practice project has produced a prototype called Banga that communicates with a therapist's Web site that allows therapists to manage clients' practice remotely. Developed in cooperation with Prof. Gail Ramsberger of CU's Department of Speech, Language, and Hearing Science, and with students from CU and from Jackson State University, with support from the National Science Foundation, Banga is described in presentations at the 2008 ASSETS Conference in Halifax, Nova Scotia, and the 2009 ASSETS Conference in Pittsburgh. A technical talk at Google on the work on mobile technology is available online. Current work is readying Banga for deployment as an HTML5 application, usable on any phone or other platform with a compatible Web browser.

Vocabulary Enhancement

Lewis serves as co-PI of the Rehabilitation Engineering Research Center for the Advancement of Cognitive Technologies (RERC-ACT), directed by Dr. Cathy Bodine of the Department of Rehabilitation Medicine of the University of Colorado. The institute co-sponsors the Center's project aimed at enhancing job-related vocabulary for people with cognitive disabilities. Lewis leads this project with Dr. Thomas K. Landauer of the University of Colorado and Pearson Knowledge Technologies. Dr. Landauer is one of the creators of Latent Semantic Analysis, a technique for analyzing language use, which provides the foundation for the vocabulary enhancement project.

Social Software

Social networking systems like Facebook potentially offer great benefit to people with disabilities, enabling them to stay in touch with friends and family. With institute support, Lewis and graduate student Jeffery Hoehl are beginning a survey study of social networking participation by people with disabilities. The results should indicate whether existing social networking systems are providing adequate support, or whether enhanced designs are needed.

Dissemination Through Presentation and Publications

Presentations

  • Lewis, C., Sullivan, J., and Hoehl, J. (2009) Mobile Technology for People with Cognitive Disabilities and Their Caregivers - HCI Issues. HCI International 2009, San Diego, CA, July 23, 2009.
  • Lewis, C. (2009) Accessibility and Assistive Technology on Smart Phones. RESNA 2009 Annual Conference, New Orleans, June 26.
  • Lewis, C. (2009) Symposium Wrap Up and Next Steps. Panel presentation, RESNA 2009 Annual Conference, New Orleans, June 26.
  • Lewis, C. (2009) Mainstream Information and Communication Technology and People with Cognitive Disabilities: An Agenda. Panel presentation, CSUN 24th Annual International Technology and Persons with Disabilities Conference, Los Angeles, March 19.
  • Lewis, CH. Frontiers in Cognitive Accessibility and the Web. Association of University Centers on Disabilities Annual Conference, Washington, DC, November 10, 2008.
  • Lewis, C. Smart Phones for People with Cognitive Disabilities: Some Current Projects. In Workshop on Options for Accessing Telephones for People with Disabilities, RESNA Annual Conference, Arlington, VA, June 28, 2008.
  • Lewis, C. Cognitive Technology on a Mobile Platform: Android Applications. Google Tech Talk, Mountain View, CA, May 27, 2008. Recording available at http://www.youtube.com/watch?v=2U_iDtA0LA0.
  • Lewis, C. and Vanderheiden, G. Designing Web Content that is Accessible To Users With Cognitive Disabilities. Webcast by National Center on Disability and Access to Education, May 7, 2008.
  • Lewis, C. Mobile ICT for people with cognitive disabilities. Joint ITU-T & G3ict Forum 2008: The Convention on the Rights of Persons with Disabilities: Challenges and Opportunities for ICT Standards, Geneva, April 21, 2008.
  • Lewis, C. Building accessibility into higher ed software: The Fluid Project. Accessing Higher Ground Conference, Boulder CO, November 8, 2007.
  • Lewis, C. Student Software Projects in Accessibility. STARS Alliance Celebration, UNC Charlotte, August 14, 2007.
  • Clark, C. and Lewis, C. An introduction to the Fluid project. JA-SIG Summer Conference, Denver, June 25, 2007.
  • Lewis, C. Cognitive accessibility on the Web. Alliance 2007 June Summit, Colorado Communities United for People with Developmental Disabilities, Vail, CO, June 20, 2007.
  • Lewis C. Advancing cognitive technology. National Assistive Technology Technical Assistance Partnership (NATTAP) Annual Conference, Denver, May 22, 2007.
  • Lewis C. Cognitive challenges and mobile technology. Nokia Innovation Summit on Accessibility, Batvik, Finland, April 11, 2007.
  • Lewis. C. Cognitive impairment and accessibility. Presentation to TEITAC (Telecommunications and Electronic and Information Technology Advisory Committee of the US Access Board), Washington, DC, February 7, 2007.
  • Bohman, P. and Lewis, C. Cognitive disabilities and the web: What we think we know. Webcast by National Center on Disability and Access to Education, January 31, 2007.
  • Lewis, CH. Cognitive assistive technology. IEEE Engineering in Medicine and Biology Society, Denver Chapter, November 2, 2006.
  • Lewis, CH. Including people with cognitive disabilities in user testing of technology (with Cathy Bodine and Edmund LoPresti). Workshop, RESNA, Atlanta, June 26, 2006.

Publications

  • Lewis, C. (2009) Cognitive disabilities. In C. Stephanidis (Ed.) Universal Access Handbook, CRC Press, 7.1-7.10.
  • Chandler, S., Harris, J., Moncrief, A., and Lewis, C. 2009. Naming practice for people with aphasia as a mobile web application. In Proceedings of the 11th international ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, Pennsylvania, USA, October 25 - 28, 2009). Assets 2009. ACM, New York, NY, 247-248.
  • Lewis, C., Sullivan, J., and Hoehl, J. 2009. Mobile Technology for People with Cognitive Disabilities and Their Caregivers --- HCI Issues. In Proceedings of the 5th international Conference on Universal Access in Human-Computer interaction. Addressing Diversity. Part I: Held As Part of HCI international 2009 (San Diego, CA, July 19 - 24, 2009). C. Stephanidis, Ed. Lecture Notes In Computer Science, vol. 5614. Springer-Verlag, Berlin, Heidelberg, 385-394.
  • Lewis, C. and Menn, L. 2009. Access Tool? Accelerating Treadmill? Technology and the Aging Population. In Proceedings of the 5th international Conference on Universal Access in Human-Computer interaction. Addressing Diversity. Part I: Held As Part of HCI international 2009 (San Diego, CA, July 19 - 24, 2009). C. Stephanidis, Ed. Lecture Notes In Computer Science, vol. 5614. Springer- Verlag, Berlin, Heidelberg, 263-268.
  • Lewis, C. (2008) Cognitive and learning impairments. In S. Harper and Y. Yeilizada (Eds.) Web Accessibility: A Foundation for Research. Springer, 15-24.
  • Benjamin, C., Harris, J., Moncrief, A., Ramsberger, G., and Lewis, C. 2008. Naming practice on an open platform for people with aphasia. In Proceedings of the 10th international ACM SIGACCESS Conference on Computers and Accessibility (Halifax, Nova Scotia, Canada, October 13 - 15, 2008). Assets 2008. ACM, New York, NY, 265-266.
  • LoPresti, E., Bodine, C., and Lewis, C. (2008) Assistive technology for cognition. IEEE Engineering in Medicine and Biology Magazine, 27,2, 29-39.
  • Lewis, C. (2007) Simplicity in cognitive assistive technology: A framework and agenda for research. Universal Access in the Information Society, 5, 4, 351-361. Online at http://www.springerlink.com/content/881h660p6u1766h4/
  • Lewis, C. (2006) HCI and cognitive disabilities. interactions 13, 3 (May. 2006), 14-15.
  • Lewis, C. (2005) HCI for people with cognitive disabilities. SIGACCESS Access. Comput., 83 (Sep. 2005), 12-17.
  • Lewis, C. (2005) Bridges for the mind: Opportunities for Research on Cognitive Disabilities (Abstract). Invited plenary paper, In Proc. Assets 2005, Seventh International ACM SIGACCESS Conference on Computers and Accessibility, New York: ACM, p 1.