New England Machine Learning Accessibility Hackathon

Microsoft New England Research and Development

Join us on Monday, June 11th for a day of Machine Learning for Accessibility! The goal will be to create solutions that promote accessibility and inclusion. Prizes include Xbox One X bundles and $100 Amazon gifts cards. 
Please register to attend and note if you are interested in leading or participating in a specific team. Projects include:
<UL>
<LI>
Data Analytics Tool for parents and therapists using Pathfinder Health Innovations which tracks multi-year behaviors and skill acquisition for children in autism therapy and special education. Led by Leo Junquero & Brent Samodien, Microsoft.
</LI>
<LI>
Neurodiversity Social Chatbot. Led by <A HREF="https://joelsalinasmd.com/" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">Dr. Joel Salinas</A>, Harvard Medical School/MGH and Dr. Jordi Albo-Canals, NTT Data/Tufts University. How do we learn to relate with another person? How do we communicate so we both feel heard, honored, and respected for who we are? How--despite so many barriers--can we connect better? We all struggle with these questions. But for some, these questions feel unanswerable and insurmountable. While there is still no replacement for the all benefits of face-to-face interaction with others, we can begin to overcome this challenge through the thoughtful application of machine-learning to make face-to-face connections easier, better. As featured in <A HREF="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.nytimes.com%2F2014%2F10%2F19%2Ffashion%2Fhow-apples-siri-became-one-autistic-boys-bff.html&data=02%7C01%7Csansmith%40microsoft.com%7Caf582b39f3e04100748408d5aa5b643d%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636602231859012042&sdata=Ob7vyPARbYri%2FI2VBqpRMxo3dTIxyBKUIB8nRQX9LK4%3D&reserved=0" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">this New York Times Modern Love essay</A>, Gus, a 13-year-old on the autism spectrum, learned how to connect better with other people on his own terms with some unexpected help: Siri. Yes, Siri on his iPhone. BIG challenges don't have easy solutions. But if that gets your blood pumping, then let's work together and tackle this epic problem head on!
</LI>
<LI>
American Sign Language: Fact or Opinion Quiz. Led by Danielle Bragg, University of Washington/Microsoft Research, and Dr. Naomi Caselli, Boston University. The ability to distinguish between facts and opinions is an important skill taught in K-12 education. Exercises used in schools are all in English, which is not the primary language of the Deaf community -- American Sign Language (ASL) is. Help us build a tool entirely in ASL that quizzes students on whether content is fact or opinion. The system will both display content in signed ASL, and evaluate answers signed to a camera. 
</LI>
<LI>
ASL Scattergories. Led by Danielle Bragg, University of Washington/Microsoft Research, and Dr. Naomi Caselli, Boston University. Sign language translation lags far behind spoken language translation in large part due to a lack of proper training data. Help us build an online American Sign Language (ASL) scattergories game to help collect a large, labelled corpus of signs executed by diverse signers to boost translation efforts.
</LI>
<LI>
Seeing AI App - improving UPC barcoding identification, particularly on non-flat surfaces. Led by Rob Gallo, Microsoft Accessibility Engineer, and Saqib Shaikh, Seeing AI Tech Lead.
</LI>
<LI>
Aphasia Augmented Language interface tool designed to facilitate word finding when needed without disrupting a conversation. Led by Kristin Williams, Carnegie-Mellon University
</LI>
<LI>
Augmented Screen Reader that uses audio and vibration input/output, using a single website  and creating an easy to navigate, interactive semantic mapping of its contents. Led by Kalli Retzepi, MIT.
</LI>
</UL>
AGENDA 
•   9am: Doors Open, Check-In, Coffee 
•   9:30am: Kick-Off & Team Orientations.Planning
•   12:30pm: Idea Exchange & Lunch 
•   4:30pm: Team Submissions due 
•   5pm - 7pm: Team Presentations, Dinner, Prizes and Awards 
JUDGES:
<UL>
<LI>
<H4>Dr. Meryl Alper, Northeastern University</H4>
</LI>
<LI>
<H4>Dr. Daniel Hannon, Tufts University</H4>
</LI>
<LI>
<H4>Elaine Harris, MIT Hack for Inclusion organizer</H4>
</LI>
<LI>
<H4>Jamie MacLennan, Microsoft Azure ML</H4>
</LI>
<LI>
<H4>Paul Medeiros, President of Easter Seals MA</H4>
</LI>
<LI>
<H4>Jaya Narain, MIT ATHack Cofounder</H4>
</LI>
<LI>
<H4>Dr. Ognjen Rudovic, MIT Media Lab</H4>
</LI>
<LI>
<H4>Dr. D. Sculley, Google Brain</H4>
</LI>
</UL>
 
MENTORS
 
<UL>
<LI>Anastasiya Belyaeva, MIT Institute for Data, Systems and Society</LI>
<LI>Dr. Manohar Swaminathan, Microsoft Research India</LI>
<LI>Dr. Adam Kalai, Microsoft Research New England</LI>
<LI>Dr. Bill Thies, Microsoft Research New England</LI>
</UL>
PRIZES: 1st prize:  Xbox One X bundles. Second prize: $100 gift cards. 
 
Below are the notes to the team leaders and I have a attached a sample email to each of the projects.  Eventbrite with details:  <A HREF="https://www.eventbrite.com/e/new-england-machine-learning-accessibility-hackathon-tickets-44982439688?err=29" TARGET="_blank" REL="noopener noreferrer">//aka.ms/ml4inclusion</A>.
 
Owen – could Sarah be with you when you tape the interviews?  Maybe two team leaders, two judges, and the mentoring? Would that be too many?  
<UL>
<LI>Two of the team leaders could be interviewed at 4:30pm-5pm after their submissions but before their presentations. (Not during the hackathon day)</LI>
<LI>Two Judges could be interviewed during that same time.</LI>
<LI>Could we have the mentors sit together for an interview?</LI>
</UL>
 
Thanks – see you Monday!
Sandra
 
 
<A TARGET="_blank" REL="nofollow noopener noreferrer"></A>Thanks so much again for leading a Hackathon Project on Monday – we are so excited for the event! NOTE:  Please arrive by 9:00am on Monday as we have adjusted the agenda to kick off the teams at 9:30am.
 
Below is the latest hackathon information.  If you are available and interested in a team leaders’ call tomorrow, we will have a quick 30 minute check-in on Friday at 12pm ET.  
 
We currently have over 100 registrations, 7 projects, and 8 judges. All teams will be presenting three items at the end of the day to the judges: 1) their defined challenge and starting point; 2) storyboard describing a “Day in the Life of their user”; and  3) their solution.  Prizes include Xbox One X bundles and $100 Amazon gifts cards.
 
·       PROJECT TEAMS
<OL>
<LI>Data Analytics Tool for parents and therapists using Pathfinder Health Innovations which tracks multi-year behaviors and skill acquisition for children in autism therapy and special education. Led by Leo Junquero & Brent Samodien, Microsoft.</LI>
<LI>Neurodiversity Social Chatbot. Led by <A HREF="https://joelsalinasmd.com/" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">Dr. Joel Salinas</A>, Harvard Medical School/MGH and Dr. Jordi Albo-Canals, NTT Data/Tufts University. How do we learn to relate with another person? How do we communicate so we both feel heard, honored, and respected for who we are? How--despite so many barriers--can we connect better? We all struggle with these questions. But for some, these questions feel unanswerable and insurmountable. While there is still no replacement for the all benefits of face-to-face interaction with others, we can begin to overcome this challenge through the thoughtful application of machine-learning to make face-to-face connections easier, better. As featured in <A HREF="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.nytimes.com%2F2014%2F10%2F19%2Ffashion%2Fhow-apples-siri-became-one-autistic-boys-bff.html&data=02%7C01%7Csansmith%40microsoft.com%7Caf582b39f3e04100748408d5aa5b643d%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636602231859012042&sdata=Ob7vyPARbYri%2FI2VBqpRMxo3dTIxyBKUIB8nRQX9LK4%3D&reserved=0" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">this New York Times Modern Love essay</A>, Gus, a 13-year-old on the autism spectrum, learned how to connect better with other people on his own terms with some unexpected help: Siri. Yes, Siri on his iPhone. BIG challenges don't have easy solutions. But if that gets your blood pumping, then let's work together and tackle this epic problem head on!</LI>
<LI>American Sign Language: Fact or Opinion Quiz. Led by Danielle Bragg, University of Washington/Microsoft Research, and Dr. Naomi Caselli, Boston University. The ability to distinguish between facts and opinions is an important skill taught in K-12 education. Exercises used in schools are all in English, which is not the primary language of the Deaf community -- American Sign Language (ASL) is. Help us build a tool entirely in ASL that quizzes students on whether content is fact or opinion. The system will both display content in signed ASL, and evaluate answers signed to a camera. </LI>
<LI>ASL Scattergories. Led by Danielle Bragg, University of Washington/Microsoft Research, and Dr. Naomi Caselli, Boston University. Sign language translation lags far behind spoken language translation in large part due to a lack of proper training data. Help us build an online American Sign Language (ASL) scattergories game to help collect a large, labelled corpus of signs executed by diverse signers to boost translation efforts.</LI>
<LI>Aphasia Augmented Language interface tool designed to facilitate word finding when needed without disrupting a conversation. Led by Kristin Williams, Carnegie-Mellon University</LI>
<LI>Augmented Screen Reader that uses audio and vibration input/output, using a single website and creating an easy to navigate, interactive semantic mapping of its contents. Led by Kalli Retzepi, MIT.</LI>
<LI>Seeing AI App - improving UPC barcoding identification, particularly on non-flat surfaces. Led by Rob Gallo, Microsoft Accessibility Engineer, and Saqib Shaikh, Seeing AI Tech Lead.</LI>
</OL>
 
AGENDA
<UL>
<LI>9am: Doors Open, Check-In, Breakfast</LI>
<LI>9:30am: Kick-Off & Team Orientations, Planning</LI>
<LI>10am:  Inclusive Design</LI>
<LI>10:30am: Break</LI>
<LI>11am: Final Idea Selection Hacking </LI>
<LI>12:30pm: Lunch and Idea Exchange</LI>
<LI>3:00pm:  Storyboard exercise & submission prep</LI>
<LI>4:30pm: Team Submissions due</LI>
<LI>5pm - 7pm: Team Presentations, Dinner, Prizes and Awards</LI>
</UL>
 
JUDGES
<UL>
<LI>Dr. Meryl Alper, Northeastern</LI>
<LI>Dr. Daniel Hannon, Tufts</LI>
<LI>Elaine Harris, MIT Hack for Inclusion organizer</LI>
<LI>Jamie MacLennan, Microsoft ML</LI>
<LI>Paul Medeiros, President Easter Seals MA</LI>
<LI>Jaya Narain, MIT ATHack Cofounder</LI>
<LI>Dr. Oggi Rudovic, MIT Media Lab</LI>
<LI>Dr. D. Sculley, Google Brain</LI>
</UL>
 
MENTORS
<UL>
<LI>Anastasiya Belyaeva, MIT Institute for Data, Systems and Society</LI>
<LI>Dr. Manohar Swaminathan, Microsoft Research India</LI>
<LI>Dr. Adam Kalai, Microsoft Research New England</LI>
<LI>Dr. Bill Thies, Microsoft Research New England</LI>
</UL>

New England Machine Learning Accessibility Hackathon

More events from Microsoft New England Research and Development

Discover more events from Microsoft New England Research and Development, from Science & Tech to other experiences you might love.

New England Machine Learning Accessibility Hackathon

More events from Microsoft New England Research and Development

Discover more events from Microsoft New England Research and Development, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.