[clacking]
Kearney-Volpe: The typewriter, recorded sound,
speech recognition, all of these technologies were originally designed
or greatly improved on by pioneers in accessibility.
By finding solutions for people with unique abilities,
accessibility researchers often end up making technology work better
for everyone.
I'm Claire, and I'm a designer from the NYU Ability Project.
We've been collaborating with Google
and innovators from the disability community
on a project called Creatability.
It's a series of starter experiments
that explore ways we can make creative tools more accessible
using AI on the web.
Each experiment expands creative possibilities
by designing for all kinds of inputs, whatever works best for someone.
Fleet: My name is Chancey Fleet.
I am a technology educator and accessibility advocate.
Sound Canvas enables a non-visual user
to draw on the screen in a variety of ways,
including using a mouse, using a stylus, using arrow keys,
or even using body-tracking technology
and receive immediate real-time feedback about the drawing that they're doing
in the form of sound that is pitched higher on the vertical plane or lower,
and panned in stereo from left to right
so that the individual can develop a real sense
of where they are with their drawing in space.
woman: That is really cool.
[piano notes playing]
Zimmerman: My name is Jay Alan Zimmerman,
and I'm a composer who became deaf.
Seeing music is a way to experience music
through your eyes instead of your ears.
It is a series of tools
that will help you to understand music and musical sounds,
so you're gonna get a sense of volume, emotion, intensity.
I think it's really important that people have access to these tools
so they can start experimenting.
F6. woman: Okay.
Zimmerman: That-- no, you just did it right now.
You did F6.
woman: I can't hear it, but I can feel it.
Kearney-Volpe: We've also been exploring new ways
for people to create music using their head or body.
Farrimond: My name's Barry Farrimond.
I'm a co-founder of Open Up Music,
an organization that empowers young disabled people
to create inclusive youth orchestras.
So Clarion Lite is a introductory musical instrument
to get people started on their musical journey.
It opens up the opportunities to interact with a musical instrument.
It broadens it out from just ten fingers to any part of your body.
By putting that musical instrument online,
we're opening up access to people around the world.
[laughing] I mean, it's an amazing thing.
Phillips: One of the key things that makes all of this possible
is TensorFlow.js, making machine learning algorithms
more accessible to anyone, right in the web browser.
It's all happening on your computer,
so this allows us to not only give you a--
a faster frame rate to make this an enjoyable experience,
a fluid experience,
but it also makes it so that your data is completely private to you.
Kearney-Volpe: Anyone with access to the internet,
a browser, and a web cam
can just click and instantly try these experiments.
These collaborations are really just the beginning.
We're excited to see
how other developers will build on what we've started here.
Fleet: I think it's an-- an open invitation
to the community of developers
to engage with what's already available
and iterate and really move forward the state of the art.
This is a great beginning.
[piano notes playing]
[instrumental music]
No comments:
Post a Comment