A gif of a bee flying around

Grace Hopper

Design Research | UX/UI
Project Overview
In the summer of 2021, I had the pleasure of participating in an internship at IBM called Patterns. Patterns is an immersive 8-week design education program where interns work on designing solutions for real-world IBM products. Throughout my time in the internship I learned about, and participated in many disciplines of UX design and design research.
Collaborators
I was part of a multidisciplinary team, who came from different education backgrounds like: Communication Design, Cognitive Science, and Informatics.

Chantal Lesley: UX Designer
Gavin Renken: UX Researcher
Drishti Vidyarthi: UX Designer
Nia Page: UX Researcher
Diego Meza Perez: UX Designer
Objective
Grace Hopper was led by a sponsorship team who had developed an Artificial Intelligence tool that had the capability of extracting data from tables and charts and gives the ability for users to ask questions and receive answers in a natural language.
Approach
During the internship we followed IBM's Enterprise Design Thinking Method and conducted several activities to lead us to empathize with our users and design with them in mind.
An image of a group of people on a web call
Introduction

We were initially tasked with a complicated problem statement that my team had a hard time grasping. Working with AI products was something that was new to all of us, and we were not familiar with the terms our sponsorship team were using to describe their product.

A graphic of a problem statement
Enterprise Design Thinking

One of the first things we learned in our internship is that IBM practices Enterprise Design Thinking, an iterative process that is referred to as "The Loop" comprised of three stages:

An infinity symbol with the left side highlighted
Observe

Getting to know users, understanding context,
uncovering needs, getting feedback.

An infinity symbol with the middle highlighted
Reflect

Understanding the team, aligning on intent,
uncovering new insights, planning ahead.

An infinity symbol with the right side highlighted
Make

Exploring possibilities, communicating ideas,
prototyping concepts, driving outcomes.

Thanks to the fact that this is a continuous cycle, it means that you can essentially start at any stage of The Loop. Since we were presented the product without a clear user, and without sponsor users to interview, it meant that we were not ready to start the Observe stage. Luckily, following the method of The Loop meant that we were able to start in the Reflect stage.

A graphic showing the reflect stage
AI Research
Icon for Global Table Extraction

In order to align with our sponsorship team, we needed to understand the AI tool, and its capabilities to be able to move forward.

Global Table Extraction

The ability for an AI tool to pull
data that is typically hidden in tables and charts.

Icon for Natural Language Processing
Natural Language Processing

Makes it possible for a user to communicate
with a machine in the way you would with another person.

Final takeaway: We learned that our AI tool uses Global Table Extraction technology paired with Natural Language Processing, to provide an experience of finding information that is typically hidden in tables and charts by asking the AI tool a question and receiving an answer in a natural language (ex: the way you communicate with Siri or Alexa), which removes the barrier of communication between machines and humans.

A graphic with an updated problem statement
A graphic showing the observe stage
Interviews

After completing the Reflect stage, we felt comfortable moving into the Observe stage of The Loop and continuing forward with conducting some user interviews. Initially, we were told that Data Scientists were potential users for our tool as they typically work with a lot of unstructured data. But after five interviews with Data Scientists, we were uncovering a different story...

A graphic with a quote from an interview
A graphic with a quote from an interview
Pivoting

So now that we understand our tool, after our first few interviews, we realized that our AI tool is not a great fit for Data Scientists and we wouldn‘t be able to alleviate their pain points. From there, we pivoted and looked for other potential users. We had the opportunity to talk to five students from backgrounds such as: 

• Computer Science
• Linguistics
• Statistics
• Business & Economics

While we were able to empathize with them and discovered that they had valid pain points, my team asked what happens to these users once they're done with their studies?

A graphic with a quote from an interview
Pivoting... Again

We felt it necessary to make one more pivot. We were noticing a trend in our students who were business majors. They all had similar pain points that our AI tool could help alleviate. Therefore, we interviewed business professionals from various industries. We had a total of seven interviews that spanned over occupations like:

• Entrepreneurs
• Real Estate Agents
• Senior Audit Managers

A graphic with a quote from an interview
A graphic with a quote from an interview
User Persona

As a team, we felt like we nailed down our target market, and were able to move on and create a user persona.

A graphic with details from a User Persona
Needs Statements

In order to reframe our thinking, we completed a Needs Statement exercise, where we put ourselves in our users shoes and asked what is it that they really need.

Post it with a Needs StatementPost it with a Needs StatementPost it with a Needs Statement
Stakeholders Needs

At this time we were fully aware that our stakeholders have needs as well and that we needed to keep these needs in consideration while designing final outcomes:

Mindshare icon
Mindshare

The ability to raise awareness of the
innovative work done at IBM.

Functionality icon
Functionality

Creating an engaging and enjoyable experience
in the process of data extraction.

User Data icon
User Data

Collect (optional) information from users to target demographics and gauge interest for future iterations of the product.

Hills

Creating Hills is an activity in Enterprise Design Thinking that describes something a specific user is enabled to do through our final design.

A graphic describing an execution from a Hills exercise
A graphic describing an execution from a Hills exercise
A graphic describing an execution from a Hills exercise
A graphic describing the make stage
Sketches

Keeping our Users and Stakeholders needs in mind, we created lo-fi sketches as a base to what our AI tool would look like and how it would function. Being in-house designers, we also needed to make sure that our tool reflected IBM‘s current visual design and utilized Carbon, IBM‘s current design system.

A graphic showing preliminary sketches
A graphic showing preliminary sketches
Prototype

Prototypes may be showcased when product goes live.

Usability Testing

My team was able to conduct usability testing with 5 users, with our biggest takeaways being:

A graphic showing results from a usability test
Experience Based Roadmap

This Enterprise Design Thinking exercise was an opportunity for our team to think big in terms of where we can potentially take the product, and what that would mean for our users.

Icon of a cupcake
Cupcake
  • The ability to learn about the new AI tool through an interactive demo.
  • The AI tool can highlight sections of a pdf with the answer to a question.

What we can provide for our users now

Icon of a birthday cake
Birthday Cake

What we can provide for our users soon

  • The ability to upload their own pdfs and pull information from tables and charts.
  • The AI tool can learn and recommend information to users based on their searches.
Icon of a wedding cake
Wedding Cake

What we hope to provide for our users later

  • The ability to upload and analyze across multiple documents and create a database.
  • The AI tool will allow collaboration amongst teams for industry professionals.
My Impact

For this project, I had the opportunity to work on an interdisciplinary team, and was really allowed to work in every aspect of the project.

I allowed my curious nature to take initiative in deep diving into IBM‘s AI tools and learning more about AI design best practices by completing a Team Essentials for AI learning module.

I uncovered a strength of mine which is having the ability to simplify the complex technology and ideas that were involved in this project, and transform them into easy to understand playbacks providing efficient productivity for the team and alignment with our stakeholder team.

Our project was atypical in the sense that none of our members had previous experience in AI, and our stakeholder team didn't have a clear vision on who their product was for, or on expected deliverables. Our initial prototype was based on my lo-fi sketches, and my team trusted me to develop and craft the storytelling for our final playback which we presented to over 60 IBMers where we were overwhelmed with praise and positive feedback for our clearly delivered playback.

Gif of a woman about to begin a presentation
Graphic showing a quote
Lessons Learned

Being agile and willing to pivot is a great skill. Early on in the internship we were told to fail hard and fail fast. We had no idea how true that advice would be for our team, but it was a great lesson to learn that failure is not necessarily negative, and is part of the learning process.

Being unafraid to disagree with stakeholders, but also being able and ready to back up your thoughts and claims with research. My curious nature lead me to question everything, which greatly helped our team carve the direction for our project, and make recommendations to our stakeholders on how to optimize the tool.

With More Time and Resources

Taking the time with my teammates to do a “show and tell“ of our past projects and our skill strengths at the start of our collaboration would have helped tremendously to ensure easy delegation early on and throughout the project.