Moderated VS Unmoderated Tests in UX Design

Usability tests in online UX Design Education come in two broad categories: moderated and unmoderated.

A moderated UI usability test is when the researcher or you, as a designer, work with the user, either in the same space or online, to take them through the prototype. You ask the questions while the user completes the tasks answers the questions.

In an unmoderated test, the users work by themselves. There is no one there in the room, or in the virtual room, to help them, prompt them, or ask the question in a different way. This really tests the UI design. So, unmoderated tests can be challenging for users, but, equally, can give you really good insight into where those UX challenges are. If the users are struggling to complete the test, then that is a clear indication that something with your solution isn’t quite right, and may need some extra attention.

New Frontiers in Ecommerce: Live Shopping and Community-Building: Live Shopping as a Community Experience

Learn how live shopping and community building can provide you with the information and context needed to enhance your ecommerce shopping experience.

With live shopping, something that is incredibly valuable is understanding your communities on a deeper level. Communities are changing every hour, every minute, and every day.
I think one of the most beautiful things about live shopping events is that you’ll be able to understand what your audience is thinking, what they’re asking from you, and what they’re doing in real-time. In a way, that feels holistic and allows you to put context to the situation.

For example, we had one women’s health brand that used our solution a few months ago. We wanted to understand a little bit more about this customer. People think that live shopping events and live shopping are only for digital-first brands that are innovative and easy to sell. Such as a makeup or skincare company. However, what we’re noticing is that if you can build a community and engage, live shopping is for you.

This brand made use of a lot of our engagement modules. They asked a lot of questions and triggered a lot of polls within the live shopping experience. One of the great takeaways was they found out that 54% of their audience was first-time moms.

Now that not only is insightful information to target the rest of your live shopping event but is helpful for future events and to figure out what kind of products you want to launch later on.

Data is something that I think we’re all a little bit wary of. However, insights, context and information from your community, especially in real-time, really are priceless.

Developing Diversity in UX Design Teams

I think a really important issue when it comes to online UX design education, designing and the design space in general is that design teams themselves are often not diverse. Because of this, I’ve had several experiences when working with design teams where people are designing products and experiences, and they continue to forget about communities of color.

When you think of how many AI-enabled products come out and are unable to detect dark skin, it tells you that throughout the design-thinking process, there was probably no UX or UI researcher, designer or strategist who was a person of color who thought, “We should also be testing folks of color to see how they would interact with this product.”

The Need for Diversity in Imagery

Another thing I think people should be mindful of when designing is imagery and branding—especially when designing an app or a website. A lot of times, for communities of color, we go on a website, and we don’t see ourselves on that website at all. There is no one who thought, “We should diversify our imagery so that people can see themselves in this product.” That absence is something that can also be alienating. It goes against the root of what UX and UI design are: the ability to be empathetic.

The Need for Self-Examination and Reflection

I think that the root of the problem is really the fact that there is a lack of work done within the design space. People need the ability to look at themselves and examine the unconscious biases they have. I think that’s something that needs to be implemented within the design-thinking process in addition to having diverse teams. We want to ensure that the products that we’re coming out with are truly equitable and inclusive.

Frequently, we have these different designs that are coming out. The service, product or experience is not actually effective because the design team is not taking into consideration the actual problem space itself that may be specifically harming communities of color or other marginalized communities. It is not solving the real solution because the act of delving deeper into the nature of the problem was missing from the entire design-thinking process.

The Critical Role of Background Research

In order to make sure that we are really thinking about the full context when it comes to defining the problem space, especially when it comes to working with Black, Indigenous, and communities of color, I always like to stress the importance of first doing background research. What is the historical context? What institutional or interpersonal practices and policies have impacted these communities? This research can be done through currently published journals.

Another essential practice is intentionally connecting with community experts who have a strong sense of what the problem space is. Being able to have that context and not go into defining a problem with a colorblind mentality is really critical when it comes to determining the actual problem.

Diversity in UX and UI Technology

“I remember in 2012, just not being able to use any emojis that were my skin tone. And that’s something that was just the norm. And so I think a really big thing within the design field itself, is something that I call the white default, which is essentially, the norm is viewed as white,” says Jacquelyn Iyamah.

So, you end up with these products like emojis, Band-Aids, self-driving cars, soap dispensers that just don’t speak to communities of color. They specifically don’t speak to folks who have dark skin. Online UX Design Education must be able to be mindful of that as well as be able to, within the design thinking process, continuously question ourselves and our biases. These issues are something that’s really critical to ensure that we’re not designing products that continuously harm.

“The kind of conversation or the kind of arguments against bias that takes place is often a matter of representation. So let me give you a little historical point here. Technologies that we come to use, if and when they’re created within a capitalistic society, then the way those technologies are pursued is usually to cater to the needs of the corporations that are creating it,” says Amir Baradaran.

Kodak is a good example of that, whereby for people of color, you had a hard time being able to actually have good photos because it was never created for BIPOC. Because it was adjusted only to fair skin, who then had better purchasing capabilities, it never even cared to allow for having devices that actually would better capture the reality of our skin colors.

So, for example, when the camera has a hard time recognizing people of color or being able to distinguish between males and females in darker-skinned bodies and faces, obviously, we have an issue. That should be regulated. We should look for a better representation of data, based on which then machines can learn.

Donald Norman and UX Design in the Era of the PC

One of the most valuable parts of online UX design education is the look back at the most innovative UX developments in history.

Moving on to the ’70s and Xerox, Apple, and the PC. This is the era of personal computers. Suddenly, psychology and engineering are merged together, and that evolves into the first graphical user interfaces and the mouse, which was invented by Xerox. Apple, in 1984, develops the Macintosh — the first ever mass-market PC that involved a graphical user interface, a mouse, and a built-in screen.

Now, we arrive to the big, big, big deal of UX design. That is Donald Norman. In the ’90s, Donald Norman was the first ever person to implement the word UX in his job title. He was hired by Apple as a UX architect engineer. He was a cognitive scientist who wanted to evolve what designers had understood up until to that moment as UX. He wanted to evolve that and to expand that into the realm of the physical, including UI and UI design, industrial design, the graphical user interface, the physical interaction, even the packaging.

So, thank you Mr. Norman because, thanks to you, the world now is a better place.

Eliminating Bias in Usability Research

One important thing to consider when you’re planning and preparing for your usability study in online UX design education is how to avoid bias. This is important whether you’re testing a prototype, testing the competition, or even just having a conversation with your users to discover more about their needs how to incorporate that into your UX design or UI design.

You really have to be careful not to introduce your own biases into the conversation. Biases are very broad topics, and there’s a lot of information to learn about them and how to control for them. The easiest way to do that is by working with a diverse team with diverse backgrounds and diverse experiences.

The importance of user testing is that when you are designing, you often come with biases, and those can make their way into your work. When you’re designing for a group of people who are not necessarily you, in your demographic, or even related to things you have an interest in, you’re going to come into it with assumptions that might not be true at all. That means that it’s important to ensure you test the way real uses would actually use what you’re designing.

Getting that sort of data is going to help you to make more educated decisions in your UI and UX, especially when you’re working with a team, each individual has their own assumptions, and you really need something to drive the direction of the design.

Emily Rothschild Covers Phase 2 Product Sketch Expectations

When I’m teaching students, I often treat them like they’re just starting out a project. Later on, once they think they’re further along, I have them complete 30 drawings. I don’t have them complete one or two. They’re not doing five or 10. They’re producing 30 unique sketches.

How do you push yourself to really think past your initial ideas, understandings and assumptions and go beyond and then keep going beyond?

When you start out, whether for an assignment in a product design class or your early career, it’s really hard. You have just a couple of ideas, and you can’t imagine how you can come up with 30 to complete the exercise. But, if you keep pushing, let yourself go and imagine and put some of the thinking and self-editing aside, you find yourself producing some of your richest work. Even your most far-fetched ideas can have real legs and potential.

It’s important to put all of those ideas down on clean paper. Each sketch must be a finished drawing with a title and your name on it too. We actually put all of the sketches up on the wall, and then we walk through those ideas. You need to really understand that sometimes there are groupings and themes within them. There are similarities. There are wild ideas that sometimes generate the best discussions, and students at first push back.

Origin of the Exercise

This design exercise was actually something that a teacher had me do when I was in school. It was one of the few times in graduate school that I stayed up all night worrying. I then realized how liberating it was to create so many sketches and all of the potential that really lives in this exercise. I also recognized how important it was to not require this exercise just once but, instead, a couple of times throughout a project.

Online Product Design Education

You must make sure that you’re always continuing to push forward. I don’t only mean by producing 30 drawings. It can be in other ways. As you will learn in all of your product design education classes, you can improve your chances of having a successful career in the product development field by making sure that you’re always pushing yourself forward and beyond what you first think, the idea you first land on and your first understanding of anything.

Empathy Endurance in Design

At its core, user experience research, design and writing is really user-centered UI design. It comes down to making sure that we’re able to connect and empathize with our users. It’s not just asking surface level questions to understand what features we can build. It’s understanding on a much deeper level the broader context of users and their environments.

How can we build for people? How can we empathize with them? Empathy is something that’s really hard to accomplish. It’s something that a lot of UX and UI professionals like to tout, like to speak about, but it’s something that requires a lot of practice.

Empathy endurance is a really important thing that anyone in UX design should strive to build into their career. It’s more the idea that we can connect with users by going to their environments and meeting them where they are. It’s still really important that after we connect with those users and have those conversations, we have the empathy endurance.

A key piece of online UX design education is learning the ability to bring those conversations and connections back to the product that we’re building. Users need their voices heard by being directly reflected into the products. At its core, it’s empathy. It’s user-centered design, and it’s people. That’s the really beautiful part about UX, whether it’s quantitative research or qualitative research. At its core it’s about people. That’s what makes it so exciting to be part of the UX design process.

Empathy in Design Driven by Research

Our next module in online UX design education is project planning. Project planning is essential to a successful user research stage in the UX design or UI design process. In this module, we will explore how important it is to understand context. Political, social, cultural, and economic factors really have a huge weight in the way that you’re planning your use of research. You will understand how to identify the best format and how to conduct these surveys, interviews or focus groups following ethical guidelines.

Once we have concluded the user research stage, we will have gathered data. This data will be filtered in a way that will allow us to create specific psychographics and demographics, which we call personas. The reason why we call them personas, even though these are fictitious human beings, is that they are based on real data that we obtained through our user research stage.

Calling them personas is to humanize them. By humanizing them, it allows the designer of UX or UI, you in this case, to develop a higher level of empathy with this persona, this fictitious human being character. You will be able to put yourself in their shoes in a much easier manner and be more empathetic and understanding of their needs and how to connect with them. Connection: it’s very important in this process.

Ethnographic Research and Observation in Product Design

Ethnographic research is becoming a key part of our toolbox as designers. This type of research is not necessarily needed for every product development project, but it can be extremely valuable to make sure that you’re still responding to the needs of your market.

The idea of ethnographic research is that you’re going to really dive into a user group or type of user. You’re diving into their lives and the way they actually use your product and incorporate it into their day-to-day activities. You not only engage them and talk to them, but you also really observe the way they live and use your product.

This type of research is very different from a quantitative type of research where you simply ask people questions and analyze their responses. This used to be the main type of research you’d learn about in product design education. The people’s responses would be turned into graphs and heat maps, and you’d learn how to study those.

In today’s online product design education, the focus is going to be on ethnographic research, which is qualitative instead of quantitative. It’s usually done with a very small sample. A group of six to 12 people is a good size. You don’t need to deal with hundreds of people.

The difficult part, when you do ethnographic research, is not the research itself. It’s easy to engage people, extract some information and observe how they use your product and how they live.

The difficult part is to take that observation and turn it into an insight about your product design. That’s where it gets very challenging. We spend a lot of time actually training our team to make that passage from observation to insight.

There’s a lot of secret sauce that takes place during that passage.