Poster image for this article
Source: waterhauler via Reddit

Considerations for Search

Share this post:

When I get asked to add a search functionality to a web-based project, my immediate answer in the form of a question is, “What are you considering for searching?”

Let me tell you a story, an amalgamation of true stories while growing up. Let’s call the story “The Green Notebook Quest.” I was a young kid, in a hurry to go to school (almost always), and I couldn’t find my school notebook (almost always). And the exchange between me and my mother went something like this (almost always):

Me: Ma, I can’t find my notebook!
Mom: Which notebook?
Me: The green notebook. I had it on the desk by the computer.
Mom: I tidied your desk. It was so messy. I put the books on the shelves in your room. Look there.
Me: Which shelf? I’m looking and I can’t find it!
Mom: The shelf next to the cabinet. I put it next to your textbooks.
Me: (frustrated) That’s not the green notebook. It’s green, but not the one I’m looking for! A smaller book. And it has a cat sticker on it. I need it for my Math homework.
Mom: There are two shelves. Check the other shelf!
Me: (flipped through books on the other shelf) I am, and I still can’t find it!
Mom: (walked into my room) Did you look everywhere on the shelf?
Me: Yes!
Mom: (reached for a green notebook with cat sticker, on the shelf) Is this the notebook?
Me: It wasn’t there when I went through that shelf. I swear I checked it! It wasn’t there a minute ago!
Mom: (held it up to my face) That’s because you’ve been looking for it with your nose.

We all know this story. We’ve experienced this at least a few times in our lives, and it is to show that many Moms (or Dads) are the best search and analytics engine. So why am I telling you this story?

Search functionality can be complex, and search UI and UX can be complicated. To help design and develop the search feature, we need user stories and diagrams, and to lead us to these deliverables, we should ask a few guiding questions. Let’s consider that universal story again to help us deconstruct and reassemble our approach to search functionality.

Who am I: Who is the user?

The persona of the user will guide us in deciding what the principle of least astonishment is for the sets of users, and inform us how we should design the UI and UX for the search functionality. What can we assume about their experience with web searching? What is the basis of our assumptions? What devices do they use? Will, or should search be available on all devices? Knowing the persona will lead us to what, where, and how the users would want to search for things.

What is the user searching for?

To put simply, the user is searching for an object. But what attributes define the object? Are there relationships with other objects? Are these relationships relevant to the search? In “The Green Notebook Quest” story, the object that I was looking for can initially be broken down as follows:
type: notebook
color: green

And as it turned out, there was more than one green notebook.

But then, in the midst of frustration, I expanded my query to include other attributes, such as the object’s size (“smaller”), what it’s being used for, or title, (“Math”), and tags (“cat sticker”):

From this example, we see that it is helpful to understand the definition of the object the user is searching for, in any given application, so that we can model the object better and design intuitive UI and UX for that search.

What does the user need search functionality for?

What are the conditions for this functionality: quick search or deeper search? Should it be available everywhere on the site? How does search fit into the overall experience of the site? How does it add to, or impede the user’s learning experience? Is the search functionality a solution to poor information architecture, or a way to address a complex site model? Do we need to track the search patterns? This set of questions can provide insights on what the search should do, anticipate user search patterns, and shape the expected UX around it.

How is search being done?

When we have user stories and requirements written on the search feature, we can now think about how to implement them. What search engines will we use? This blog—CompilED—for example, uses lunr.js because it is a Hugo-generated static site with a small dataset, and we decided that full-text search is good enough. For the mapping project Writ Large —a Django project with a manageable size of dataset—we use Django PostgreSQL search tools that came with the framework. For another Django project, Footprints, we decided to go with Solr because there are thousands of records to go through an we wanted a much more robust faceted search.

However, considerations for search don’t simply stop with the technology choice. Let’s go back to “The Green Notebook Quest.” The search was a two-step process. Initially I did a simple search, then I filtered the results with certain parameters.

Initial query "green notebook"
---------------
Filter by:
    size: "small"
    tag: "cat"
    usage: "math"

But wait, the initial query can be broken down further to a two-step process:

Initial query:
    q1:
        type: "notebook"
    q2:
        color: "green"
---------------
Filter by:
    size: "small"
    tag: "cat"
    usage: "math"

So now, we have to decide how to design the UI and UX around this search pattern. Can we assume that the user has a certain knowledge of superuser searches so we can condense everything into one search field, i.e. type:notebook AND color:green AND size:small etc? Or should we design an elegant search interface that appeals more to the user’s intuition?

We did the latter for Footprints search. The user begins the search with a keyword, and the after the initial step, the user can narrow the results with a set of filters.

Where is the user searching?

There may be instances where we set limits to user searches, for example, search only published or public records if user is not an admin. What fields or attributes are being exposed to the search? Users may want to set their own limits to the search as well. The latter case can also be thought as a facet of the search. The areas of search in “The Green Notebook Quest,” for example, were “shelves by the cabinet in my room,” and my mother and I were allowed to look for all objects on the shelves.

Why is this important? As always, for UI, and UX.

Who can see what the user is looking for?

Sometimes, we want to hide certain search results based on user roles. Only editors will see unpublished articles, for example. This type of decision needs to be included in testing so we can be certain that a zero match is indeed an intended match.

In “The Green Notebook Quest,” my mother and I had the same access to the books on the shelves. We both should be able to find the notebook. Yet, I didn’t find it, but my mother did. So, what gives?

How can the user see what the user looking for?

We ask this question so we can design the search result page. Should the results page be separate? For Footprints, we decided to show all records at first, and then show only those that match the search queries. This blog’s simple search displays resulting posts in a pop-up panel. In Writ Large, all location pins that don’t meet the search criteria are dimmed on the map instead of hidden.

The result from the user’s search, does it match what the user is looking for?

The search implementation is incomplete without this verification, and we do this through testing. Write a test. We set up a search against a known set of data. We test using different search parameters. We test it against different user permission levels. Test, verify, and so on.

When I couldn’t find the notebook in “The Green Notebook Quest,” my mother stepped in to verify my results. Mom-test yielded a different result (she found the book), and a feedback was given to me directly (don’t find things with your nose).

To summarize…

The search feature is not just about the engines looking for things in the database. Search begins with the user’s intention, and it revolves around the user’s expectations in searching. The search experience should be intuitive, as well as informative. I hope the questions here can serve as a starting guide to a better search design.

So, what does the “The Green Notebook Quest” look like in context of search functionality?

The model for anything on the shelf in my room is defined by type , color, title, tag, size, width, and height.

The users are:

user1: "Mom"
        permission: "Admin", "User"
user2: "Me"
        permission: "User"

The search is the following:

Initial query:
    q1:
        type: "notebook"
    q2:
        color: "green"
------------------------------
Filter by:
    size: "small"
    tag: "cat"
    usage: "math"
------------------------------
Areas of search: shelf1 by cabinet, shelf2 by cabinet
------------------------------
Test & verify: Mom-test
Exception thrown: "Don't find things with your nose"
End of this article.

Printed from: https://compiled.ctl.columbia.edu/articles/searching-1/