IA Summit:"How Do You Make the Good Great? A Case Study on Redesigning the University of Michigan Medical School Website"
•Download as PPTX, PDF•
2 likes•694 views
Presentation at IA Summit 2017 in Vancouver, Canada. Video: https://blueprintdigital.com/ia-summit-2017/kelly-davenport-jackie-wolf/ After a major overhaul three years ago, the University of Michigan Medical School’s flagship website for prospective students was getting glowing feedback. Great news, right? But … now what? What comes after “good”? This talk presents a case study of how we dug in to a new round of user research to deepen our understanding of the application journey of prospective medical students and present the next iteration of an already successful site. With the journalist’s question of “what did you know, when?” we mapped the information-seeking behavior of prospective students, and learned how the lens of time could give us new insights into how to organize and present information to users.
Recommended
More Related Content
Viewers also liked
Viewers also liked (8)
Similar to IA Summit:"How Do You Make the Good Great? A Case Study on Redesigning the University of Michigan Medical School Website"
Similar to IA Summit:"How Do You Make the Good Great? A Case Study on Redesigning the University of Michigan Medical School Website" (20)
More from Jackie Wolf
More from Jackie Wolf (20)
Recently uploaded
Recently uploaded (20)
IA Summit:"How Do You Make the Good Great? A Case Study on Redesigning the University of Michigan Medical School Website"
- 1. HOW DO YOU MAKE THE GOOD GREAT? A Case Study on Redesigning the University of Michigan Medical School Website
- 2. KELLY DAVENPORT IT Project Manager, Michigan Medicine JACKIE WOLF Web Project Manager, Michigan Medicine
- 3. ANCIENT HISTORY (circa 2012) ● Static HTML. ● So many menus! ● Who’s the audience?
- 4. ANCIENT HISTORY (circa 2013) ● We love Drupal! ● Responsive design. ● Cleaned-up architecture. ● Focus on prospective students.
- 5. “ In all, I think Michigan absolutely excels compared to other schools in the organization of their website, updating statistics regarding the admissions process, and being available via social media. — Prospective Student
- 6. “ This is the best website out of the 25 or so schools that I applied to. — Prospective Student
- 8. Now What?!
- 9. WHAT DOES ‘BETTER’ LOOK LIKE? Get Back to Business Find a Focus Travel to a New Dimension
- 11. Insiders / Outsiders Image: M.C. Escher, lithograph, 1948
- 12. It’s never just a carousel. Image: Sigmund Freud by Max Halberstadt, 1921
- 13. Did Someone Say Redesign? Image: The Scream, 1893, Edvard Munch
- 17. Find A Focus 2
- 21. @umichmedschool
- 22. How did you prepare for interviews? Did you go back to the website after your acceptance offer? How did you decide where to apply?
- 23. Enter your MCAT & GPA Your LizzyM score
- 25. WHICH MICHIGAN? Images: Marcin Szczepanski (l) and Leisa Thompson (r) for the University of Michigan
- 26. Travel To A New Dimension 3
- 28. Awareness Research Decision Community
- 29. MAPPING EXPERIENCE TO TIME Timeframe Topics Mode of seeking Genre of information
- 30. FIRST LOOK LATER ON …
- 31. OLD REVAMPED!
- 32. 12 UNIQUE CONTENT COMPONENTS 1. Media with Text 2. Application Tracker 3. Metrics Blocks 4. Facts & Figures 5. Contact Us Block 6. Related Content 7. News & Profiles Teaser 8. Top 10 List 9. Social Media Block 10. List of Links 11. Pull Quote 12. Responsive Table
- 33. OLD REVAMPED!
- 34. OUR NEXT QUESTIONS How does the system get used? Effect on student experience? Any change in site engagement?
Editor's Notes
- Hello! I’m Kelly and this is my colleague Jackie. Michigan Medicine is the academic medical center at the University of Michigan. It’s a big place! 25,000-plus employees, including 2,700 faculty. We have a top-ranked medical school with 800 students and a clinical operation that sees more than 2 million clinic visits a year. Today, we want to tell you the story of one of our flagship websites, the main U-M Medical School site, and how used user research to drive improvements to the site. I’m going to be talking about how we worked with stakeholders on this project, and later how we translated our research into design ideas, and Jackie will be sharing on the research process itself. But first, we need to start with a little history.
- This is the Medical School site in 2012, a few months before the launch of a major redesign. This site suffered from what I think is a familiar problem to those of us in higher ed or nonprofit tech -- places where decision-making can be very distributed and consensus-driven, and big, bold changes can take a long time to effect -- and that’s the tragedy of the commons. While our school continued to attract excellent students and to train excellent doctors, its website was a bit of a mess -- thousands of static HTML pages, multiple menus and calls to action, and a muddied focus.
- In 2013, we launched a big change -- moving from static HTML to a modern CMS (Drupal!), introducing a responsive design, and cleaning up the site architecture and its content to be more strongly tailored to our core user group of prospective students, for instance, by adding homepage calls to action based on educational program. What you can’t see from this screenshot is the work we’d been doing behind the scenes to shift the organization to a model of stronger central stakeholder involvement in web projects. In this case, that meant assembling a formal committee of folks from across the institution.
- That fall, we got back responses from a survey of prospective students on the website changes. Here are a few comments from students.
- That probably sounds like a great place to end this story, right, a happy ending?! The users loved it! Mic drop!
- But, there’s no quitting in web design and we knew, about 18 months into the lifecycle of the new site, that we needed to start thinking about what was next … eep!
- So, this is going to be the story of what comes after Happily Ever After. Our story today is in three parts: Part 1: Get back to business. This part of the story is about re-engaging with business owners to identify a direction for the project. Part 2: Find a focus. This chapter is about translating a business need into a user research question on an interesting institutional problem. Part 3: Travel to a new dimension. This last section is about finding a new plane of meaning in which to understand your information architecture.
- So let’s get started with Getting Back to Business. A word for our colleagues in the nonprofit or higher ed world: What do I mean when I say “business owners”? In our organization, with more than 25,000 employees and dozens of departments, centers, and programs, run by thousands of independently minded faculty, it’s not always easy to identify who this may be. I’m talking about the folks who: Have power to make decisions and drive alignment in the org. (Because, let’s face it, consensus is a fact of life for most of us in higher-ed cultures.) Have insight into the strategic vision of the org. Where are we going and how are we trying to get there? Understand how the pieces of the org fit together, and where there are opportunities to collaborate, or where politics may necessitate treading lightly.
- A little background on our team’s role within our org because I think it’s useful context: We’re an embedded creative services team, and we’re one of only a few groups in the entire academic medical center that charges an hourly rate fee-for-service. This gives us an interesting insider-outsider perspective on the org, as we get to be both consultants and boots-on-the-ground workers.
- What we’ve learned in this hybrid role is that ongoing stakeholder relationships are vital to understanding the business needs that are driving requests for web services. Because a carousel is never just a carousel — as Freud might have put it — but may represent our institutional hopes, dreams, and fears. So we’re always digging beneath the surface of a web request to better understand what led to it. By keeping a bit of the mindset of an external consultant, we can stay curious about our own organization and continue to ask good questions that get at underlying needs — this mindset can help us build better products.
- Now, when you go to your stakeholders, it’s easy to forget that maybe not everyone is excited about the prospect of redesigning an enterprise website with dozens of stakeholders and half a million annual users (go fig). In our case, we got a few excited responses, and a few “Um, didn’t we just do this … ?” (Well, technically it was 2 years ago, but who’s counting …) There’s some interesting debate in the field about making incremental improvements (e.g. evolutionary redesign) vs. pursuing big cutting-edge changes, and so I think it’s worth considering what your organizational culture and your team’s resourcing levels can tolerate. One of our tactics for engaging stakeholders ...
- In our case, it helped to call our project a “revamp,” because we really weren’t sure going into it, what the scope would or should be, and we also found that by calling our project a “revamp” instead of a “redesign,” it put stakeholders into a more playful and creative mode, instead of girding their loins for another epic cut-and-paste into a CMS. So to kick off the project, we threw a “revamp” brainstorming party, put on music, fed everyone some good food, and seeded the session by turning our conference room into a gallery of screenshots of beautiful new higher ed sites, screenshots of our competitors’ sites, and images and quotes from our users so we could “hear” from them directly about what they liked and didn’t like about their site experience. Then we got out a tool that we’ve found to be excellent at democratizing feedback and revealing misalignment in a group of stakeholders in a way that doesn’t put anyone in a risky position to be the odd person out (or, on the flip side, the loudest opinion in the room that everyone’s too polite to say they disagree with … )
- This method is called the Performance Continuum, which I learned in a workshop with Dan Klyn from The Understanding Group. The way I explained it to my group of stakeholders was like this: The idea behind Performance Continuums is to set a strategic direction — what before how. (Remember, it’s never just about a carousel, so let’s talk about what are our real business drivers.) In practice, this is an activity that asks you to create a handful of factors that describe what we are trying to accomplish with this project and where we stand today. Key detail: Stakeholders develop these factors together, so they are integrally involved in defining the metrics of success, which means -- cha-ching! -- instant buy-in. Then you place a marker on a scale that represents a desired future state reflecting a successful outcome for the website.
- Among the performance metrics that our stakeholders defined was how we approached content on the site, and a desire to move strongly toward more storytelling and image and video-driven content vs. traditional informational “facts & data” content. This slide shows how we captured stakeholders’ current state assessment (red) and future state desire (green), e.g. where we are / where we want to be. The wonderful thing about this tool is that because opinions become notches on a scale that then are aggregated, the scale naturally reveals where there is alignment -- and where there isn’t. In our organizational culture, this can have a democratizing effect on feedback that is transformative. As a result of this exercise, we identified only 1 of the 5 performance metrics where the group was not strongly aligned, and that led to a fruitful conversation about how to approach the difference of opinion in the remaining area. These exercises also reaffirmed the original principles that animated our first big redesign -- including a strong focus on prospective students, and flexibility for a large team of distributed content managers to be empowered by the CMS structure to publish great content.
- So, with the stakeholders on board, and some idea of what “better” might look like to our committee -- more storytelling and more engaging content presented to our core audience of prospective students -- we got focused on identifying a core use case to explore through research with the goal of learning something new about our users that would inform our next steps as designers. Jackie’s going to tell you more about how we approached the research process.
- We are fortunate that we have great partners at the Office of Admissions who were invested in us doing research to identify the needs of prospective students and how that research could inform design decisions. Kelly and I sat down with the marketing lead from the Office of Admissions who walked us through the Medical School recruiting process and recruiting goals of the school including the types of students they wanted to attract. It was during this meeting that we learned about an interesting recruitment challenge: while a student may receive an offer of admission as early as October, they aren’t required to accept or reject that offer until April. This 7 month window is crucial for the school because this is where the student is making a decision and potentially weighing different offers of admission. So we were curious, what’s happening during this time time gap and does the medical school website factor into this decision making process. So, we did what any good prospective medical student would do: we did a ton of research on applying to medical school and we started here: the guide for medical student provided by the Association of American Medical Colleges or AAMC, which is the governing body of medical schools in the U.S.
- So we started at the AAMC and branched out from there and what we learned: Applying to medical school is both a lengthy and complex process that has a central application process through the AAMC with other deadlines an demands set by the schools themselves. So we took all of the deadlines and mapped out a timeline of the AAMC’s major milestones and added U-M’s deadlines and touch points such as secondary applications and interviews. Doing this mapping allowed us to test our understanding of the process of applying for med school and helped us identify areas and time spaces where we didn’t necessarily understand what was happening
- What you see here is a cleaned up process, and what happens when you have a graphic designer make something nice out of my mess. Remember that 7 month gap between October and April? During this time, the map let us see how interesting that initial questions was, because we were able to see how many other milestones were occurring during this window including financial aid, scholarships, and 2nd look. This timeline also helped us ask better questions of our students during our interviews because we could see both the quantitative (what were you doing when) and qualitative (how did you feel about) parts of the process. We used this timeline to create our research questions of: Do the student’s information needs change over the course of the application process, and if so how?
- So, with a better idea of what question we were trying to answer Kelly and I scheduled interview with 8 first-year med students. We sought out a group of student that could speak to the recruiting goals of the school: in-state, out-of-state, nontraditional, and students who came from traditionally under-represented groups in medicine. Additionally we wanted to interview students who received multiple offers of admission so we could understand what students were weighing between October & April before choosing to come to Michigan. Preparing for the interview we were inspire by the school’s Instagram which is mostly content generated by the students themselves. Looking at these photos was another way to challenge our preconceptions of who our users were. These students did not fit into what I thought of as the type A cookie cutter medical student. These students had diverse background and interests and thru their Instagram account gave us a flavor of the type of culture students are creating as a community of learners.
- Remember that timeline? It was also a great interview prompt. While we initially created it for ourselves with our interviews we used it as a way to talk about what they did and when they did it and it worked well for helping students remember what they were doing during specific parts of the process. We also asked that student bring any of their own application artifacts such as pro/con lists, spreadsheets, and any other decision making artifacts they created during the application cycle. Using the timeline to approach our research question of whether student’s information needs changed during the application life cycle this approach helped us understand: -What information were they searching for? -How much time did they spend with the information? -What questions did they have during different parts of the cycle? -How did they react to or respond to the content they found?
- One of the interesting artifacts exposed by the interviews was something called the “LizzyM Score.” Early on in the process students are narrowing down the list of schools they choose to apply to and the LizzyM helps them do this. During our interviews this was actually a spreadsheet spread via a premed subreddit, but is now a snazzy web app Students use this to compare their academic test scores and GPA to historic data from medical schools so they can see where they have a chance of being admitted. This artifact was interesting: 1. Because it exposed that early thought process during application where students are narrowing down their choices and 2. It shows some very early information filters that students are using before they even apply to med school and even before they look at our website
- Originally we assumed that our medical school website was the center of their application universe, but came to understand that we were just a pale blue dot in the universe of information that our users were relying on. Expanding our reference to account for this larger constellation of information sources was a big perspective shift for us.
- Another surprising detail from our interviews was that some of the students had impressions of the university from their time school shopping as undergrads and in some instances that impression clashed with what they were looking for in a med school. Was U-M a big state school known for it’s football team and vibrant undergraduate social scene? Or was it the home for rigorous and top rated professional schools? Of course, it’s both but it’s worth bringing attention to the many facets of an organization’s public persona and how that affects the way your users view your message.
- So we were surprised by a few things, but what did we learn? Well we found ourselves increasingly returning to the lens of time as a new places of meaning that offered insights for understanding how users experienced the process of applying to school AND understanding how the application timeline lead to information consumption on our website.
- We used the framework of a user or customer journey to analyze our student’s comments and mapped that to this application timeline. This journey mapping gave us a much fuller picture of the application process. Returning to our original research question, it turns out that yes, student’s information needs changed over time and there were commonalities in the genres of information that they found compelling, especially at the beginning of the process.
- Early in the process quantitative data such as school rankings and data that allowed students to do snapshot comparisons of schools was sought after during the awareness and research phases (remember they are applying to 25-30 schools). However, that snapshot was less important during their decision making and commitment phases. Instead then they wanted qualitative data such as a school’s learning philosophy and how their interests and voices were incorporated into the school’s culture. They wanted to know if they could see themselves here and they wanted information that would allow them to feel like a part of the community before they arrived here.
- Taking our timeline and user information we looked deeper into these phases of the customer journey to see where their information needs intersected with our website. That analysis broke down into 4 components: -Time: in blue, which is when they were visiting the site -Topic: in pink, what information they were seeking -Modes of seeking: in yellow – were they skimming, comparing information, doing a deeper dive -Genre of Information: in green – metrics, infographics that would map to that mode of seeking As a lens, time gave us a new dimension to consider for our research: -It made us think about the opportunities to improve site engagement during certain times when students were reading more deeply and wanted more qualitative information -Allowed us to see constants that time places on our students, including how much time they have to interact with our site – are we putting information into the best form for it be consumed. The next step here was to turn these opportunities and constraints into a strategy and components of a website.
- And this seems completely obvious in retrospect, but we also discovered by using the lens of time is that students were retaining information along the way — each time they came back to the site, they might have a different information need and be looking for different information. In other words, while it might be helpful to see prominent school rankings on a top landing page early in the process, that information was old news -- even taking up valuable real estate — later in the process. This was a lightbulb moment for our design process, as we started thinking about how to design our CMS to offer a flexible information hierarchy that could serve up chunks of information in appealing genres based on what we knew about changing patterns of use during admissions. If we could make the CMS more flexible, we could empower content managers to make more choices about what to emphasize when, and provide more actionable and appealing information throughout the cycle. In the wireframes here, you can see a “first look” admissions landing page and a “later cycle” version of the same page, where we envisioned how modular chunks of content could be swapped in or out to emphasize different kinds of information.
- Another detail from our user research inspired us to reframe the way we presented the student profile content on the site, a series called Points of Blue. With the understanding from our user journey model that students were returning to the site later in the application process in part to assess school culture, we redesigned the presented of the content to better showcase the faces and individuals being profiled. You can see the old site on the left and the new one on the right.
- In all, we designed approximately 12 modular content components for the new site, which launched in January of this year. For our fellow Drupal nerds, I’m happy to talk your ear off about how we implemented this system in the CMS. So find me later :)
- Here’s one more before-and-after showing our old Admissions Timeline page and our new one. The MD Admissions Timeline page used to be a brief month-by-month overview of the process and then a “subway map”-style graphic that explained all the steps in the process. We worked with marketing to combine the content into a more robust month-by-month timeline page that re-integrated the timeframe with the milestones so it was more clear what an applicant could expect, or needed to do, and when.
- We launched the site in January of this year, and our story’s not over yet! A few of our next questions include: We built the CMS to be flexible enough to allow content managers to switch the information around easily based on what students are interested in at different times -- but in practice, we don’t know yet how this will play out. It’s certainly more work to follow this more tailored approach! We’ll get some feedback as part of the Medical School Choice Survey, which prospective students fill out at the end of the application cycle. We’ll be able to compare year-over-year site analytics to see if there are any changes in site engagement for critical windows in the cycle.
- Thanks also to our wonderful team at Michigan MultiMedia!