By going through this process our team got visibility on how inexpensive was performing the heuristic review, and how, the dashboard was a good tool to sell the concept to other stakeholders. Since I implemented the Google Sheet below, NewsCorp has adopted it as part of their "Business as Usual" quality assessment for some of their other products.
Almost straight after I first joined News I performed a Pragmatic Usability Review by Experts (aka as PURE), and led the effort with two other UXers in the team. This helped us identify showstoppers early in the process, and adhere to UX best practices.
The process started by defining the most important workflows in News Connect; in this case:
And then defining the golden-path steps that would allow the user to accomplish the task successfully.
Sign in to news connect
2 steps
Create a lookalike segment
9 steps
Build a target audience
7 steps
Book a marketing campaign
6 steps
Each step then would three experts would assess each step assigning 1, 2 or 3 friction points according to the following criteria.
<aside> ✅ The step can be accomplished easily by the target user, due to low cognitive load or because it’s a known pattern, such as the acceptance of a terms-of-service agreement.
</aside>
<aside> ⚠️ The step requires a notable degree of cognitive load (or physical effort) by the target user, but can generally be accomplished with some effort.
</aside>
<aside> ⛔ The step is difficult for the target user, due to significant cognitive load or confusion; some target users would likely fail or abandon the task at this point.
</aside>