Spaceship · Usability Testing Round 2

4 moderated sessions · Redesigned homepage prototype · Nov 2024

01

Context

Following Round 1 (Nov 2023), a prototype was built to address the primary blockers found — search/transfer confusion, error handling, and discoverability. Round 2 tests whether those fixes worked.

What changed between rounds:

Round 1 revealed that users couldn’t distinguish between search and transfer in the homepage search bar. The redesigned prototype separated these flows, introduced a clearer modal structure, and added a bulk transfer option with CSV upload. Round 2 tested this prototype with 4 participants — same 3 tasks.

Participants 4 ↑ from 3 in Round 1
Tasks completed 11/12 1 blocked by prototype bug
Issues found 4 ↓ from 6 in Round 1
Avg ease of use Easy–Very Easy All tasks, all participants
02

Task Results

3 tasks: find a domain, transfer a domain, bulk transfer. 4 participants: 2 internal (Namecheap), 2 external tech-savvy users.

Task Completion — Round 2

11 of 12 task attempts completed. 1 blocked by prototype bug (not a usability issue).

Ease of Use — by Task

Self-reported by participants (1 = Very Difficult, 5 = Very Easy)

Per-Participant Breakdown

ParticipantProfileTask 1 · FindTask 2 · TransferTask 3 · Bulk
P01 · JBInternal (HR), no domains✓ Very EasyPrototype bug✓ Easy (with difficulty)
P02 · JExternal, owns 1 domain✓ Very Easy✓ Easy✓ Easy (with difficulty)
P03 · TExternal, owns 10+ domains✓ Very Easy✓ Very Easy✓ Average
P04 · RNInternal, owns 1 domain✓ Very Easy✓ Very Easy✓ Very Easy
03

Ranked Issues

4 issues found. Severity scored by task criticality × impact × frequency.

Issues — by Severity

RankTaskLocationIssueAffectedSeveritySuggestion
1stBulk transferHomepageUsers expect to initiate transfers through the menu — not the search bar. The search input is perceived as “for registering”, not transferring.3/4 CriticalAdd a visible transfer entry point in the navigation menu or domains page — don’t rely solely on the search bar.
2ndBulk transferTransfer ModalEPP code tooltip goes unnoticed. Users don’t realize they can include authorization codes in the bulk transfer flow.3/4 MinorSurface EPP code instructions directly in the input area — not behind a tooltip. Reference Namecheap’s inline approach.
3rdTransfer resultsHeaderThe input field in the results page header is confusing — unclear if it’s for adding more domains or starting over. Copy says “Make your move!” which misleads mid-flow.1/4 MinorAdjust copy to reflect current context (“Add more domains”). Use consistent icons (magnifying glass, not arrow).
4thSearch resultsMain suggestionSystem assumes .com when user enters a bare domain name. User questioned why results show “greatdomain.com” as available when they never specified a TLD.1/4 MinorWhen no TLD is specified, show suggestions only — don’t present .com as the primary “available” result.
04

What Changed from Round 1

Direct comparison: which Round 1 issues were resolved, which persist.

1
Search/transfer confusion — resolved. The #1 issue from Round 1 ('Search or transfer a domain' placeholder confused all 3 participants) did not resurface. The redesigned modal with separated flows eliminated the ambiguity. All 4 participants found domain search straightforward.
2
Bulk transfer entry point — still a problem. Round 1 flagged discoverability (issue #4: 'Transfer section is hard to find'). Round 2 confirms this from a different angle: 3 of 4 users went to the menu first, not the search bar. The search bar works — but users don't expect transfers to live there.
3
Error handling — improved but EPP codes now the gap. Round 1's error handling issues (silent failures, unclear format guidance) were not reproduced. But a new blind spot appeared: the EPP code tooltip is invisible to most users. The information architecture improved; the micro-interactions need work.
4
Task completion improved significantly. Round 1: 4 completed without issues, 5 with difficulty, across 9 attempts. Round 2: 9 completed without issues, 2 with difficulty, across 12 attempts (excluding 1 prototype bug). The redesign moved the needle.
05

Findings

Answering the 3 test goals set before the study.

1. Have we resolved the search modal misunderstandings?

Yes. The main usability issues from Round 1 were fixed. One user was unfamiliar with “bulk” as a concept, but the modal components themselves were clear.

2. Is the search bar the primary option for initiating a transfer?

No — not intuitively. Some users overlook the “search or transfer” placeholder or assume transfers belong in the menu. The search bar works once found, but discoverability needs a secondary entry point (menu or domains page).

3. Can users complete all flows without difficulty?

Yes — all users completed all tasks. The only friction was finding the transfer entry point and the invisible EPP tooltip. Once inside the flow, the experience was rated Easy to Very Easy across the board.

P04 on search simplicity:

“This is as simple as Google — a white page with a text box in the middle. Spaceship does the same, so there’s no confusion about what needs to be done.”

P03 on search vs. transfer:

“It doesn’t seem normal to use a search input for a transfer.”

P01 on terminology:

“Registering and buying should be the same thing.”

P04 on .com assumption:

“It’s strange that the results automatically assume I want ‘.com’. I entered ‘greatdomain,’ and the results display ‘greatdomain.com’ as available. If I haven’t specified ‘.com,’ why is it being presented this way?”

Spaceship.com — Internal Design Research

Source: Usability Testing Round 2 · 4 sessions · Nov 2024