Hello Mozilla Connect Community, I’m Chance York, a User Researcher on the Firefox User Research team. I’m reaching out because our team has created a survey to gather opinions on a handful of browser features, some of which were suggested previously on Mozilla Connect. Your feedback on this survey...
That’s why they did it in sets of three. They could just give every user a blank text box for every option, but doing it this way makes it far easier to analyze the data in bulk.
And there’s no way to relate preference between features, at least in my case. I had one question that I entered “2x faster performance” as most want, and the next question was “2x slower performance,” but there was another crappy option in the same list that I also don’t want, so if I don’t pick “2x slower performance” as least want, what signal does that send?
I hope it all comes out in the wash, but honestly, I would’ve preferred a big list of all of the features with 4 options:
really want
want
meh
don’t want
I think I would’ve entered about even numbers of things for each category. They could even limit “really want” to top three or something.
i don’t like how they used “want least”, it means three very different things:
That’s why they did it in sets of three. They could just give every user a blank text box for every option, but doing it this way makes it far easier to analyze the data in bulk.
yea, but that gives you less info
this way, you can’t really differentiate from a feature that people want, but not as a priority, VS a feature that people don’t want ever
And there’s no way to relate preference between features, at least in my case. I had one question that I entered “2x faster performance” as most want, and the next question was “2x slower performance,” but there was another crappy option in the same list that I also don’t want, so if I don’t pick “2x slower performance” as least want, what signal does that send?
I hope it all comes out in the wash, but honestly, I would’ve preferred a big list of all of the features with 4 options:
I think I would’ve entered about even numbers of things for each category. They could even limit “really want” to top three or something.
It makes the survey easier to complete by users in small steps. Huge surveys scare users away.
The survey design accounts for this. See https://lemm.ee/comment/13835466.