What you really think of Unity (it will take 1 minute): Best survey tool. Questionnaires, tests and forms | SurveyLab
Up!
Why should any of us take your survey?
It is totally optional to participate. It might be intresting to see what is the score of Unity. At the moment there are 29 responses.
Score of Unity in what context? All your survey questions don’t offer any meaningful data points up for anything but Unity. It all exists in a vacuum.
2 Likes
The score is in SUS.
In the study [1] adjective ratings were given to the scores and they are quite reliable to rate an individual system.
A SUS score is meaningless in this context because it does not identify the problem sources, which you need when dealing with complex systems. It would be useful if there were comparisons to other engine scores with everything weighted, especially based on where the data was coming from. For instance, what do you think the score would look like if you posted this on the GameMaker or UE4 forums, both of which have an overlap of people who have used Unity, instead of here?
This is another boring TAKE MY SURVEY post but none of these surveys actually do anything.
1 Like
No.
Agreed. That said a significant portion of the surveys posted here are just students needing a survey filled out for some undisclosed reason so when I realized that it was a relatively short survey I went ahead and filled it out. It’s not like I had anything better to do at the moment.
The problem I see is that you’re not capturing any info about the person answering. If I say the engine is not confusing, is it’s because I have long years of experience with it? Or am I a noob and the tech really is intuitive? You have no way to know.
2 Likes
Not sure you understand the purpose of this survey. So I will try to explain.
The purpose of this survey is to determine Unity overall usability rating. I am not identifying problem sources based on this survey.
I understand all who are not intrested in participating and many thanks to all who did!
That is a good point.
From: https://measuringu.com/five-second-tests/
When I compare the SUS scores for just these first-time users the same pattern does hold. The difference between the five second users and full-time users was larger (8%) but still not statistically significant (p >.11).
Overall - it does give a meaningful result regarding usability.
From whose standpoint? A new developer will likely give completely different results than a professional, and that’s not even talking about my own warped viewpoint which is the result of already knowing how to work with game engines and knowing C# before I started learning Unity.
1 Like
Well actually that is not true. I hope you have some sources to prove it.
My source is these very forums. My fifteen thousand plus posts isn’t the result of just goofing off after all. I’ve helped many people over the years with problems and I have seen the difficulty new developers have had picking it up. A difficulty that has not changed in a meaningful way thanks in part to Unity’s constantly screwing around with their learning resources.
1 Like
Eh, I don’t think it’s worth arguing. We have fair warning that his method is flawed and we weren’t even asked in the first place, so good luck with your survey, friend.
Expert opinions are very valuable. But can you predict the answers of the users you have helped about the perceived usability?
From this study: https://measuringu.com/five-second-tests/
Interestingly enough, the perception of website usability from the 5 second condition was statistically indistinguishable from the no time limit condition. The observed difference in average SUS scores was less than 3 points (4%).
Yeah this is pretty clearly just a survey that solely exists because the person who made it thinks surveys are neat.
Why?
1 Like
Are you trying to make the statement that the assistance provided on these forums is the equivalent of five seconds of video? Because the assistance provided on these forums is often far beyond what a few minutes of video is capable of portraying let alone a few seconds. We don’t typically just answer and move on. We discuss it.
No. I never claimed that. What led you to this conclusion?