Asset Clash: Compare two similar assets on a set of given requirements

Hey guys,

I’m sure we’ve all faced this: A new project usually means different requirements, and therefore probably a different choice in assets. For example, I’ve spent hours on researching which of the available character controllers fits my needs. What if someone else already had done this for me and you, and put their findings somewhere, publicly available on the internet?

Imagine you are looking for a weather asset suited towards an FPS game. Most will instantly think about UniStorm, Tenkoku or SkyMaster. But what are the details? Which of them can be synchronized over the network, so that all players see the same sky and have the same weather? What if I wanted to have low hanging clouds the player could fly through - which of them could deliver that? And at the end of the day, which of them delivers the most of the requirements I have?

Imagine a blog with a more or less standardised format:

Introduction of Asset A
Introduction of Asset B
Evaluation Critera
Evaluation matrix
Result

The criteria would be different, but the “rating of fulfillment” (I didn’t think of a better name for that yet) would be the same across all comparisons:

++ (Feature is provided out of the box, or there is a tutorial or something equivalent offered by the author

  • (The requirement is fulfilled partly ( >= 50%, whatever that might mean) by the asset
    o (The asset provides the feature in a non-sufficient way or provides a basis to implement it by oneself AND there is at least some documentation by anybody on how to do it)
  • (The asset provides or does not provide a basis for implementing the feature by oneself, or does provide it in a non-sufficient way and there is no starting point and no documentation about how to implement it)
    – (The asset provides or does not provide a basis for implementing the feature by oneself, and there is no starting point and no documentation about it)

The evaluation matrix would be made of a table, the rows being the requirements and the columns being the evaluated assets. In the cells, there would be the rating and, if necessary, a short explanation, for example requirement X is rated with o, because there is a forum post by someone with details on how to do this (including the link to that post).

Of course there are “problems” with this format. It will be nearly impossible to include every possible requirement, and maybe there may only be a few requirements that are interesting for the reader. But maybe picking some requirements an imaginated game would have, and, if demand (maybe even at your request? :p) is high enough, re-evaluating some assets for different settings would be of value to some.

That idea got stuck in my head for quite a while now, and that’s why I’m now reaching out to you. What do you think about that idea? Would you want to read something like this, and would it at least partially help you in choosing the asset that is best suited for your needs?

Best regards,
Patrick

1 Like

Among the scenarios I’ve been faced with

Third Person Controller by Opsive ($75)
Third Person Motion Controller by ooti ($65)
Third Person Controller - Shooter Template Template by Invector ($75)

I own the one by Opsive. However, my interest was also been rivaled by those other assets. Eventually I concluded that currently there wasn’t enough evidence to switch.

Your proposed idea would help in defining a use-case among the several “alike” assets. Example: Some could give the impression of being better with certain genres, workflows etc.

To add to your idea. Many asset creators have another asset in the same category to maintain integrations. It may be beneficial to also reach out to them to get some thoughts on where they feel their asset differs.


To highlight some others:

EnhancedScroller by echo17 ($20)
Optimized ScrollView Adapter by The Fallen Games ($25)
New UI Widgets by Ilya Novikov ($49)

Editor Console Pro by FlyingWorm ($30)
SRDebugger Console & Tools On-Device by Stompy Robot LTD ($30)

Octave3D- I think is alone in the non-runtime 3D map editor assets now.

TerrainComposer 2 by Nathaniel Doldersum ($75)
Map Magic by Denis Pahunov ($75)
World Composer by BiteTheBytes ($59/$189)

Playmaker by Hutong Games LLC ($65)
Behavior Designer by Opsive ($75)
Blox Visual Scripting by PL Young ($40)

1 Like

Those words could come from my mouth - there seem to be a lot of assets that are similar, yet different in sometimes crucial details.

You mentioned some of the assets I pondered over - I guess third person controllers would be a good starting point :slight_smile:

Comparing Playmaker and Behavior Designer might be a bit difficult though, as the latter is targeted more towards AI, if I’m not mistaken. Yet, why not point out the differences and save others the headache of finding out themselves :slight_smile:

I think it’s a pretty good idea, but would be take a significant amount of time to properly do. Giving a fair review of an asset is time consuming enough, add in reviewing all of its direct competition and defining all of their differences would be substantial. Plus, what happens when they update? Re-evaluation and more maintenance.

1 Like

You are right, updates are a problem. I would for now choose the easy way out and would refer to a specific version. That way, the reader has at least a reduced amount of information to work through. If there is a major update that is a game changer, then maybe it would be best to just redo the whole evaluation process.

The time needed to have a good, fair view will indeed be immense, but I didn’t think of this as an in depth review with each and every aspect being considered from all sides. Let’s be realistic, that would be an herculean task for even a single asset, as you said. I would see it more as a feasibility study. Maybe it will grow if this project is well received, but time will tell :slight_smile:

Yes, PM and BD don’t really overlap that much, and work quite well together.

NodeCanvas is the one to compare Behavior Designer to, as it’s primary focus is on behaviour trees. (NC also handles FSMs, which invites comparisons with PM).

While Playmaker is a visual FSM implementation, it gets used as a more general purpose visual programming tool, so there would be value in comparing it with Blox, FlowCanvas, uScript, Bolt (not quite released yet and Unity 2017 only), and others.

Also important to include are the experience level of the end user as well as the user’s primary role (programmer, artist, designer, etc).

If you’re going to start with the character controllers, drop me a PM. I own all three of the ones mentioned (Opsive, ootii, Invector) and I’ve spent a significant amount of time digging into how each one works and testing out integrations with other assets.

Yes. Especially for complex assets like character controllers. One couldn’t just make a comparison of the advertised features. You’d really need someone like @TeagansDad who has compared performance in edge cases, examined code structure and scripting extensibility, etc.

1 Like

Thanks for your offer, I will surely take it up when the time comes :slight_smile: I am glad to hear that you would be willing to contribute!

Thank you for your input :slight_smile: I wouldn’t want to compare just advertised features, that would not be of help to anybody that can read and browse the asset store pages :stuck_out_tongue:
On the other hand, doing performance tests would require a standardized approach for each class of asset in order to make the results meaningful. I must admit that I am a bit frightened about the amount of extra work required just to work out multiple measuring methods that might only apply to two to five assets and cater to a number of different usage scenarios.
I’ll be happy to include any additional information the community might provide, though :slight_smile:

In regards to examining the source code, I agree with you that this is a valuable information. I have seen too many assets which had code that is just plain awful, but that is usually something you only get to know once you own the asset already :confused:

I will also take the community around an asset into account, though as with the quality of the source code this will probably be a little subjective.

I am a big fan of your assets btw!

2 Likes