Can you use DOTS as a data analysis tool?

DOTS with it Entities and Systems has a lot of similarities with Database Tables and SQL queries…

Therefore could you use DOTS as a super fast multi-threaded data analysis tool?

I guess you could. What are you trying to achieve?

Well I was just analysing the bloat (duplicated files) in Unity projects using Unity to parse the text data from a duplicate file finder program and hitting the point where I needed a better way to link and store the data when I thought of databases and DOTS.

link to thread on Bloat in Unity https://discussions.unity.com/t/789088

So I have duplicate files listed with file | path | size | datetime.

What I need is a way to analyse the Unity folders for duplicates so I can say what areas of Unity have the most duplication… it looks like the Package Manager could be the duplication king.

It’s quite easy to build up a dictionary of path folders and total the files within those folders but a bit harder to also count the total files size of the different files in those folder. That’s when I thought of SQL/DOTS so could I write a DOTS SQL query system that would solve this problem?

Well, data transformation is what it excels at. Analysis is transforming a lot of data. Do you have an example? I am interested in solving a lot of puzzles in DOTS at the moment.