Thought of this while having a convo with someone at or from DEF CON and accidentally pulled an all nighter to push over some final dev hurdles - I've been redesigning my core engine (correlations) for the last week, starting when the architecture started to feel less scalable during testing against a full prod-scale data set.
So there are now more than 700 branch types (links + meta + confidence = 1 type) between the primary ~20 data sources, which represents a ~15% increase from the previous model that produced 3.2 Tn correlations. The changes should result in higher fidelity joins and discoverable data, further expedited analysis for security teams, and deeper temporal reasoning ability for agents consuming derivative products...I hope.
Going to hit the gym and clear my head while running this next test. I know that I've been saying this but I really hope to build a video soon - this last thing has been holding it back.💪
ALT ...so d2f sub 1 needs to equal d2f sub 2, and d2f sub 3 needs to equal d2f sub 4, where length "L" creates a complimentary shaft angle...call that Theta D.