As we continue developing our software, we accumulate a growing amount of technical debt just to keep the system running. But I believe we are on the brink of an even larger issue. Cognitive debt.
Hope you enjoy this reading, all feedback is welcome.
No… No they’re not. Either that or nerual nets are even dumber than I thought. My understanding was emulating nodes of information like brains do. Thats not probabilities. But willing to be wrong if you can bring sources. The connection between points in probability doesn’t make sense. Thats a nonsense statement.
Thats also no how simulated annealing works. The temperature value is roughly the probability it will pick a different, less optimal step, in order to try and find better alternative paths. The temperature value is roughly the probability of trying something ‘random’. Not deterministic at all. The temperature value is lowered with time and progression. Its known the entire time, but its still a weighted coin flip that determines which path to take.
https://en.wikipedia.org/wiki/Simulated_annealing
Neural nets are dumber than you thought for sure. What I mean is the coin flip results are known after the fact.
I’m not convinced of that you do. Nor is knowing that flip helpful. Because it’s non deterministic. An internal coin flip is not an input either.
What I mean is for post hoc analysis since you know the coin flips and the inputs you can step through the layers and nodes calculation deterministically.
I mean sure, but to what end?
You can see where it went wrong. Not why, how