As the bottom of LLM inference, it is sampling for the next token based on the probability distribution conditioned on the tokens currently in the context window. If the distribution exhibits degeneracy in probability for more than token, outcome of the sampling will naturally, as it should, be nondeterministic. It should be left alone.
Democracy as an ideal is not what is being practiced here in the US, at least in the last twenty or so years. People hacked the supreme court, hacked the media to con the voters for vote, big money comes into the mix, etc., no wonder it is not working as it should be.
wheels get reinvented again again again and again … this is quite unique to info tech … imagine mathematicians do the same, the world would be in chaos …
> wheels get reinvented again again again and again
And yet, it took us (humans) a long time to turn the wheel around and using it for transportation, so maybe we need reinvent even more things, turn them around and such :)
I am surprised there is so much talk about China. Can we just focus on our own business here in the US: fixing the roads, bridges, schools, cities, etc.? Let’s make America greater first!
An implication from the 1985 paper of Peter Naur on programming as theory building is that the current LLM coding tool would be very effective in generating technical debt even when it works ... use at your own risk.
A near insurmountable amount of problems and technical debt are due to be created in problems teams. Sounds like a great time to get into consulting. It's like knowing that y2k is coming up ahead of time. Learn your debuggers and your slide decks folks
Technical debt will have a strong negative impact on a project/product over time if left unresolved (if it doesn't, it probably isn't really something we should call technical debt).
That is, technical debt matters whether anyone cares about it or not.
As a junior engineer I don’t care about technical debt and instead will push that we should rewrite the app so the new wave of employees can understand it.
Convincing my manager and leadership of this is 100x easier with generated code. I get approval and generate a new stack of tech debt that I try to pass to the next wave of employees.
reply