values: specify deterministic automation - #275
Conversation
Two years ago no one would think to include artificial intelligence under the umbrella term "automation", this is now changing. With this change my aim is to preserve the original spirit of our values as our language and environment shifts. If my interpretation of this value is flawed, please let me know.
Shift in environment is clear. By shift in language, you mean that the word automation has changed? Phrasing / form-Therefore, we value automation over toil, while recognizing that not all toil can be automated.
+Therefore, we value deterministic automation over toil, while recognizing that not all toil can be automated.The values should be centered around us humans, so a technical detail like "deterministic" doesn't really belong here on epistemological grounds. To illustrate the difference, someone may respect all life equally and therefore choose veganism. The prior is a value, and the latter is a personal norm or rule. As a concrete test, a formulation like "deterministic" technically brings into question the validity of useful tools like probabilistic property checking or probabilistic data algorithms like RFC 195's. Those are useful and their nondeterminism harmless, but I feel this would need clarification, at which point it doesn't feel like a well-formed value anymore. Current valuesMost applicable to your observation is our value that
This line has absolutely grown in relevance. It is important to me, and I believe it is reflective of values that are widely held, including among those in the community who have a positive view on "AI". LogicIn terms of logic, your proposal is a weakening of a precondition, making it a smaller statement, which technically always fits more people into the group, so into the community. I like that. My opinion / verdictBesides technical arguments about the validity and merits, I owe you my opinion as an SC member. I believe maintainers and contributors should be free to choose their own tools, even if they could use them unproductively or to ruin their reputation, however unfortunate that is. If they didn't care about the quality of their contributions, I'm glad we can uncover that problem more easily now. That said, I do agree deterministic tooling is better than the unprincipled and biased choices produced by "AI". Nonetheless, I believe this edit to be a slight net negative, mostly on the basis of it moving away from being a value and more towards a norm or rule, and partly on the basis of the quoted line already representing my perspective on the issues. |
|
Assuming the intent for this is to exclude AI/LLMs from the automation Value; i disagree because I think there is a space for such tooling in our domain. The question is when and under what conditions. But to say it has no value or excluding it from the Value seems short-sighted; applying today's evaluation of a technology to a long-lived Value. I also don't think the proposed change would meet the intended outcome. We have deterministic LLMs. We have useful tooling that is non-deterministic as @roberth points out. So for me, this fails on both fronts; both on the intent and outcome. And I'll +1 @roberth's post above. |
|
I'd love to hear from the rest of the SC and community, but I respond early since it seems we read this value differently. I'm not trying to ban nor discourage people from using LLM tooling with this amendment. My read of this value is not about interactive/user tooling at all, but rather about CI/GHA, maintenance, and our formal procedures. |
Thanks for the clarification; my assumption for your intent was wrong. |
Two years ago few would think to include artificial intelligence under the umbrella term "automation", this is now changing. With this change my aim is to preserve the original spirit of our values as our language and environment shifts. If my interpretation of this value is flawed, please let me know.