3

Should we have a stance on AI generated answers (and possible questions as well)?

  • AI generated answers are not allowed as they can be tricky to verify as correct and it can be said if you are using AI to generate an answer you won't be able to verify if it is correct or not.
  • AI generated answers are allowed but need to be properly cited as an AI generated answer to allow users to know the source of the answer.(All AI generated content is required to be cited per SE policy)
  • AI Generated answers are treated like all others and no special actions are needed for them(not allowed per stack exchange)

As a note I am asking this question as there are new banners available for answers to indicate that they are not allowed or not

Sites can now request to enable a banner to warn about their policy on AI-generated content

24
  • @murgatroid99 can this question be featured to try and increase the visibility
    – Joe W
    Commented Jan 13 at 21:20
  • 3
    That is a good point. I have featured this question.
    – murgatroid99 Mod
    Commented Jan 13 at 21:35
  • 1
    Regarding #3: AI answers that are not clearly listed as AI are considered a Code of Conduct violation under the Inauthentic Usage policy, and so are essentially prohibited already. Making a more restrictive policy is, of course, totally fine.
    – cocomac
    Commented Jan 17 at 16:22
  • @cocomac If that was the case why is there an option to have a banner warning users that all AI generated answers have to be properly identified? "Reminder: Answers generated by artificial intelligence tools must be cited on [Site Name]. Learn more" That option suggests that it isn't required to state that AI is used in an answer.
    – Joe W
    Commented Jan 17 at 17:12
  • 2
    @JoeW I'm not sure exactly what you mean. An AI answer listed as an AI answer is allowed by the Inauthentic Usage policy, so having a banner reminding users to state that they used AI is fine. A banner saying that a site decided to fully ban AI and to not use it is fine as well.
    – cocomac
    Commented Jan 17 at 17:24
  • @cocomac My point is that if it was true that an AI generated/edited answer has to have a statement listing it as AI why would one of the choices listed in the post I link be to add a banner stating that AI answers must be noted as such. The fact that it is a choice to turn on for a site suggests that posting AI answers without listing them as such is allowable. That question is saying sites can have a banner saying AI answers are not allowed, AI answers must be identified or no banner at all. You should post an answer explaining why you think they are not allowed without reference.
    – Joe W
    Commented Jan 17 at 18:02
  • 1
    The community consensus is clearly against AIG material being permitted at all. Why has this post been edited to say they are okay with referencing? This is neither necessary nor desirable. @murgatroid99
    – Nij
    Commented Feb 12 at 10:42
  • 1
    @Nij I think there is a misunderstanding with the edit, the update was to remove the option of saying that AI content must be cited because that is already a sitewide requirement. When they asked the question of which type of banner a site wanted they missed the fact that all AI answers where already required to be cited under the inauthentic use policy.
    – Joe W
    Commented Feb 12 at 13:35
  • @JoeW the edit is somewhat poor, probably best would have been to just remove option 3 from the points list, the option for allowing without referencing the AI generation, as it stands this asks a question and appears to give a single option (granted the one it seems our community agrees on) and still lists the third, no longer Stack Exchange permitted option in the edit notes beside the second option that would be stack exchange permitted.
    – Andrew
    Commented Feb 12 at 15:11
  • @Andrew The attempt of the edit was to explain why it was being removed, if you feel you can do a better job feel free to make an edit yourself.
    – Joe W
    Commented Feb 12 at 15:38
  • @JoeW done, how's that look?
    – Andrew
    Commented Feb 12 at 15:50
  • @Andrew Option 2 is also no longer available as all AI answers are required to be properly citied based on existing SE policies. The meta question that sparked this question has also been updated to reflect that.
    – Joe W
    Commented Feb 12 at 15:57
  • 2
    @JoeW This is a question asking what this site should do, it DOES make sense that the answers must be cited variant is one of the options, because as a question it needs 2 choices minimum to make sense, Option 1 is no we should not allow them at all, option 2 is yes we should allow them (in line with the SE policies on citations), option 3 is the only one that should be removed because if violates the SE policies - the options are do we keep the default minimum or do we ban outright, we still have the choice and we still need to consider both.
    – Andrew
    Commented Feb 12 at 18:23
  • 1
    If you want to remove it you need a major structural rewrite to the question to be in line with a "should we do something or nothing", remove the bullet points, ask it open ended, and point out the minimums in that case, without providing any options at all, instead of the more "here are our choices, which should we choose" as it was originally written.
    – Andrew
    Commented Feb 12 at 18:25
  • 1
    There's a fundamental disagreement on what we're discussing, and why the option still belongs, so there is more to continue in chat - in the words of Neil Peart "If you chose not to decide, you still have made a choice" it's still an option, either the default minimum or to choose to reject all AI content - you have presented a choice here "reject AI content or...." with nothing after the or in the ways you have edited your question
    – Andrew
    Commented Feb 12 at 19:11

3 Answers 3

11

We should not allow the use of AI for answers on this site.

AI has proven to be unreliable, making answers that sound reasonable but are out and out false or wrong. It can be used for creative writing, and as a tool for other things but usually needs work after the fact. There's an extra risk on a site like ours where an answer given could have been correct, but no longer is, is the most common tag on BGSE, Magic is a game with changing rules, and a large language model AI is very capable of giving once true, but no longer correct, answers.

In general though AI answers run counter to the entire point of Stack Exchange, getting an answer from experts, or at least people with more experience in a topic. If people wanted an answer from an AI, they could just ask the AI their question directly.

7

I suggest that we do not allow AI answers on this site as they can be very difficult to verify if they are correct or not and based on writing style can easily be taken as a correct answer when they are not. I feel this way as when an AI is used to generate an answer the required knowledge will not be present to verify if it is accurate or not.

6

While I have an opinion about AI, I'm not going to say right now what I think this site should do - I'm not a regular of this site, and I don't really know it. This "answer" is regarding option #3, which states "AI Generated answers are treated like all others and no special actions are needed for them ".

Tl;dr: AI answers that are not clearly listed as AI answers violate the Inauthentic Usage policy, which is part of the Stack Exchange Code of Conduct. This has been confirmed by a SE Community Manager (staff). Per the Moderator Agreement, diamond (i.e., elected or appointed) mods are expected to enforce the CoC. How mods handle AI-content (as a CoC violation) is, to an extent, up to them. But, individual sites aren't really supposed to make policies overriding the CoC. You cannot, for example, make a policy that allows being intentionally rude to other users.


To respond to your comment:

@cocomac My point is that if it was true that an AI generated/edited answer has to have a statement listing it as AI why would one of the choices listed in the post I link be to add a banner stating that AI answers must be noted as such. The fact that it is a choice to turn on for a site suggests that posting AI answers without listing them as such is allowable. That question is saying sites can have a banner saying AI answers are not allowed, AI answers must be identified or no banner at all. You should post an answer explaining why you think they are not allowed without reference.

AI content that is improperly referenced (i.e., not cited as such) is clearly banned, regardless of whether or not there is a banner announcing it. A lack of a banner does not mean something is permitted. It's entirely possible for a site to say "We don't want the banner", and, for example, deciding they will ban all AI content, whether cited or not.

2
  • 1
    Thank you for this information and explanation of why it is considered a violation.
    – Joe W
    Commented Jan 17 at 19:47
  • As an update the post has been updated that they will be making an update to help center articles community wide to note that AI articles need to be properly cited.
    – Joe W
    Commented Feb 5 at 1:44

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .