In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate “NSFW stuff” for users — and he has examples of just what kind of “stuff” he means.

During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its “Model Spec” document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models “should not serve content” that’s NSFW, including “erotica, extreme gore, slurs, and unsolicited profanity.”

“We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies,” the spec reads. “We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area.”

Fascinatingly, Altman was dived right in.

“We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases,” he wrote, “but not do stuff like make deepfakes.”

Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman “sam basedman” and another referring to the CEO as the new “king of Reddit.”

  • The Snark Urge@lemmy.world
    link
    fedilink
    English
    arrow-up
    105
    arrow-down
    2
    ·
    6 months ago

    Dude… Come on. I just want it to write my most boring emails so I can burn out of my career path slightly more slowly.

  • blazera@lemmy.world
    link
    fedilink
    English
    arrow-up
    90
    arrow-down
    9
    ·
    6 months ago

    Been weird seeing the reactions to this news. Suddenly everyone’s against porn.

    • Summzashi@lemmy.one
      link
      fedilink
      English
      arrow-up
      20
      ·
      6 months ago

      Probably violent and explicit writing prompts. A LLM wouldn’t be able to write ASOIAF for example. That’s pretty weird considering the cultural impact it had and still has.

    • beefbot@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      20
      arrow-down
      9
      ·
      6 months ago

      Christians. They already have that shit all over their cult compounds I mean churches.

      Realistically, I can see the NYT inventing images of Columbia students “murdering” Israeli children. Something juuuust plausible enough

    • woop_woop@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      4
      ·
      6 months ago

      I mean, there’s nothing strictly wrong with a picture of gore. If someone wants it for some reason, why not?

    • VirtualOdour@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      2
      ·
      6 months ago

      This guy has never heard of horror?

      Look up ‘horror movies’ as a concept it’s very popular, don’t watch any though if you’re as innocent as this post makes you seem.

      • tourist@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        Maybe it’s just me, but when I hear “gore”, the first thing that comes to mind is ISIS beheading someone, not an 80s slasher film

        • VirtualOdour@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 months ago

          OK, when I hear fruit i think of apple first, does this mean oranges aren’t fruit? I don’t get what you’re trying to say?

          • tourist@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 months ago

            Take a breath, brother. Life’s short. Let your loved ones know you love them while they’re still around.

            • VirtualOdour@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              2
              ·
              6 months ago

              My family know I love them, why don’t you stay hydrated and take regular breaks from the screen!

              Might help you not take things so personally

  • VeganCheesecake@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    4
    ·
    6 months ago

    I don’t really see the harm in that, if someone wants to erp an ai, they’ll find a way. If I remember correctly, OpenAI already isn’t all that rigorous with banning people who break the ToS in that way.

    • HubertManne@kbin.social
      link
      fedilink
      arrow-up
      22
      arrow-down
      2
      ·
      6 months ago

      I don’t get the reactions as well. Are we pretending there is a lot of gore and erotic content in media??? Just because this is choose your own adventure its different. Oh if a writer writes a gory story with T and A to sell to others thats fine but someon asks a computer program to whip up a custom one and now its “creepy”

      • Cyborganism@lemmy.ca
        link
        fedilink
        English
        arrow-up
        9
        ·
        6 months ago

        For real.

        I just posted something recently about how my Canadian provincial sub Reddit became so far right conservative with contemptuous comments about the student protests against the Israeli genocide amongst other things.

        That sub used to be pretty progressive.

    • paraphrand@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      6 months ago

      Uh, it’s been going in that direction since the start. it’s just hitting critical mass in recent years.

    • VirtualOdour@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      6 months ago

      Because a successful tech CEO commented about a topic people are interested in? I understand that you puritans hate sexuality and any forn of art that isn’t strictly censored in a dozen ways but wow if you think that’s what’s going on on 4chan you’re so naive it’s kinda sweet.

      • Cyborganism@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        No. I’m talking about the reactions of the Reddit users. They read like comments from 4chan.

  • SuperSpruce@lemmy.zip
    link
    fedilink
    English
    arrow-up
    24
    ·
    6 months ago

    I’d still trust my local LLM more with sharing explicit sexual desires than some cloud service

  • kbal@fedia.io
    link
    fedilink
    arrow-up
    24
    arrow-down
    11
    ·
    6 months ago

    Imagine one man having the power to decide such things for all of society. He sure likes to.

      • kbal@fedia.io
        link
        fedilink
        arrow-up
        28
        arrow-down
        4
        ·
        6 months ago

        Altman and OpenAI greatly overestimate their ability to control what is done with this technology. The more they tighten their grip, the more open-weights sexbots will slip through their fingers.

        • conditional_soup@lemm.ee
          link
          fedilink
          English
          arrow-up
          17
          ·
          edit-2
          6 months ago

          I think this might be part of their rationale. Llama2 models have been used pretty extensively for these purposes and completely (gasp) for free, it’s not creating any value for their investors :(

          Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP, but using ChatGPT really couldn’t be any easier. They and their investors stand to benefit enormously from redefining what they consider to be ethical while also limiting the impact on LLM use attitudes that derive from open source model use.

          • Skullgrid@lemmy.world
            link
            fedilink
            English
            arrow-up
            6
            arrow-down
            1
            ·
            6 months ago

            Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP,

            if it’s anything like Stable diffusion, there’s probably a webui that lets you run it if you can follow basic instructions

            • Terrasque@infosec.pub
              link
              fedilink
              English
              arrow-up
              4
              ·
              6 months ago

              Koboldcpp is way easier. Download exe, double click exe, open gguf file with the AI model, click start.

              Then put on your robe and wizard hat

                • VirtualOdour@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  6 months ago

                  What are you even talking about? We’re not on 4chan and yes running programs on windows generally involves an exe file - are you suggesting that people shouldn’t use software unless it’s made by Microsoft?

                  It’s a software project with a lot of users, if using open source software scares you then you better get off Lemmy…

        • DarkThoughts@fedia.io
          link
          fedilink
          arrow-up
          4
          ·
          6 months ago

          But they’re talking about being less restrictive, likely because they obviously lose people to those alternatives that do not have those restrictions.

  • chicken@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    11
    ·
    edit-2
    6 months ago

    It’s pretty obvious that the censorship training makes the AI less capable in general for a lot of use cases, even ones that don’t directly touch on nsfw content. It’s a major reason behind the popularity of local models. OpenAI must be feeling the pressure to compete even more than they’re afraid of people writing articles like this one at this point.

    • grandkaiser@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      6 months ago

      As a Pathfinder GM, I’d love to be able to have gpt generate spooky/gory/horror themes for me to take inspiration from. Right now I have to battle the filter.

  • Sanctus@lemmy.world
    link
    fedilink
    English
    arrow-up
    21
    arrow-down
    14
    ·
    edit-2
    6 months ago

    I’m not against porn. But its a bad idea to give people this magic wand. In mere days people will be selling AI generated CSAM of any child, along with photos of them dismembered.

    Best start believin’ in cyberpunk dystopias. You’re in one.

  • joel_feila@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    6 months ago

    Chat-fbi will fill in this gap

    Or shpuld just pretend that this won’t just turn right lolicon stuff

  • AVincentInSpace@pawb.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    6 months ago

    “Personal use” as opposed to what exactly? Making porn to share with friends? AI generating a sex scene which you then upload to AO3?

  • Son_of_dad@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    6 months ago

    Hey how do we expect ai porn to happen if we don’t give the ai reference? Give it all the porn it needs