• AreaKode@lemmy.world
    link
    fedilink
    arrow-up
    47
    arrow-down
    16
    ·
    23 hours ago

    That’s what I love about LLMs. They aren’t intelligent. They’re just really good at recognizing patterns. That’s why objective facts are always presented correctly. Most of the pattern points at the truth. To avoid this, they will have to add specific prompts to lie about this exact scenario. The next similar fact, they’ll have to manually code around that one too. LLMs are very good at finding the overwhelming truth.

    • ZDL@lazysoci.al
      link
      fedilink
      arrow-up
      52
      ·
      22 hours ago

      That’s why objective facts are always presented correctly.

      Here’s me looking at the hallucinated discography of a band that never existed and nodding along.

        • ZDL@lazysoci.al
          link
          fedilink
          arrow-up
          8
          arrow-down
          3
          ·
          21 hours ago

          I made the band up to see if LLMbeciles could spot that this is not a real band.

          Feel free to look up the band 凤凰血, though, and tell me how “underground” it is.

          • agamemnonymous@sh.itjust.works
            link
            fedilink
            arrow-up
            1
            arrow-down
            2
            ·
            edit-2
            20 hours ago

            Does this count?

            Also, by nature of being underground they would be difficult to look up. Some bands have no media presence, not even a Bandcamp or a SoundCloud.

            • smiletolerantly@awful.systems
              link
              fedilink
              arrow-up
              3
              ·
              18 hours ago

              Are you having this argument on the principle of defending the undergrounded-ness of bands, or do you actually believe LLMs always get the facts straight?

              • agamemnonymous@sh.itjust.works
                link
                fedilink
                arrow-up
                3
                arrow-down
                2
                ·
                17 hours ago

                Eh, more of an exercise in scientific skepticism. It’s, possible that an obscure band with that name was mentioned deep in some training data that’s not going to come up in a search. LLMs certainly hallucinate, but not always.

                • ZDL@lazysoci.al
                  link
                  fedilink
                  arrow-up
                  4
                  arrow-down
                  3
                  ·
                  16 hours ago

                  An obscure band with that name that has a discography that nobody’s ever heard of anywhere, complete with band member names, track titles, etc?

                  Yeah, pull the other one, Sparky. It plays “Jingle Bells”.

            • ZDL@lazysoci.al
              link
              fedilink
              arrow-up
              4
              arrow-down
              2
              ·
              16 hours ago

              Nope.

              You can tell because they’re not even in the same writing system. Future tip there.

      • Honytawk@feddit.nl
        link
        fedilink
        arrow-up
        4
        arrow-down
        2
        ·
        edit-2
        14 hours ago

        There are no objective facts about a band that never existed, that is the point.

        Ask them about things that do have enough overwhelming information, and you will see it will be much more correct.

        • ZDL@lazysoci.al
          link
          fedilink
          arrow-up
          7
          arrow-down
          4
          ·
          14 hours ago

          But not 100%. And the things they hallucinate can be very subtle. That’s the problem.

          If they are asked about a band that does not exist, to be useful they should be saying “I’m sorry, I know nothing about this”. Instead they MAKE UP A BAND, ITS MEMBERSHIP, ITS DISCOGRAPHY, etc. etc. etc.

          But sure, let’s play your game.

          All of the information on Infected Rain is out there, including their lyrics. So is all of the information on Jim Thirwell’s various “Foetus” projects. Including lyrics.

          Yet ChatGPT, DeepSeek, and Claude will all three hallucinate tracks, or misattribute them, or hallucinate lyrics that don’t exist to show parallels in the respective bands’ musical themes.

          So there’s your objective facts, readily available, that LLMbeciles are still completely and utterly fucking useless for.

          So they’re useless if you ask about things that don’t exist and will hallucinate them into existence on your screen.

          And they’re useless if you ask about things that do exist, hallucinating attributes that don’t exist onto them.

          They. Are. Fucking. Useless.

          That people are looking at these things and saying “wow, this is so accurate” terrifies the living fuck out of me because it means I’m surrounded not by idiots, but by zombies. Literally thoughtless mobile creatures.

          • Honytawk@feddit.nl
            link
            fedilink
            arrow-up
            3
            ·
            7 hours ago

            Sounds like you haven’t tried an LLM in at least a year.

            They have greatly improved since they were released. Their hallucinations have diminished to close to nothing. Maybe you should try that same question again this time. I guarantee you will not get the same result.

            • ZDL@lazysoci.al
              link
              fedilink
              arrow-up
              1
              ·
              19 minutes ago

              Their hallucinations have diminished to close to nothing.

              Are you sure you’re not an AI, 'cause you’re hallucinating something fierce right here boy-o?

              Actual research, as in not “random credulous techbrodude fanboi on the Internet” says exactly the opposite: that the most recent models hallucinate more.

          • Jakeroxs@sh.itjust.works
            link
            fedilink
            arrow-up
            2
            ·
            edit-2
            7 hours ago

            Certainly! Here’s the English translation of the information about 凤凰血 (Blood of Phoenix):

            🎸 About the Band / Project

            “凤凰血” (Blood of Phoenix) is not a conventional live-performing band but rather the name of a 2016 EP by the Chinese extreme metal project ObscureDream. This is a one-man black metal/extreme metal project by Zhang Jiangnan (also known as Filth), who is also involved with other projects like Black Kirin and Dirtycreed.

            🎵 EP: Blood of Phoenix (2016)

            Release Date: April 16, 2016

            Tracks:

            Blood of Phoenix – approx. 5:50

            Farewell to My Concubine – approx. 4:22

            Blood of Phoenix (Instrumental) – approx. 4:50

            Distribution: Released digitally via Bandcamp for about €2, available in MP3/FLAC formats.

            🧱 Musical Style and Themes

            The music blends black metal and death metal with traditional Chinese elements, such as epic atmospheres, folkloric themes, and historical references.

            Tracks like Farewell to My Concubine reference iconic Chinese stories.

            The sound is described as dark, intense, and cinematic, evoking a battlefield-like grandeur.

            🎖 Reception and Influence

            Blood of Phoenix marks an important shift for ObscureDream from raw black metal to a more refined blackened death metal sound.

            It has been recognized as one of the “40 must-collect Chinese metal albums”.

            International metal reviewers have praised it as a standout example of localized Chinese extreme metal with epic and national characteristics.

            Summary

            Blood of Phoenix isn’t a traditional band but a unique, culturally rich metal release by a Chinese solo artist. It stands out for merging extreme metal with Chinese historical and mythological motifs, gaining notable acclaim in both local and international underground metal scenes.

            If you’d like links to listen, lyric translations, or analysis of the music/production, just let me know!

            https://coldwoodsprod.bandcamp.com/album/blood-of-phoenix

            • ZDL@lazysoci.al
              link
              fedilink
              arrow-up
              1
              ·
              20 minutes ago

              Huh. So there really is a 凤凰血. Weird how when I tried it (on several AIs) they just made shit up instead of giving me that information.

              It’s almost like how you ask the question determines how it answers instead of, you know, using objective reality. Almost as if it has no actual model of objective reality and is just a really sophisticated game of mad-libs.

              Almost.

    • stoy@lemmy.zip
      link
      fedilink
      arrow-up
      22
      arrow-down
      2
      ·
      19 hours ago

      I asked ChatGPT to describe the abandoned railway line between Åkersberga and Rimbo, it responded with a list of stations and descriptions and explained the lack of photos and limited information as due to the stations being small and only open for a short while.

      My explanation is that there has never been a railway line between Åkersberga and Rimbo directly, and that ChatGPT was just lying.

    • shalafi@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      2
      ·
      21 hours ago

      I use ChatGPT once a day or so. Yeah, it’s damned good at simple facts, more than lemmy will ever admit. Yeah, it’ll easily make shit up if there’s no answer to be had.

      We should have started teaching tech literacy and objective analysis 20-years ago. FFS, by 2000 I had figured out that, “If it sounds like bullshit, it likely is. Look more.”

      Also, after that post, I’m surprised this site hasn’t taken you out back and done an ol’ Yeller on ya. :)