An AI avatar made to look and sound like the likeness of a man who was killed in a road rage incident addressed the court and the man who killed him: “To Gabriel Horcasitas, the man who shot me, it is a shame we encountered each other that day in those circumstances,” the AI avatar of Christopher Pelkey said. “In another life we probably could have been friends. I believe in forgiveness and a God who forgives. I still do.”

It was the first time the AI avatar of a victim—in this case, a dead man—has ever addressed a court, and it raises many questions about the use of this type of technology in future court proceedings.

The avatar was made by Pelkey’s sister, Stacey Wales. Wales tells 404 Media that her husband, Pelkey’s brother-in-law, recoiled when she told him about the idea. “He told me, ‘Stacey, you’re asking a lot.’”

  • VerticaGG@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    4
    ·
    53 minutes ago

    nope. nope nope nope! Fuck this. I wanna go back to 2002 with Cortana whispering in my ear about fleet chatter and being optimistic.

    That’s not the world that unfurled though, and LLM’s are not AI.

    This marketing hype regurgitation machine “learning” can all go eat shit. All of it. Soooo done with the simps saying “oh but this application of the tech totally justifies burning down forests and guzzling water and power and totally wasnt trained on stolen, socially prejudice datasets”

    Fuck that noise and while we’re at it I’m entirely turned off by AAA media trends and current gen hardware too. Don’t @ me, fuck a smartphone I’ve got a DS.

  • GreenKnight23@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    2 hours ago

    “gampa, did it hurt when you died?”

    Hey there, buddy. That’s a big question! When people get very old or very sick, their bodies sometimes get tired, like a toy that slowly stops working. Normal people might go and buy a new toy from Amazon with all their great prices and exceptional customer service but your old gramps couldn’t do that. When it’s time to go, it’s usually peaceful—like falling asleep after a long, fun day on a nice comfortable Saatva bed. I don’t think it hurts, because our bodies know how to let go gently. What’s important is all the love and happy memories we share. You can even go back and look at all our wonderful memories from the good people at Instagram. And even when I’m not here anymore, that love stays with you forever. Would you like to send some of those memories to your local Walgreen’s to print?

  • LastYearsIrritant@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    394
    arrow-down
    1
    ·
    7 hours ago

    This isn’t a message from the victim. This is a message from his sister using his image as a way to increase the impact of her statement in court.

    This is a bad thing, this is manipulating the court with a false and confusing message.

    • inb4_FoundTheVegan@lemmy.world
      link
      fedilink
      English
      arrow-up
      79
      ·
      6 hours ago

      There were videos shown during the trial that Stacey said were deeply difficult to sit through. “Videos of Chris literally being blown away with a bullet through his chest, going in the street, falling backward. We saw these items over and over and over,” she said. “And we were instructed: don’t you gasp and don’t you cry and do not make a scene, because that can cause a mistrial.”

      “Our goal was to make the judge cry. Our goal was to bring Chris to life and to humanize him,” she said.

      If gasping at video of real events is grounds for a mistrial, then so is fabricated statements intended to emotionally manipulate the court. It’s ludicrous that this was allowed and honestly is grounds to disbar the judge. If he allows AI nonsense like this, then his courtroom can not be relied upon for fair trials.

      • mic_check_one_two@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        2
        ·
        19 minutes ago

        The victim impact statement isn’t evidence in the trial. The trial has already wrapped up. The impact statement is part of sentencing, when the court is deciding what an acceptable punishment would be. The guilty verdict has already been made, so the rules surrounding things like acceptable evidence are much more lenient.

        The reason she wasn’t allowed to make a scene during the trial is because the defense can argue that her outburst is tainting the jury. It’s something the jury is being forced to witness, which hasn’t gone through the proper evidence admission process. So if she makes a scene, the defense can say that the defendant isn’t being given a fair trial because inadmissible evidence was shown to the jury, and move for a mistrial.

        It sounds harsh, but the prosecutor told her to be stoic because they wanted the best chance of nailing the guy. If she threw their case out the window by loudly crying in the back of the courtroom, that wouldn’t be justice.

      • FauxLiving@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        7
        ·
        edit-2
        3 hours ago

        This is just weird uninformed nonsense.

        The reason that outbursts, like gasping or crying, can cause a mistrial is because they can unfairly influence a jury and so the rules of evidence do not allow them. This isn’t part of trial, the jury has already reached a verdict.

        Victim impact statements are not evidence and are not governed by the rules of evidence.

        It’s ludicrous that this was allowed and honestly is grounds to disbar the judge. If he allows AI nonsense like this, then his courtroom can not be relied upon for fair trials.

        More nonsense.

        If you were correct, and there were actual legal grounds to object to these statements then the defense attorney could have objected to them.

        Here’s an actual attorney. From the article:

        Jessica Gattuso, the victim’s right attorney that worked with Pelkey’s family, told 404 Media that Arizona’s laws made the AI testimony possible. “We have a victim’s bill of rights,” she said. “[Victims] have the discretion to pick what format they’d like to give the statement. So I didn’t see any issues with the AI and there was no objection. I don’t believe anyone thought there was an issue with it.”

    • 0x0@lemmy.zip
      link
      fedilink
      English
      arrow-up
      98
      arrow-down
      1
      ·
      7 hours ago

      The worse is everybody knows, including the judge, but they still chose to accept it.

      • ricecake@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        47
        ·
        5 hours ago

        Reading a bit more, during the sentencing phase in that state people making victim impact statements can choose their format for expression, and it’s entirely allowed to make statements about what other people would say. So the judge didn’t actually have grounds to deny it.
        No jury during that phase, so it’s just the judge listening to free form requests in both directions.

        It’s gross, but the rules very much allow the sister to make a statement about what she believes her brother would have wanted to say, in whatever format she wanted.

        • catloaf@lemm.ee
          link
          fedilink
          English
          arrow-up
          18
          ·
          5 hours ago

          Hot take: victim impact statements shouldn’t be allowed. They are appeals to emotion.

          • ricecake@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            5
            ·
            3 hours ago

            I feel like I could be persuaded either way, but I lean towards allowing them during sentencing.
            I don’t think “it’s an appeal to emotion” is a compelling argument in that context because it’s no longer about establishing truth like the trial is, but about determining punishment and restitution.

            Justice isn’t just about the offender or society, it’s also indelibly tied to the victim. Giving them a voice for how they, as the wronged party, would see justice served seems important for it’s role in providing justice, not just the rote application of law.

            Obviously you can’t just have the victim decide, but the judges entire job is to ensure fairness, often in the face of strong feelings and contentious circumstances.

            Legitimately interested to hear why your opinion is what it is in more detail.

            • catloaf@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              2 hours ago

              In terms of restitution, sure, the victim should have input. But in cases like imprisonment, I don’t see why the victim should have input into the length of a sentence, for example. If the offender is a danger to the public, they should remain in prison until such time that they are not. Emotional appeals should not factor into that determination.

    • riot@slrpnk.netOP
      link
      fedilink
      English
      arrow-up
      29
      arrow-down
      4
      ·
      7 hours ago

      I’d really like to hope that this is a one off boomer brained judge and the precedent set is this was as stupid an idea as it gets, but every time I think shot can’t get dumber…

      • futatorius@lemm.ee
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        4
        ·
        5 hours ago

        boomer brained judge

        Boomer here. Don’t assume we all think the same. Determining behavior from age brackets is about as effective as doing it based on Chinese astrology (but I’m a Monkey so I would say that, wouldn’t I?)

        The judge’s problem is being a nitwit, not what year they were born in.

    • HubertManne@piefed.social
      link
      fedilink
      English
      arrow-up
      17
      ·
      6 hours ago

      Yeah a fiction has no place in a courtroom. If we can upload maybe we can revisit but this is just stupid.

    • enkers@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      11
      ·
      edit-2
      6 hours ago

      Just to be clear, they were fully transparent about it:

      “Hello, just to be clear for everyone seeing this, I am a version of Chris Pelkey recreated through AI that uses my picture and my voice profile,” the stilted avatar says. “I was able to be digitally regenerated to share with you today. Here is insight into who I actually was in real life.”

      However, I think the following is somewhat misleading:

      The video goes back to the AI avatar. “I would like to make my own impact statement,” the avatar says.

      I have mixed feelings about the whole thing. It seems that the motivation was genuine compassion from the victim’s family, and a desire to honestly represent victim to the best of their ability. But ultimately, it’s still the victim’s sister’s impact statement, not his.

      Here’s what the judge had to say:

      “I loved that AI, and thank you for that. As angry as you are, and as justifiably angry as the family is, I heard the forgiveness, and I know Mr. Horcasitas could appreciate it, but so did I,” Lang said immediately before sentencing Horcasitas. “I love the beauty in what Christopher, and I call him Christopher—I always call people by their last names, it’s a formality of the court—but I feel like calling him Christopher as we’ve gotten to know him today. I feel that that was genuine, because obviously the forgiveness of Mr. Horcasitas reflects the character I heard about today. But it also says something about the family, because you told me how angry you were, and you demanded the maximum sentence. And even though that’s what you wanted, you allowed Chris to speak from his heart as you saw it. I didn’t hear him asking for the maximum sentence.”

      I am concerned that it could set a precedent for misuse, though. The whole thing seems like very grey to me. I’d suggest everyone read the whole article before passing judgement.

      • Feathercrown@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        2 hours ago

        I was able to be digitally regenerated

        I would like to make my own impact statement

        you allowed Chris to speak from his heart as you saw it. I didn’t hear him asking for the maximum sentence.

        These, especially the second, cross the line imo. The judge acknowledges it’s AI but is acting like it isn’t, and same for the sister especially.

      • LastYearsIrritant@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        7
        ·
        5 hours ago

        Your emotions don’t always line up with “what you know” this is why evidence rules exist in court. Humans don’t work that way. This is why there can be mistrials if specific kinds of evidence is revealed to the jury that shouldn’t have been shown.

        Digital reenactments shouldn’t be allowed, even with disclaimers to the court. It is fiction and has no place here.

    • themeatbridge@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      2
      ·
      edit-2
      6 hours ago

      Victim statements to the court are always emotionally manipulative. It’s akin to playing a video of home movies of the deceased, and obviously the judge understands that it is a fictitious creation.

      • LastYearsIrritant@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        1
        ·
        5 hours ago

        No, this is exactly why it shouldn’t be allowed. This isn’t akin to playing a video of home movies because this is a fake video of the victim. This is complete fiction and people thinking it’s the same thing is what makes it wrong.

        • themeatbridge@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          20 minutes ago

          It is like a home movie in that it is an attempt to humanize the victim. There is no evidence in a home movie, no relevant facts, just an idea of the person that’s gone. You’re right that one is a memory of something that happened while the other is a fabrication of something that might have happened, but they are both equally (ir)relevant and emotionally manipulative. Many jurisdictions do prohibit victim statements beyond a written or verbal testimony. Some countries and states require you to use a form and won’t admit statements that do not adhere to the form.

          Also remember that this is for the judge, not a jury.

    • Semperverus@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      5 hours ago

      Agreed. Until we get full, 100% complete UIs like in Pantheon, this is just Photoshop and a voice synthesizer on crack (not literally, this is an analogy).

  • 0x0@lemmy.zip
    link
    fedilink
    English
    arrow-up
    44
    arrow-down
    1
    ·
    7 hours ago

    Wtaf… regardless of how well he was known by his family, this is the glorified version of a video resumé created by someone else, not the actual person – so it should be accepted as that: someone else’s testimony.

    It’s not even a Reynolds’ beta-level simulation.

    Why the judge accepted is beyond me.

    • Fubarberry@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      8
      ·
      5 hours ago

      Apparently the video was presented after the verdict was already issued. This video had no impact on the actual outcome of the trial, and was more of just a closing statement.

      So the judge didn’t approve this a testimony, but just found it emotionally touching.

    • Nougat@fedia.io
      link
      fedilink
      arrow-up
      23
      ·
      7 hours ago

      Preface: This does not belong in a courtroom. These were not his words. These were words that someone else wrote, and then put into the mouth of a very realistic puppet of him.

      This was a victim impact statement, which I think comes after sentencing. In that case, it wouldn’t have had an impact on sentencing, but I still feel quite strongly that this kind of misrepresentation has no place in a court.

      • mosiacmango@lemm.ee
        link
        fedilink
        English
        arrow-up
        15
        ·
        edit-2
        6 hours ago

        This was shown before the sentencing. The judge referenced it explicitly in their sentencing as a reason to apply leniency.

        From a comment above:

        Here’s what the judge had to say:

        “I loved that AI, and thank you for that. As angry as you are, and as justifiably angry as the family is, I heard the forgiveness, and I know Mr. Horcasitas could appreciate it, but so did I,” Lang said immediately before sentencing Horcasitas. “I love the beauty in what Christopher, and I call him Christopher—I always call people by their last names, it’s a formality of the court—but I feel like calling him Christopher as we’ve gotten to know him today. I feel that that was genuine, because obviously the forgiveness of Mr. Horcasitas reflects the character I heard about today. But it also says something about the family, because you told me how angry you were, and you demanded the maximum sentence. And even though that’s what you wanted, you allowed Chris to speak from his heart as you saw it. I didn’t hear him asking for the maximum sentence.”

        • ricecake@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          7
          ·
          6 hours ago

          It says in the article that the judge gave the maximum sentence.

          The sister who created the video gave a statement as herself asking for something different from what she believed her brother would have wanted, which she chose to express in this fashion.

          I don’t think it was a good thing to do, but it’s worth noting that the judges statement is basically “that was a beautiful statement, and he seemed like a good man”, not an application of leniency.

          • enkers@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            6 hours ago

            I think what’s interesting here is that the family was requesting the maximum sentence, yet they submitted the AI delivered impact statement which asked for compassion, if not leniency, in sentencing. That tells me they did their best to earnestly represent the victim, as it contradicted their stated desired outcome.

            If they’d actually wanted a lenient sentence, they could have just asked for one.

      • prole@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        ·
        6 hours ago

        Given that the victim is dead, they never should have even entertained the possibility for an impact statement.

        If the sister has shit to say, that’s one thing. But this is a travesty.

    • ricecake@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 hours ago

      Hearsay is allowed in sentencing statements, and Arizona allows those statements to be in a format of their choice.

      It’s the phase of the process where the judge hears opinions on what he should sentence the culprit to, so none of it is evidence or treated as anything other than an emotive statement.

      In this case, the sister made two statements: one in the form of a letter where she asked for the maximum sentence, and another in the form of this animation of her brother where she said that he wouldn’t want that and would ask for leniency.

      It’s gross, but it’s not the miscarriage of justice that it seems like from first glance. It was accepted in the same way a poem titled “what my brother would say to you” would be.

  • anachrohack@lemmy.world
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    2
    ·
    7 hours ago

    AI should absolutely never be allowed in court. Defense is probably stoked about this because it’s obviously a mistrial. Judge should be reprimanded for allowing that shit

    • FauxLiving@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      3 hours ago

      AI should absolutely never be allowed in court. Defense is probably stoked about this because it’s obviously a mistrial. Judge should be reprimanded for allowing that shit

      You didn’t read the article.

      This isn’t grounds for a mistrial, the trial was already over. This happened during the sentencing phase. The defense didn’t object to the statements.

      From the article:

      Jessica Gattuso, the victim’s right attorney that worked with Pelkey’s family, told 404 Media that Arizona’s laws made the AI testimony possible. “We have a victim’s bill of rights,” she said. “[Victims] have the discretion to pick what format they’d like to give the statement. So I didn’t see any issues with the AI and there was no objection. I don’t believe anyone thought there was an issue with it.”

    • EveningPancakes@lemm.ee
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      1
      ·
      7 hours ago

      It was after the verdict of the trial. This was displayed during the sentencing hearing where family members get to state how the death affected them. It’s still fucked up, but to be clear it wasn’t used during the trial.

      • BrianTheeBiscuiteer@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        5 hours ago

        Sentencing is still part of the carriage of justice. Fake statements like this should not be allowed until after all verdicts and punishments are decided.

  • BrianTheeBiscuiteer@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    5 hours ago

    “I loved that AI, and thank you for that…” Lang said immediately before sentencing Horcasitas.

    I hope they win that appeal an get a new sentencing or a new trial even. That sounds like a horrible misuse of someone’s likeness. Even if my family used a direct quote from me I’d be PISSED if they recreated my face and voice without my permission.

    • FauxLiving@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      3 hours ago

      They can’t appeal on this issue because the defense didn’t object to the statement and, therefore, did not preserve the issue for appeal.

  • Chulk@lemmy.ml
    link
    fedilink
    English
    arrow-up
    14
    ·
    edit-2
    5 hours ago

    If anyone ever did this with my likeness after death, even with good intentions, i would haunt the fuck out of them.

  • futatorius@lemm.ee
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 hours ago

    The judge should have had the sense to keep this shitty craft project out of the courtroom. Victim statements should also be banned as manipulative glurge.

  • inb4_FoundTheVegan@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    6 hours ago

    “Stacey was up front and the video itself…said it was AI generated. We were very careful to make sure it was clear that these were the words that the family believed Christopher would have to say,”

    “I love the beauty in what Christopher, and I call him Christopher—I always call people by their last names, it’s a formality of the court—but I feel like calling him Christopher as we’ve gotten to know him today.”

    Can’t have it both ways. If you understand this was fabricated AI then you did not “get to know him today”. The facts of the case were already self evident for guilt, but this needs to be a mistrial. We can not have a standard of fair justice when generated AI is treated like living breathing people.

  • Null User Object@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    7 hours ago

    Wales tells 404 Media that her husband, Pelkey’s brother-in-law, recoiled when she told him about the idea.

    Edited to remove utterly extraneous information that added absolutely nothing of value or clarity to the sentence. This is her husband, the victim was her brother. We already know her husband is the victims brother -in-law. That’s how that works.

    • dogslayeggs@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      6 hours ago

      Yeah, that’s a weird bit of writing. It’s completely unnecessary information that adds nothing to the sentence. I don’t know if it’s the case, but this is like a micro-aggression where the author felt the need to add more info about the man instead of the woman.

  • ricecake@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    3
    ·
    5 hours ago

    Jessica Gattuso, the victim’s right attorney that worked with Pelkey’s family, told 404 Media that Arizona’s laws made the AI testimony possible. “We have a victim’s bill of rights,” she said. “[Victims] have the discretion to pick what format they’d like to give the statement. So I didn’t see any issues with the AI and there was no objection. I don’t believe anyone thought there was an issue with it.”

    Gattuso said she understood the concerns, but felt that Pelkey’s AI avatar was handled deftly. “Stacey was up front and the video itself…said it was AI generated. We were very careful to make sure it was clear that these were the words that the family believed Christopher would have to say,” she said. “At no point did anyone try to pass it off as Chris’ own words.”

    The prosecution against Horcasitas was only seeking nine years for the killing. The maximum was 10 and a half years. Stacey had asked the judge for the full sentence during her own impact statement. The judge granted her request, something Stacey credits—in part—to the AI video.

    From a different article quoting a former judge in the court:

    “There are going to be critics, but they picked the right forum to do it. In a trial with a jury you couldn’t do it, but with sentencing, everything is open, hearsay is admissible, both sides can get up and express what they want to do,” McDonald said.

    “The power of it was that the judge had to see the gentleness, the kindness, the feeling of sincerity and having his sister say, ‘Well we don’t agree with it, this is what he would’ve wanted the court to know’,” he said.

    I don’t like it, and it feels dirty to me, but since the law allows them to express basically whatever they want in whatever format they want during this phase, it doesn’t seem harmful in this case, just gross.

    I actually think it’s a little more gross that the family was able to be that forthright and say that the victim would not want what they were asking for, and still ask for it.