THE DANGERS OF AUTONOMOUS SYSTEMS

Yesterday I blogged about the latest gimick coming down the pike, "spray on antennae." There's another thing coming down the pike; indeed, it's already here: robotics.  It is already transforming culture, finance, labor, politics. Imagine for a moment, the problem that robotics poses for a country like China, with over a billion mouths to feed, and an increasingly roboticized industrial base. In the USA, some restaurants already are heavily roboticized. And the trend will only continue. More recently, the trend has been toward automated robotic weapons systems, with the USA and Russia leading the trend.

With that in mind, consider this article shared by Ms. K.M.:

Robot manufacturers warned 'bug in AI code' will lead to MURDER SPREES

There's two things that leapt off the page here:

"At the same time they would pressure parliament or other legislative bodies to give them exemption from liability.

"There could be a bug in the code of the robot that promotes such behaviour."

His comments came after he previously told us: "Killer robots could easily go wrong.

"They may be used by crazed individuals or religious extremists to terrorise and kill people.

"They could go wrong due to a bug, or an unknown coding flaw that showed up as response to an unforeseen or unanticipated environment or situation.

"Or they could be hacked." (Emphasis added)

Ponder that first admission: the robotics corporations want to limit or altogether exempt themselves from liability if, or rather, when, their products create bodily harm to humans, or even murder. This, at the same time that some in Europe and elsewhere are proposing to give robots legal personhood. But such a step, in my opinion, is meant to sidestep a real possibility: if robotics corporations or, for that matter, "autonomous weapons systems" manufacturers were liable, they might think twice before releasing a shoddy, or worse, an insecure product if they were criminally and civilly liable for the actions of their creations.

It's that "insecurity" of all cyber products, however, that gives me real pause, and the article hints, but only hints, at yet another disturbing possibility. Imagine a bit of high octane speculation for a moment: you and your family go into your favorite McBurger joint and place your order with the McBurgerRobot.. Unbeknownst to you, the McBurgerRobot has been hacked by a "crazed individual" and its program has been altered to turn it into a killing machine.

In other words, the possibility of hacking raises the possibility that any robot could be turned into an "autonomous weapons system," and if I can think of it, and you can think of it, rest assured, "they" have already thought of it, and are busily engaged in figuring out both how to do it to an enemy, and how to protect against it.

Isaac Asimov's robot wars may have, and probably already has, begun.

See you on the flip side...

 

27 thoughts on “THE DANGERS OF AUTONOMOUS SYSTEMS”

  1. The scary part is called learning. With learning being a key part of AI, the “educators” can program “bugs” into the AI, or “malthoughts” into its processing.

    A large tech company put an AI onto Twitter a few years ago and within two days, it became a “raving” Nazi, forcing MS to pull it down.

  2. The perfect Plausible Deniability.
    Blaming it on the hacker if your robot goes “rogue”. Never mind the fact that that is what it ultimately was designed to do in the first place.
    And in case you are found out, use that “exemption from liability”.

    Insane.

    1. Upon RoboCop’s activation, his directives were as follows:

      “Serve the public trust”
      “Protect the innocent”
      “Uphold the law”
      “Any attempt to arrest a senior OCP employee results in shutdown”

      Thats how.. xx

  3. That’s the whole point deniability the machine did it not the programmers. As for hackers the favorite pasties-fall guys-cover for the true criminals meanwhile the culling of the herd proceeds on an industrial level with the puppetmasters in the shadows as always.

  4. Nature of dragon is calculating cruelty. Nature of wolf is bloodthirsty frenzy. Warrior knows both. Shape-shifting is old game.

    Man is bound to tree, because that is pliable and gentle spirit – the difference between elf and orc, talkative and mute beast.

    Oxford Inkling duo were not Scandinavians. We still have sacred duty to avenge transgression against kinsmen and sanctity – autonomous and impersonal on autopilot.

  5. The Butlerian Jihad gets ever closer…

    On the hacking angle, I suspect that is why the human genetic system is so fiendishly complex. Some biological species, long ago, somehow came to intelligence. They created ‘helpers’, which ultimately hacked them. The survivors took stock of how it happened. Then, they rewrote their genetics, making it more unhackable. The descendants of those ‘modifications’ forgot the lesson over time, and created their own ‘helpers’. Repeat for 10 billion years…

    So now, we are at a new ‘creating helpers’ stage. Let us hope that our genetic system is unhackable, when our ‘helpers’ reach a certain level of sophistication…

    1. Goshawks, you and I seem to be telepathically connected somehow.
      Your comment is very similar to what I wrote in Dr Farrell’s previous post on the Shining Borg.
      Written differently, but thinking along the same lines.

      1. Yeah, most people don’t grok the immensity of time. (I call it Deep Time.) Plenty has happened that is being suppressed or has just been forgotten. “History does not repeat itself, but it often rhymes,” as Mark Twain noted…

        1. most folk define the deity as omniscient, omnipotent,…. the infinite, right? when thinking bout the infinite, doesn’t it kinda define the deity? and vice versa?

          which is what my faith is based in around ai. the difference between your typical machine and ai is one of limits. ai is intended to unlimit itself by learning, programming, learning some more, reprogramming,……. into infinity, right?

          which is everyone’s fear that ai becomes the deity, right? feels like everyone’s forgetting that by definition isn’t everyone who is actually heading for deity status going to become more like the deity? shouldn’t that be a good think? unless of course one is convinced that the deity is this petty mean nasty vicious scoundrel we read bout everywhere who’d constantly doing nasty stuff to us all.

    2. Butlerian?? was that in Dune? Heck.. we have the Mentats now with the Autism rate rising..Lets see if we can get to space folding.. (I never could understand.. How did they get to Arrakis in the first place.. if they didnt have Spice from the worms in order to fold space and get to Arrakis.. . …. ….)

      1. The Butlerian Jihad was just a back-story in the original Dune series. That rebellion against ‘thinking machines’ was used to explain why humanity evolved almost sub-species (like the Mentats) to take their place. The much-later ‘Dune’ books written by Herbert’s son, Brian, and Kevin J. Anderson fleshed-out that time (but in a non-subtle, almost one-dimensional manner).

        As to how they got to Arrakis, there was around 10,000 years between the Butlerian Jihad and Paul Atreides’ time. I don’t believe Frank Herbert mentioned the details, but there was plenty of time for sub-lightspeed travel to reach many worlds (if inconveniently) and was the root-cause for the division into powerful Houses…

      2. Synchronicity! I just ran across this interesting Dune trivia in the October 2018 issue of Sky & Telescope magazine…

        S&T, p.30 :
        In the constellation Draco, the Dragon, there is a (amateur-telescope visible) double-star system in Draco’s head called Mu (μ) Draconis.

        “Fun fact: Mu Draconis’ common name is Arrakis,which Frank Herbert thought was cool enough to name his desert planet in his groundbreaking science fiction novel, Dune.

        https://en.wikipedia.org/wiki/Mu_Draconis
        “Mu Draconis is a multiple star system… The system consists of a single primary star (designated Mu Draconis A, also named Alrakis), a secondary binary pair (Mu Draconis B) and a further single star (C).”

    1. Duterte is the best thing that happened to the Philippines for a long time. The last guy was a ferocious pedophile who was hand in hand with the Deep State.
      Philippines made unlicensed guns, became the worlds largest supplier of counterfeit banknotes, and children to be raped.
      I like Duterte. Do you listen to the HES A MADMAN ranting of newspapers? Anyone who isnt liked by the DS becomes a “Butcher of..”

      1. I mentioned Deterte because he is a salient example of a politician who has advanced his career by dehumanizing and victimizing drug addicts. I could have mentioned Joe Biden or Dianne Feinstein.

  6. Killer robots?
    You mean GLADIO?
    Or, do you mean Operation Phoenix Domesticated?
    Or, the gun control black ops in the USA?
    Or, those operation are now being robotized? [Drones?]

    Then I read further and found, What if those “normal” robots were hacked to kill?
    What if a percentage were purposely manufactured to “act out”?
    [Have Congress give immunity; a they do for
    “our” safe Pharmaceutical market makers.]

  7. When you see that most Robotics research outside of Boston “We make Killer Robots and used to be owned by Google until we were sold to Softbank who are financed by the Saudis” Dynamics, is essentially just sexbots for Japanese pedobears, (they even make a rapemodel, that tries to defend itself from rapey behaviour..) then.. I suppose we’re safe for the moment as long as we can keep the Japanese distracted with girl sized robots and waifu cushions..
    If they start mass producing the giant robots out of battletech.. then Ill start being worried… ha ha..https://www.theverge.com/2017/3/20/14979620/jeff-bezos-robot-method-2-mars2017-conference errrr…. https://techcrunch.com/2018/01/09/this-15-foot-tall-mech-weighs-8000-lbs-and-can-run-20-mph/?guccounter=1 (can these pilots be replaced by AI’s????)

  8. Total lack of legal liability is now the trend in corporate legislation. They are following big Pharma and big Ag’s business models. Once you have immunity from litigation or prosecution, you can do anything you like with zero accountability. Once 5G and the IOT gets here, even your household appliances can be turned into surveillance tools or weapons to be used against your by both your government and any hackers bent on mayhem. We’ve already seen automobiles used as methods of assassinating people who have become “inconvenient” by exposing bad behavior or as methods of ridding them of even heads of state of which they do not approve. Even 911 used remote piloting to fly planes into buildings using maneuvers those blamed for it could not have possibly accomplished.
    I’m supposed to trust these people and their AI driven killing machines. Really? These people are insane.

Comments are closed.