Australia’s first robotic help in a hip replacement operation

The surgeon and the robotic arm will work together on a hip replacement.

The surgeon and the robotic arm will work together on a hip replacement. Stryker, Author provided

Ross Crawford, Queensland University of Technology; Anjali Jaiprakash, Queensland University of Technology, and Jonathan Roberts, Queensland University of Technology

The first robotically assisted hip replacement operation in Australia is due to be performed today on a patient in Brisbane.

A total hip replacement (THR) is one of the most successful operations that surgeons perform, with more than 43,000 carried out last year in Australia alone.

The robot technology to help in such operations has been used for some years in the US but has only recently reached Australia.

But if the operations are so popular and successful, why let a robot in on the surgery?

The hip opp

A hip replacement involves an incision to expose the hip joint and the placement of an acetabular component (the cup) and a femoral component (the stem). A head is then placed on the stem and a ball and socket joint is created that is the patient’s new hip.

A typical ball and socket artificial hip replacement.
Ross Crawford, Author provided

Though very successful, the operation can be quite challenging to perform in certain patients such as the very overweight and those with complex deformities due to childhood diseases or trauma. There is also a learning process for the surgeon in performing a hip replacement and it is hoped this can be shortened by using robotic technology.

Accurate positioning of the components of a hip replacement is important. Having the cup and stem in the correct position can decrease the chance of complications such as dislocation, where the head comes out of the cup. Making sure the joint stem is located in a way to ensure optimal leg length may also lead to improved function of the new hip.

Currently, surgeons rely on their experience and judgement to correctly place the components of a hip replacement. Many studies have shown that even experienced surgeons can have difficulty in reliably and accurately placing the cup in the correct orientation. They sometimes find placement of the stem challenging too.

This is where a robot can help.

The robot surgeon

Up until now, the Australian experience of robotic orthopaedic surgery has been limited to partial knee replacements. The first was carried out in April last year, and since then more than 280 of these procedures have been performed.

The first robotically assisted total hip replacement operation will take place today at Brisbane’s Holy Spirit Northside Hospital, and it’s likely such procedures will quickly become just as popular as the knee operations.

The Stryker Mako advanced robotic arm that helps with the surgery.
Stryker, Author provided

So what is different with a robotic total hip replacement and where does the robot help?

The MAKO robotic system is a carefully controlled robotic arm that aids surgeons in placement of the components of a total hip replacement. It makes the operation more accurate and safer for surgeons, regardless of their experience.

The main difference from a patient’s point of view is that a pre-operative CT scan is needed to plan the procedure. Traditionally, surgeon relied purely on an X-ray to plan a total hip replacement.

When performed by a robot, planning for the procedure is done by specialist engineers in collaboration with the surgeon. The engineer and surgeon work together to determine the optimal position for the components and they create a plan.

The plan places the cup in the correct orientation to match the patient’s anatomy and the stem is also sized to fit the patient’s femur. The aim is to accurately restore the patient’s hip anatomy, particularly leg length.

Once the surgery begins, the surgeon exposes the hip joint in the usual way. Trackers are placed on the pelvis and on the femur allowing the robot to register these bones.

The trackers are attached to the bones using small posts with a screw thread on the tip. A series of points on the patient’s pelvis and femur are then registered and the robot creates a 3D representation that matches the CT scan.

Once the robot understands the geometry, it is able to follow any movement of the patient by the signal transmitted by the trackers fixed to the bones.

A cutting tool called reamer – somewhat like a powered round cheese grater – is attached to the robot and is used to prepare the bone to accept the cup. The surgeon holds the reamer but the robot constrains it and will not let the surgeon remove bone beyond the planned amount.

This will prevent any accidental damage to the bone and make sure the reaming can only occur as planned. Human error is removed from the preparation.

After reaming is finished, the cup is grasped by the robot and the robot sets the correct positioning. The surgeon then hammers the cup into the correct position in the pelvis.

They are able to monitor the position of the implant on the computer screen as it is “seated”. The cup cannot be driven in too far, as the robot constrains where the cup can be placed, as with the reamer.

Next the surgeon places a broach in the femur to prepare a cavity for the femoral component (stem). The broach can be tracked by the robot to make sure it is placed in the correct orientation and the patient’s legs are at the planned length.

Once happy, the surgeon cements the stem into where the broach was positioned, places a head on the femur and puts the head into the cup.

Who’s in charge?

Though the robot is constraining the surgeon to execute the plan, the surgeon remains in charge at all times. The surgeon continues to carry all responsibility for the success of the operation and any complications.

This first step of robotically assisted total hip replacement is relatively easy. The robotic technology (robotics, navigation and haptics) being used is very mature.

But as we are seeing in many industries, the capability of robotics is expanding rapidly. It will not be long before the technology is advanced enough to take over far more of the operation from the human surgeon.

Then the big ethical questions will arise. Even now orthopaedic robots are being limited in what they can do because the step to autonomous surgery is currently a step too far.

Like driverless cars, the questions of liability and trust continue to be aired when discussing robotic-surgery or health care.

But also like driverless cars, robotic surgeons do not have to be perfect. They just have to be better than humans.

The Conversation

Ross Crawford, Professor of Orthopaedic Research, Queensland University of Technology; Anjali Jaiprakash, Post-Doctoral Research Fellow, Medical Robotics, Queensland University of Technology, and Jonathan Roberts, Professor in Robotics, Queensland University of Technology

This article was originally published on The Conversation. Read the original article.

How do robots ‘see’ the world?

Disney’s WALL.E needed to see all the rubbish on Earth so it could clean it up. AAP Image/Tracey Nearmy

Jonathan Roberts, Queensland University of Technology

The world has gone mad for robots with articles talking almost every day about the coming of the robot revolution. But is all the hype, excitement and sometimes fear justified? Is the robot revolution really coming?

The answer is probably that in some areas of our lives we will see more robots soon. But realistically, we are not going to see dozens of robots out and about in our streets or wandering around our offices in the very near future.

One of the main reasons is simply that robots do not yet have the ability to really see the world. But before talking about how robots of the future might see, first we should consider what we actually mean by seeing.

I see you

Most of us have two eyes and we use those eyes to collect light that reflects off the objects around us. Our eyes convert that light it into electrical signals that are sent down our optic nerves, which are immediately processed by our brain.

Our brain somehow works out what is around us from all of those electrical impulses and from our experiences. It builds up a representation of the world and we use that to navigate, to help us pick things up, to enable us to see one another’s faces, and to do a million other things we take for granted.

That whole activity, from collecting the light in our eyes, to having an understanding of the world around us, is what is meant by seeing.

Researchers have estimated that up to 50% of our brain is involved in the process of seeing. Nearly all of the world’s animals have eyes and can see in some way. Most of these animals, insects in particular, have far simpler brains than humans and they function well.

This shows that some forms of seeing can be achieved without the massive computer power of our mammal brains. Seeing has clearly been determined to be quite useful by evolution.

Robot vision

It is therefore unsurprising that many robotics researchers predict that if a robot can see, we are likely to actually see a boom in robotics and robots may finally become the helpers of humans that so many people have desired.

Early days: A vacuum cleaner that can ‘see’ where it needs to clean.

How then do we get a robot to see? The first part is straightforward. We use a video camera, just like the one in your smart phone, to collect a constant stream of images. Camera technology for robots is a large research field in itself but for now just think of a standard video camera. We pass those images to a computer and then we have options.

Since the 1970s, robot vision engineers have thought about features in images. These might be lines, or interesting points like corners or certain textures. The engineers write algorithms to find these features and track them from image frame to image frame in the video stream.

This step is essentially reducing the amount of data from the millions of pixels in an image to a few hundred or thousand features.

In the recent past when computing power was limited, this was an essential step in the process. The engineers then think about what the robot is likely to see and what it will need to do. They write software that will recognise patterns in the world to help the robot understand what is around it.

The local environment

The software may create a very basic map of the environment as the robot operates or it may try to match the features that it finds with a library of features that the software is looking for.

In essence the robots are being programmed by a human to see things that a human thinks the robot is going to need to see. There have been many successful examples of this type of robot vision system, but practically no robot that you find today is capable of navigating in the world using vision alone.

Such systems are not yet reliable enough to keep a robot from bumping or falling long enough to give the robot a practical use. The driverless cars that are talked about in the media either use lasers or radar to supplement their vision systems.

In the past five to ten years a new robot vision research community has started to take shape. These researchers have demonstrated systems that are not programmed as such but instead learn how to see.

They have developed robot vision systems whose structure is inspired by how scientists think animals see. That is they use the concept of layers of neurons, just like in an animal brain. The engineers program the structure of the system but they do not develop the algorithm that runs on that system. That is left to the robot to work out for itself.

This technique is known as machine learning and because we now have easy access to significant computer power at a reasonable cost, these techniques are beginning to work! Investment in these technologies is accelerating fast.

The hive mind

The significance of having robots learn is that they can easily share their learning. One robot will not have to learn from scratch like a newborn animal. A new robot can be given the experiences of other robots and can build upon those.

One robot may learn what a cat looks like and transfer that knowledge to thousands of other robots. More significantly, one robot may solve a complex task such as navigating its way around a part of a city and instantly share that with all the other robots.

Equally important is that robots which share experiences may learn together. For example, one thousand robots may each observe a different cat, share that data with one another via the internet and together learn to classify all cats. This is an example of distributed learning.

The fact that robots of the future will be capable of shared and distributed learning has profound implications and is scaring some, while exciting others.

It is quite possible that your credit card transactions are being checked for fraud right now by a data centre self-learning machine. These systems can spot possible fraud that no human could ever detect. A hive mind being used for good.

The real robot revolution

There are numerous applications for robots that can see. It’s hard not to think of a part of our life where such a robot could not help.

The first uses of robots that can see are likely to be in industries that either have labour shortage issues, such as agriculture, or are inherently unattractive to humans and maybe hazardous.

Examples include searching through rubble after disasters, evacuating people from dangerous situations or working in confined and difficult to access spaces.

Applications that require very long period of attention, something humans find hard, will also be ripe to be done by a robot that can see. Our future home-based robot companions will be far more useful if they can see us.

And in an operating theatre near you, it is soon likely that a seeing robot will be assisting surgeons. The robot’s superior vision and super precise and steady arms and hands will allow surgeons to focus on what they are best at – deciding what to do.

Even that decision-making ability may be superseded by a hive mind of robot doctors. The robots will have it all stitched up!

The Conversation

Jonathan Roberts, Professor in Robotics, Queensland University of Technology

This article was originally published on The Conversation. Read the original article.

Star Wars: these could be the droids we’re looking for in real life

BB-8 (left) is a new droid addition to the Star Wars universe. Disney

Jonathan Roberts, Queensland University of Technology

The latest episode of Star Wars is now upon us and has unleashed a new era of science fantasy robots, or “droids” as they are known.

One of the heroes of the new movie The Force Awakens is BB-8, a cute but capable spherical droid that is at the centre of the story (sorry, no spoilers).

But droids have been at the heart of the epic science fantasy saga since the original Star Wars movie back in 1977, when C-3PO uttered the immortal words:

I am C-3PO, human-cyborg relations. And this is my counterpart R2-D2.

Star Wars has always been a droid story, just as much as a story about the Skywalker family.

The old and the new: C-3PO (left), BB-8 (centre) and R2-D2 (right) from the Star Wars universe.
Reuters/Carlo Allegri

Even though we all know that Star Wars happened a long time ago, in a galaxy far, far away, just how good has it been a predicting the usefulness and development of robots on our own planet today?

Is that you R2?

For those non-Star Wars experts reading this, R2-D2 is an R-series astromech droid. Such droids work on spaceships and are particularly good at working outside in the vacuum of space. They are the mechanics of space travel and are packed with tools and know-how to fix things. They also seem to be fully waterproof, can fly short distances using deployable thrusters and somehow possess a cheeky character.

But did you know that working in orbit around Earth right now is NASA’s Robonaut 2, also known as R2. It is one of the International Space Station’s test bed droids, having a humanoid shape and proportions so that it can undertake maintenance tasks originally designed for human astronauts.

Robonaut2 – or R2 for short – from NASA and General Motors, is a robot designed to work side-by-side with people in difficult or dangerous places on Earth and in space.

Perhaps in the future, when all spaceship maintenance will be performed by droids, this real R2 unit will replace the humanoid form.

The diplomatic droid

The golden humanoid C-3PO is a protocol droid fluent in more than six million forms of communication. A protocol droid’s primary purpose in Star Wars is to help non-droids, creatures of all kinds, communicate with one another and generally avoid potentially dangerous misunderstandings.

If there were protocol droids in Mos Eisley’s Cantina then maybe no-one would have shot first! But as the bartender said of R2-D2 and C-3PO: “We don’t serve their kind here.”

We have human diplomats in our world to negotiate and attempt to head off conflict, and there seems no need for a mechanical interface such as a protocol droid.

But we are seeing translation apps on our phones and their accuracy is improving to the point where it is conceivable that live language translation between two people speaking to one another may not be too far away. Until we find non-human sentient equals then there will be few diplomatic jobs for C-3PO-like droids here on earth.

A place that we are likely to see humanoid robots like C-3PO is as artificial companions and carers. The advantage of a humanoid robot is that it should be able to cope in our homes or care facilities as they have all been designed for humans.

This is one of the great advantages of the humanoid robot form, although there is the so-called “uncanny valley” to deal with and the feeling by some that we should always ensure people have a human touch.

Best Star Wars Droids

A way of thinking about the dozens of droids of Star Wars is to classify them by how they are used. We have seen them being used in applications as diverse as farming, medicine, war, torture and space exploration.

Farming robots

When R2-D2 and C-3PO escape Darth Vader and land in their escape pod on the sand plant of Tatooine, they are picked up by the Jawas scavenging for droids to sell to local moisture farmers. The lack of labour on Tatooine results in droids being critical for the functioning of the farms.

Note to non-Star Wars experts: Darth Vader himself, or the least a young Anakin Skywalker, built C-3PO on Tatooine from spare parts.

In the past year alone, very capable agricultural robots have been demonstrated by Queensland University of Technology, The University of Sydney and by Swarm Farm Robotics.

Robots down on the farm.

Many other research organisations and companies are developing agricultural robotics as a way of overcoming labour availability issues, reducing the cost of inputs such as diesel and herbicide, and enabling the use of smaller machines that compact the soil less than the large tractors we see commonly used today.

Medical robots

In the Star Wars movies, medical droids appear at critical moments. The medical droids 2-1B and FX-7 twice patched up Luke in The Empire Strikes Back. Once when he survived the Wampa attack on Hoth and then again at the end when they grafted on a robotic hand to Luke after his father sliced it off.

Similar Imperial DD-13 medical droids created the droid-like Darth Vader from his battered body following his light sabre duel with Obi Wan on the volcanic plant Mustafar in Revenge of the Sith.

An EW-3 midwife droid even helped Padmé give birth to the twins Luke and Leia just prior to her tragic death.

Here on Earth, Google has been talking about its plans for new medical robots. It’s teaming up with medical device companies to develop new robotic assistants for minimally invasive surgery.

Medical robotic assistants have already become a common sight in well-equipped modern hospitals and are being used to help surgeons during urology procedures and more recently for knee replacements. New research is also showing how novel tentacle-like robot arms may be used to get to difficult to reach places.

The hope is that medical robotics will enable shorter training times for surgeons, lengthen a surgeon’s career and improve outcomes for patients. All these benefits could drive the cost of these procedures down, giving access to more people around the world.

Killer robots

Unsurprisingly, there are many droids in the Star Wars universe dedicated to killing. In Episodes I-III, the Trade Federation used droid starfighters. These were spaceships that were droids themselves and the droid command ships housed thousands of them.

The Trade Federation were also fans of deploying thousands of humanoid shaped B1 Battle Droids. Although they were relatively well equipped, they seemed stupid and were even worse shots than Stormtroopers. The far more capable Destroyer Droids had deflector shields and rapid fire laser cannons.

Killer robots and their development is a hot topic right now on Earth. A campaign has been started with the aim of developing arms controls and some killer robots have already been deployed.

In the Middle East, drones are routinely used to deliver missiles. These are human controlled and are not autonomous but they are changing the face of conflict.

In the DMZ between the Koreas you will find fully autonomous robots equipped with heavy duty, long-range machine guns. If they spot movement in the DMZ they are capable of firing. There is no need for a human in the command chain. They are real Destroyer Droids.

Are these the utility droids you’re looking for?
Flickr/donsolo, CC BY-NC-SA

What is missing?

Even though we can see many examples of how the droids of Star Wars may have inspired the design of the robots of today, there is one major missing piece of technology that means our robots are nothing like a Star Wars droid. And that is the almost complete lack of reliable and capable artificial intelligence in our robots.

Nearly all of the human created robots that I have mentioned rely entirely on a human expert to either control them remotely or program them to do a small range of very specific tasks. The robots that we have today are not very autonomous.

Most of them cannot see, and even if they could, engineers have yet to develop artificial intelligence to the point where a robot by itself could solve a meaningful problem it may encounter in the world.

Really smart robots are coming and many people are working hard to tackle the challenges but we are not likely to see general-purpose droids in the near future. We have a long time to go, and are far, far away from welcoming cute robot companions such as R2-D2 and BB-8 into our homes and workplaces. Until then, let’s just all enjoy Star Wars.

The Conversation

Jonathan Roberts, Professor in Robotics, Queensland University of Technology

This article was originally published on The Conversation. Read the original article.

Your questions answered on artificial intelligence

Have questions about robots and artificial intelligence? Shutterstock

Toby Walsh, Data61; David Dowe, Monash University; Gary Lea, Australian National University; Jai Galliott, UNSW Australia; Jonathan Roberts, Queensland University of Technology; Katina Michael, University of Wollongong; Kevin Korb, Monash University; Robert Sparrow, Monash University, and Sean Welsh, University of Canterbury

Artificial intelligence and robotics have enjoyed a resurgence of interest, and there is renewed optimism about their place in our future. But what do they mean for us?

You submitted your questions about artificial intelligence and robotics, and we put them – and some of our own – to The Conversation’s experts.

Here are your questions answered (scroll down or click on the links below):

  1. How plausible is human-like artificial intelligence, such as the kind often seen in films and TV?
  2. Automation is already replacing many jobs, from bank tellers to taxi drivers in the near future. Is it time to think about making laws to protect some of these industries?
  3. Where will AI be in five-to-ten years?
  4. Should we be concerned about military and other armed robots?
  5. How plausible is super-intelligent artificial intelligence?
  6. Given what little we know about our own minds, can we expect to intentionally create artificial consciousness?
  7. How do cyborgs differ (technically or conceptually) from A.I.?
  8. Are you generally optimistic or pessimistic about the long term future of artificial intelligence and its benefits for humanity?


Q1. How plausible is human-like artificial intelligence?

A. Toby Walsh, Professor of AI:

It is 100% plausible that we’ll have human-like artificial intelligence.

I say this even though the human brain is the most complex system in the universe that we know of. There’s nothing approaching the complexity of the brain’s billions of neurons and trillions of connections. But there are also no physical laws we know of that would prevent us reproducing or exceeding its capabilities.

A. Kevin Korb, Reader in Computer Science

Popular AI from Issac Asimov to Steven Spielberg is plausible. What the question doesn’t address is: when will it be plausible?

Most AI researchers (including me) see little or no evidence of it coming anytime soon. Progress on the major AI challenges is slow, if real.

What I find less plausible than the AI in fiction is the emotional and moral lives of robots. They seem to be either unrealistically empty, such as the emotion-less Data in Star Trek, or unrealistically human-identical or superior, such as the AI in Spike Jonze’s Her.

All three – emotion, ethics and intelligence – travel together, and are not genuinely possible in some form without the others, but fiction writers tend to treat them as separate. Plato’s Socrates made a similar mistake.

A. Gary Lea, Researcher in Artificial Intelligence Regulation

AI is not impossible, but the real issue is: “how like is like?” The answer probably lies in applied tests: the Turing test was already (arguably) passed in 2014 but there is also the coffee test (can an embodied AI walk into an unfamiliar house and make a cup of coffee?), the college degree test and the job test.

If AI systems could progressively pass all of those tests (plus whatever else the psychologists might think of), then we would be getting very close. Perhaps the ultimate challenge would be whether a suitably embodied AI could live among us as J. Average and go undetected for five years or so before declaring itself.

Back to top


Q2. Automation is already replacing many jobs. Is it time make laws to protect some of these industries?

A. Jonathan Roberts, Professor of Robotics

Researchers at the University of Oxford published a now well cited paper in 2013 that ranked jobs in order of how feasible it was to computerise or automate them. They found that nearly half of jobs in the USA could be at risk from computerisation within 20 years.

This research was followed in 2014 by the viral video hit, Humans Need Not Apply, which argued that many jobs will be replaced by robots or automated systems and that employment would be a major issue for humans in the future.

Of course, it is difficult to predict what will happen, as the reasons for replacing people with machines are not simply based around available technology. The major factor is actually the business case and the social attitudes and behaviour of people in particular markets.

A. Rob Sparrow, Professor of Philosophy

Advances in computing and robotic technologies are undoubtedly going to lead to the replacement of many jobs currently done by humans. I’m not convinced that we should be making laws to protect particular industries though. Rather, I think we should be doing two things.

First, we should be making sure that people are assured of a good standard of living and an opportunity to pursue meaningful projects even in a world in which many more jobs are being done by machines. After all, the idea that, in the future, machines would work so that human beings didn’t have to toil used to be a common theme in utopian thought.

When we accept that machines putting people out of work is bad, what we are really accepting is the idea that whether ordinary people have an income and access to activities that can give their lives meaning should be up to the wealthy, who may choose to employ them or not. Instead, we should be looking to redistribute the wealth generated by machines in order to reduce the need for people to work without thereby reducing the opportunities available to them to be doing things that they care about and gain value from.

Second, we should be protecting vulnerable people in our society from being treated worse by machines than they would be treated by human beings. With my mother, Linda Sparrow, I have argued that introducing robots into the aged care setting will most likely result in older people receiving a worse standard of treatment than they already do in the aged care sector. Prisoners and children are also groups who are vulnerable to suffering at the hands of robots introduced without their consent.

A. Toby Walsh, Professor of AI:

There are some big changes about to happen. The #1 job in the US today is truck driver. In 30 years time, most trucks will be autonomous.

How we cope with this change is a question not for technologists like myself but for society as a whole. History would suggest that protectionism is unlikely to work. We would, for instance, need every country in the world to sign up.

But there are other ways we can adjust to this brave new world. My vote would be to ensure we have an educated workforce that can adapt to the new jobs that technology create.

We need people to enter the workforce with skills for jobs that will exist in a couple of decades time when the technologies for these jobs have been invented.

We need to ensure that everyone benefits from the rising tide of technology, not just the owners of the robots. Perhaps we can all work less and share the economic benefits of automation? This is likely to require fundamental changes to our taxation and welfare system informed by the ideas of people like the economist Thomas Piketty.

A. Kevin Korb, Reader in Computer Science

Industrial protection and restriction are the wrong way to go. I’d rather we develop our technology so as to help solve some of our very real problems. That’s bound to bring with it economic dislocation, so a caring society will accommodate those who lose out because of it.

But there’s no reason we can’t address that with improving technology as long as we keep the oligarchs under control. And if we educate people for flexibility rather than to fit into a particular job, intelligent people will be able to cope with the dislocation.

A. Jai Galliot, Defence Analyst

The standard argument is that workers displaced by automation go on to find more meaningful work. However, this does not hold in all cases.

Think about someone who signed up with the Air Force to fly jets. These pilots may have spent their whole social, physical and psychological lives preparing or maintaining readiness to defend their nation and its people.

For service personnel, there are few higher-value jobs than serving one’s nation through rendering active military service on the battlefield, so this assurance of finding alternative and meaningful work in a more passive role is likely to be of little consolation to a displaced soldier.

Thinking beyond the military, we need to be concerned that the Foundation for Young Australians indicates that as many as 60% of today’s young people are being trained for jobs that will soon be transformed due to automation.

The sad fact of the matter is that one robot can replace many workers. The future of developed economies therefore depends on youth adapting to globalised and/or shared jobs that are increasingly complemented by automation within what will inevitably be an innovation and knowledge economy.

Back to top



Q3. Where will AI be in five-to-ten years?

A. Toby Walsh, Professor of AI:

AI will become the operating system of all our connected devices. Apps like Siri and Cortana will morph into the way we interact with the connected world.

AI will be the way we interact with our smarthphones, cars, fridges, central heating system and front door. We will be living in an always-on world.

A. Jonathan Roberts, Professor of Robotics

It is likely that in the next five to ten years we will see machine learning systems interact with us in the form of robots. The next large technology hurdle that must be overcome in robotics is to give them the power of sight.

This is a grand challenge and one that has filled the research careers of many thousands of robotics researchers over the past four or five decades. There is a growing feeling in the robotics community that machine learning using large datasets will finally crack some of the problems in enabling a robot to actually see.

Four universities have recently teamed up in Australia in an ARC funded Centre of Excellence in Robotic Vision. Their mission is to solve many of the problems that prevent robots seeing.

Back to top


Q4. Should we be concerned about military and other armed robots?

A. Rob Sparrow, Professor of Philosophy

The last thing humanity needs now is for many of its most talented engineers and roboticists to be working on machines for killing people.

Robotic weapons will greatly lower the threshold of conflict. They will make it easier for governments to start wars because they will hold out the illusion of being able to fight without taking any casualties. They will increase the risk of accidental war because militaries will deploy unmanned systems in high threat environments, where it would be too risky to place a human being, such as just outside a potential enemy’s airspace or deep sea ports.

In these circumstances, robots may even start wars without any human being having the chance to veto the decision. The use of autonomous robots to kill people threatens to further erode respect for human life.

It was for these reasons that, with several colleagues overseas, I co-founded the International Committee for Robot Arms Control, which has in turn supported the Campaign to Stop Killer Robots.

A. Toby Walsh, Professor of AI:

“Killer robots” are the next revolution in warfare, after gunpowder and nuclear bombs. If we act now, we can perhaps get a ban in place and prevent an arms race to develop better and better killer robots.

A ban won’t uninvent the technology. It’s much the same technology that will go, for instance, into our autonomous cars. And autonomous cars will prevent the 1,000 or so deaths on the roads of Australia each year.

But a ban will associate enough stigma with the technology that arms companies won’t sell them, that arms companies won’t develop them to be better and better at killing humans. This has worked with a number of other weapon types in the past like blinding lasers. If we don’t put a ban in place, you can be sure that terrorists and rogue nations will use killer robots against us.

For those who argue that killer robots are already covered by existing humanitarian law, I profoundly disagree. We cannot correctly engineer them today not to cause excessive collateral damage. And in the future, when we can, there is little stopping them being hacked and made to behave unethically. Even used lawfully, they will be weapons of terror.

You can learn more about these issues by watching my TEDx talk on this topic.

A. Sean Welsh, Researcher in Robot Ethics

We should be concerned about military robots. However, we should not be under the illusion that there is no existing legislation that regulates weaponised robots.

There is no specific law that bans murdering with piano wire. There is simply a general law against murder. We do not need to ban piano wire to stop murders. Similarly, existing laws already forbid the use of any weapons to commit murder in peacetime and to cause unlawful deaths in wartime.

There is no need to ban autonomous weapons as a result of fears that they may be used unlawfully any more than there is a need to ban autonomous cars for fear they might be used illegally (as car bombs). The use of any weapon that is indiscriminate, disproportionate and causes unnecessary suffering is already unlawful under international humanitarian law.

Some advocate that autonomous weapons should be put in the same category as biological and chemical weapons. However, the main reason for bans on chemical and biological weapons is that they are inherently indiscriminate (cannot tell friend from foe from civilian) and cause unnecessary suffering (slow painful deaths). They have no humanitarian positives.

By contrast, there is no suggestion that “killer robots” (even in the examples given by opponents) will necessarily be indiscriminate or cause painful deaths. The increased precision and accuracy of robotic weapons systems compared to human operated ones is a key point in their favour.

If correctly engineered, they would be less likely to cause collateral damage to innocents than human operated weapons. Indeed robot weapons might be engineered so as to be more likely to capture rather than kill. Autonomous weapons do have potential humanitarian positives.

Back to top


Q5. How plausible is super-intelligent AI?

A. David Dowe, Associate Professor in Machine Learning and Artificial Intelligence

We can look at the progress made at various tasks once said to be impossible for machines to do, and see them one by one gradually being achieved. For example: beating the human world chess champion (1997); winning at Jeopardy! (2011); driverless vehicles, which are now somewhat standard on mining sites; automated translation, etc.

And, insofar as intelligence test problems are a measure of intelligence, I’ve recently looked at how computers are performing on these tests.

A. Rob Sparrow, Professor of Philosophy

If there can be artificial intelligence then there can be super-intelligent artificial intelligences. There doesn’t seem to be any reason why entities other than human beings could not be intelligent. Nor does there seem to be any reason to think that highest human IQ represents the upper limit on intelligence.

If there is any danger of human beings creating such machines in the near future, we should be very scared. Think about how human beings treat rats. Why should machines that were as many times more intelligent than us, as we are more intelligent than rats, treat us any better?

Back to top


Q6. Given what little we know about our own minds, can we expect to intentionally create artificial consciousness?

A. Kevin Korb, Reader in Computer Science

As a believer in functionalism, I believe it is possible to create artificial consciousness. It doesn’t follow that we can “expect” to do it, but only that we might.

John Searle’s arguments against the possibility of artificial consciousness seem to confuse functional realisability with computational realisability. That is, it may well be (logically) impossible to “compute” consciousness, but that doesn’t mean that an embedded, functional computer cannot be conscious.

A. Rob Sparrow, Professor of Philosophy

A number of engineers, computer scientists, and science fiction authors argue that we are on the verge of creating artificial consciousness. They usually proceed by estimating the number of neurons in the human brain and pointing out that we will soon be able to build computers with a similar number of logic gates.

If you ask a psychologist or a psychiatrist, whose job it is to actually “fix” minds, I think you will likely get a very different answer. After all, the state-of-the-art treatment for severe depression still consists in shocking the brain with electricity, which looks remarkably like trying to fix a stalled car by pouring petrol over the top of the engine. So I’m sceptical that we understand enough about the mind to design one.

Back to top


Q7. How do cyborgs differ (technically or conceptually) from A.I.?

A. Katina Michael, Associate Professor in Information Systems

A cyborg is a human-machine combination. By definition, a cyborg is any human who adds parts, or enhances his or her abilities by using technology. As we have advanced our technological capabilities, we have discovered that we can merge technology onto and into the human body for prosthesis and/or amplification. Thus, technology is no longer an extension of us, but “becomes” a part of us if we opt into that design.

In contrast, artificial intelligence is the capability of a computer system to learn from its experiences and simulate human intelligence in decision-making. A cyborg usually begins as a human and may undergo a transformational process, whereas artificial intelligence is imbued into a computer system itself predominantly in the form of software.

Some researchers have claimed that a cyborg can also begin in a humanoid robot and incorporate the living tissue of a human or other organism. Regardless, whether it is a human-to-machine or machine-to-organism coalescence, when AI is applied via silicon microchips or nanotechnology embedded into prosthetic forms like a dependent limb, a vital organ, or a replacement/additional sensory input, a human or piece of machinery is said to be a cyborg.

There are already early experiments with such cybernetics. In 1998 Professor Kevin Warwick named his first experiment Cyborg 1.0, surgically implanting a silicon chip transponder into his forearm. In 2002 in project Cyborg 2.0, Warwick had a one hundred electrode array surgically implanted into the median nerve fibres of his left arm.

Ultimately we need to be extremely careful that any artificial intelligence we invite into our bodies does not submerge the human consciousness and, in doing so, rule over it.

Back to top

Cybernetics is already with us.


Q8. Are you generally optimistic or pessimistic about future of artificial intelligence and its benefits for humanity?

A. Toby Walsh, Professor of AI:

I am both optimistic and pessimistic. AI is one of humankind’s truly revolutionary endeavours. It will transform our economies, our society and our position in the centre of this world. If we get this right, the world will be a much better place. We’ll all be healthier, wealthier and happier.

Of course, as with any technology, there are also bad paths we might end up following instead of the good ones. And unfortunately, humankind has a track record of late of following the bad paths.

We know global warming is coming but we seem unable not to follow this path. We know that terrorism is fracturing the world but we seem unable to prevent this. AI will also challenge our society in deep and fundamental ways. It will, for instance, completely change the nature of work. Science fiction will soon be science fact.

A. Rob Sparrow, Professor of Philosophy

I am generally pessimistic about the long term impact of artificial intelligence research on humanity.

I don’t want to deny that artificial intelligence has many benefits to offer, especially in supporting human beings to make better decisions and to pursue scientific goals that are currently beyond our reach. Investigating how brains work by trying to build machines that can do what they do is an interesting and worthwhile project in its own right.

However, there is a real danger that the systems that AI researchers come up with will mainly be used to further enrich the wealthy and to entrench the power of the powerful.

I also think there is a risk that the prospect of AI will allow people to delude themselves that we don’t need to do something about climate change now. It may also distract them from the fact that we already know what to do, but we lack the political will to do it.

Finally, even though I don’t think we’ve currently got much of a clue of how this might happen, if engineers do eventually succeed in creating genuine AIs that are smarter than we are, this might well be a species-level extinction threat.

A. Jonathan Roberts, Professor in Robotics

I am generally optimistic about the long-term future of AI to humanity. I think that AI has the potential to radically change humanity and hence, if you don’t like change, you are not going to like the future.

I think that AI will revolutionise health care, especially diagnosis, and will enable the customisation of medicine to the individual. It is very possible that AI GPs and robot doctors will share their knowledge as they acquire it, creating a super doctor that will have access to all the medical data of the world.

I am also optimistic because humans tend to recognise when technology is having major negative consequences, and we eventually deal with it. Humans are in control and will naturally try and use technology to make a better world.

A. Kevin Korb, Reader in Computer Science

I’m pessimistic about the medium-term future of humanity. I think climate change and attendant dislocations, wars etc. may well massively disrupt science and technology. In that case progress on AI may stop.

If that doesn’t happen, then I think progress will continue and we’ll achieve AI in the long-term. Along the way, AI research will produce spin-offs that help economy and society, so I think as long as it exists AI tech will be important.

A. Gary Lea, Researcher in Artificial Intelligence Regulation

I suspect the long-term future for AI will turn out to be the usual mixed bag: some good, some bad. If scientists and engineers think sensibly about safety and public welfare when making their research, design and build choices (and provided there are suitable regulatory frameworks in place as a backstop), I think we should be okay.

So, on balance, I am cautiously optimistic on this front – but there are many other long-term existential risks for humanity.

Back to top

The Conversation

Toby Walsh, Professor of AI, Research Group Leader, Optimisation Research Group , Data61; David Dowe, Associate Professor, Clayton School of Information Technology, Monash University; Gary Lea, Visiting Researcher in Artificial Intelligence Regulation, Australian National University; Jai Galliott, Research Fellow in Indo-Pacific Defence, UNSW Australia; Jonathan Roberts, Professor in Robotics, Queensland University of Technology; Katina Michael, Associate Professor, School of Information Systems and Technology, University of Wollongong; Kevin Korb, Reader in Computer Science, Monash University; Robert Sparrow, Professor, Department of Philosophy; Adjunct Professor, Centre for Human Bioethics, Monash University, and Sean Welsh, Doctoral Candidate in Robot Ethics, University of Canterbury

This article was originally published on The Conversation. Read the original article.

What human emotions do we really want of artificial intelligence?

The challenge in making AI machines appear more human. Flickr/Rene Passet, CC BY-NC-ND

David Lovell, Queensland University of Technology

Forget the Turing and Lovelace tests on artificial intelligence: I want to see a robot pass the Frampton Test.

Let me explain why rock legend Peter Frampton enters the debate on AI.

For many centuries, much thought was given to what distinguishes humans from animals. These days thoughts turn to what distinguishes humans from machines.

The British code breaker and computing pioneer, Alan Turing, proposed “the imitation game” (also known as the Turing test) as a way to evaluate whether a machine can do something we humans love to do: have a good conversation.

If a human judge cannot consistently distinguish a machine from another human by conversation alone, the machine is deemed to have passed the Turing Test.

Initially, Turing proposed to consider whether machines can think, but realised that, thoughtful as we may be, humans don’t really have a clear definition of what thinking is.

Tricking the Turing test

Maybe it says something of another human quality – deviousness – that the Turing Test came to encourage computer programmers to devise machines to trick the human judges, rather than embody sufficient intelligence to hold a realistic conversation.

This trickery climaxed on June 7, 2014, when Eugene Goostman convinced about a third of the judges in the Turing Test competition at the Royal Society that “he” was a 13-year-old Ukrainian schoolboy.

Eugene was a chatbot: a computer program designed to chat with humans. Or, chat with other chatbots, for somewhat surreal effect (see the video, below).

And critics were quick to point out the artificial setting in which this deception occurred.

The creative mind

Chatbots like Eugene led researchers to throw down a more challenging gauntlet to machines: be creative!

In 2001, researchers Selmer Bringsjord, Paul Bello and David Ferrucci proposed the Lovelace Test – named after 19th century mathematician and programmer Ada, Countess of Lovelace – that asked for a computer to create something, such as a story or poem.

Computer generated poems and stories have been around for a while, but to pass the Lovelace Test, the person who designed the program must not be able to account for how it produces its creative works.

Mark Riedl, from the School of Interactive Computing at Georgia Tech, has since proposed an upgrade (Lovelace 2.0) that scores a computer in a series of progressively more demanding creative challenges.

This is how he describes being creative:

In my test, we have a human judge sitting at a computer. They know they’re interacting with an AI, and they give it a task with two components. First, they ask for a creative artifact such as a story, poem, or picture. And secondly, they provide a criterion. For example: “Tell me a story about a cat that saves the day,” or “Draw me a picture of a man holding a penguin.”

But what’s so great about creativity?

Challenging as Lovelace 2.0 may be, it’s argued that we should not place creativity above other human qualities.

This (very creative) insight from Dr Jared Donovan arose in a panel discussion with roboticist Associate Professor Michael Milford and choreographer Prof Kim Vincs at Robotronica 2015 earlier this month.

Amid all the recent warnings that AI could one day lead to the end of humankind, the panel’s aim was to discuss the current state of creativity and robots. Discussion led to questions about the sort of emotions we would want intelligent machines to express.

Empathy – the ability to understand and share feelings of another – was top of the list of desirable human qualities that day, perhaps because it goes beyond mere recognition (“I see you are angry”) and demands a response that demonstrates an appreciation of emotional impact.

Hence, I propose the Frampton Test, after the critical question posed by rock legend Peter Frampton in the 1973 song “Do you feel like we do?

True, this is slightly tongue in cheek, but I imagine that to pass the Frampton Test an artificial system would have to give a convincing and emotionally appropriate response to a situation that would arouse feelings in most humans. I say most because our species has a spread of emotional intelligence levels.

I second that emotion

Noting that others have explored this territory and that the field of “affective computing” strives to imbue machines with the ability to simulate empathy, it is still fascinating to contemplate the implications of emotional machines.

This July, AI and robotics researchers released an open letter on the peril of autonomous weapons. If machines could have even a shred of empathy, would we fear these developments in the same way?

This reminds us, too, that human emotions are not all positive: hate, anger, resentment and so on. Perhaps we should be more grateful that the machines in our lives don’t display these feelings. (Can you imagine a grumpy Siri?)

Still, there are contexts where our nobler emotions would be welcome: sympathy and understanding in health care for instance.

As with all questions worthy of serious consideration, the Robotronica panellists did not resolve whether robots could perhaps one day be creative, or whether indeed we would want that to pass.

As for machine emotion, I think the Frampton Test will be even longer in the passing. At the moment the strongest emotions I see around robots are those of their creators.

Acknowledgement: This article were inspired by discussion and debate at the Robotronica 2015 panel session The Lovelace Test: Can Robots be Creative? and I gratefully acknowledge the creative insights of panellists Dr Jared Donovan (QUT), Associate Professor Michael Milford (QUT) and Professor Kim Vincs (Deakin).

The Conversation

David Lovell, Head of the School of Electrical Engineering and Computer Science, Queensland University of Technology

This article was originally published on The Conversation. Read the original article.