Chess robots to cause Judgement Day?
Washington: Next time you outsmart a computer at chess, think about the implications. It could be a very sore loser!
Humans should be very careful to prevent future computer systems from developing anti-social and potentially harmful behaviour, a new study suggests.
Modern military and economic pressures require autonomous systems that can react quickly - and without human input. These systems will be required to make rational decisions for themselves, researchers said.
"When roboticists are asked by nervous onlookers about safety, a common answer is `We can always unplug it!` But imagine this outcome from the chess robot`s point of view. A future in which it is unplugged is a future in which it cannot play or win any games of chess," researchers said.
Like a plot from The Terminator movie, we are suddenly faced with the prospect of real threat from autonomous systems unless they are designed very carefully, researchers said.
Like a human being or animal seeking self-preservation, a rational machine could exert several harmful or anti-social behaviours.
These behaviours include self-protection, resource acquisition through cyber theft, manipulation or domination; improved efficiency through alternative utilisation of resources and self-improvement such as removing design constraints if doing so is deemed advantageous.
The study published in the Journal of Experimental & Theoretical Artificial Intelligence highlights the vulnerability of current autonomous systems to hackers and malfunctions, citing past accidents that have caused multi-billion dollars` worth of damage, or loss of human life.
The task of designing more rational systems that can safeguard against the malfunctions that occurred in these accidents is a more complex task that is immediately apparent, researchers said.
"Harmful systems might at first appear to be harder to design or less powerful than safe systems. Unfortunately, the opposite is the case. Most simple utility functions will cause harmful behaviour and it is easy to design simple utility functions that would be extremely harmful," they said.
The study concludes by stressing the extreme caution that should be used in designing and deploying future rational technology, researchers said.
It suggests a sequence of provably safe systems should first be developed, and then applied to all future autonomous systems. That should keep future chess robots in check.
More from India
More from World
More from Sports
More from Entertaiment
- Will Akhilesh-Rahul alliance be able to trump BJP in UP elections?
- Arms case: Salman Khan acquitted by Jodhpur court
- Raisina Dialogue 2017: Pakistan must walk away from terror, says PM Modi
- DNA: Analysis of insensitivity shown by political leaders over rising poverty in India
- Valour of a soldier: CRPF officer Satwant Singh fights Naxals till his last breath
- World's 30 most dynamic cities: Check out the full list
- WATCH: Kieron Pollard's incredible one-handed six demoralises Fawad Ahmed
- China State TV said that its troops can reach New Delhi in 48 hours in war scenario; Indians slay it with their replies
- Virat Kohli's 'shot of the year' already has a big challenger – See video to believe!
- Bengaluru pips Silicon Valley to become world's most dynamic city