The Seven Deadly Myths of "Autonomous Systems"
"As designers conceive and implement what are commonly (but mistakely) called autonomous systems, they have succumbed to myths of autonomy that are not only damaging in their own right, but are also damaging by their continued propagation..."
[Bradshaw, Hoffman, Johnson and Woods, IEEE Intelligent Systems, 2013]
- "Autonomy is unidimensional: self-sufficiency vs. self-directedness
- Clearly separated "levels of autonomy"
- Autonomy is a widget
- Autonomous sytems are fully autonomous
- Once achieved, full autonomy obviates need for human collaboration
- More autonomous machines = simple human substitues/force multipliers
- Full autonomy not only possible, but always desirable
We must aim to discard the myths and focus on developing coordination and adaptive mechanisms that yield new levels of mission effectiveness - enabled through genuine human-centeredness.