Glossary

moral status

Whether a being matters for its own sake, so that we owe it something, such as not causing it needless harm. Whether and when AI systems could have it is an open question.

Beings with moral status can be wronged: it matters what happens to them, not only what they can do for us. Most people agree humans have it, and many agree that animals have some.

Whether any AI system could have moral status depends on questions nobody has settled, such as whether it can feel or have experiences. Some researchers now study this directly, because wrongly ignoring a being that matters, or wrongly treating a tool as a person, would both be serious mistakes.

Used in these letters