Moral cognition & norms

How people and agents learn, represent, and enforce norms, and what it takes for an agent to take part in a normative community.

Curated by
Tan Zhi Xuan
Relevant for
4 grid cellsTacit norms for agent interactions and 3 others
Write to
norms@agi-institutions.orgAn operator routes it to the right experts.

Selected papers

3

Must-reads for understanding the field and why it matters for AGI institutions.

  1. Argues that AI agents need the ability to recognize and participate in human normative institutions, rather than merely optimize independently specified goals, and sets out a technical research agenda for that normative competence.

  2. Grounds alignment in the agreements stakeholders would endorse, approximated through cognitively inspired heuristics that trade deliberative effort against accuracy.

  3. Builds agents that infer obligative and prohibitive norms from observed compliance, letting groups converge on shared institutions such as resource management and compensation rules.

Work in the field

11

Recent work in the field worth knowing.

Foundations

8

Older work that gives background on the field.

This list isn't exhaustive. About the lists.