korrents

← People and their mental models

Philip Koopman's mental models

2 claims Philip Koopman made fit 2 mental models. Most often: Margin of safety, Second-order thinking. Everything they said here.

Models we see in what they say

Our reading: their claim applies the idea without naming it. The claim is theirs; filing it here is ours.

Margin of safety

Leave room for being wrong, because sometimes you will be.

Used by 25 others

A self-driving car should be roughly ten times safer than a human driver before it is deployed, to leave engineering margin for what nobody can predict.

  1. Philip Koopman Professor at Carnegie Mellon University who works… Taken together, there is an argument to be made that AVs should be safer than human drivers by about a factor of 10 (being a nice round order of magnitude number) to leave engineering margin for the above considerations. The case for AVs being 10 to 100 times safer than human driverssafeautonomy.blogspot.com · 8 Jan 2023All korrents from this piece
    Taken together, there is an argument to be made that AVs should be safer than human drivers by about a factor of 10 (being a nice round order of magnitude number) to leave engineering margin for the above considerations.

Second-order thinking

Ask "and then what?": follow a decision past its first effect to the ones that come after.

Used by 86 others

Whatever safety gain a driver-assistance system delivers is cancelled out by the driver complacency it creates.

  1. Philip Koopman Professor at Carnegie Mellon University who works… suggests that any steering automation safety gains (e.g., Level 2 autopilot) are approximately negated by driver complacency, with autopilot on being slightly worse than autopilot off Take Tesla safety claims with about a pound of saltsafeautonomy.blogspot.com · 19 Dec 2023All korrents from this piece
    suggests that any steering automation safety gains (e.g., Level 2 autopilot) are approximately negated by driver complacency, with autopilot on being slightly worse than autopilot off