korrents
Hillel Wayne

Hillel Wayne

@hillel-wayne · 45 positions · On ppll ↗

Writer and consultant on formal methods, testing and software correctness, author of Logic for Programmers and Practical TLA+. He ran the Crossover Project, interviewing seventeen people who worked as traditional engineers before becoming software developers, to settle by evidence whether software engineering is engineering.

Hillel Wayne did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

  1. If I had to summarize what I found in general, I'd put it like this. Everybody hates waterfall.
    spoken · machine transcript hear it at 0:07:09 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 1st of 24 in this recording

  2. The core tension of engineering is between how expensive it is to make a mistake and how quickly you can iterate. The faster you can iterate, the less planning you need to do before you iterate, and the more expensive it is, the more planning you need to do.
    spoken · machine transcript hear it at 0:07:18 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 2nd of 24 in this recording

  3. And the first thing he pointed out to me was that they had their Agile revolution in 1960.
    spoken · machine transcript hear it at 0:08:30 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 3rd of 24 in this recording

  4. open source

    Software is kind of unique in having the third kind of the practitioner conference where we are just meeting to get better at what we do. We also are really the only kind to really focus heavily on like open source in making our knowledge freely available.
    spoken · machine transcript hear it at 0:12:11 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 4th of 24 in this recording

  5. developer tools

    Yeah, I interviewed like 20 people on this. I think all 20 mentioned version control as the thing they wish they had in their old field.
    spoken · machine transcript hear it at 0:15:07 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 5th of 24 in this recording

  6. while we are a lot better at iterating than other fields, we're worse at the planning part. Like we still need to do some kind of planning before we iterate and we just aren't as good as those other fields.
    spoken · machine transcript hear it at 0:15:54 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 6th of 24 in this recording

  7. documentation

    And that kind of compiling of information about the materials is something other fields do that we don't do. An analogy that I would think of in software would be something like a 500-page book on how to version an API.
    spoken · machine transcript hear it at 0:17:03 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 7th of 24 in this recording

  8. LLMs

    I think this project and writing about it and thinking about it has firmly moved me from the camp of we are definitely not to we probably are.
    spoken · machine transcript hear it at 0:17:35 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 8th of 24 in this recording

  9. formal proof

    when you start talking about like most interesting domain problems, you have to pull in so much context that basically even writing what the function is supposed to do becomes a nightmare. The imperative program you write that will get correct 99% of the time is probably good enough to use in almost all cases.
    spoken · machine transcript hear it at 0:23:46 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 9th of 24 in this recording

  10. energyformal proofnuclear power

    but I can tell you with first hand experience nuclear power plants do not care about this stuff. They're actually just fine with with with thorough testing.
    spoken · machine transcript hear it at 0:24:55 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 10th of 24 in this recording

  11. Then the actual system might still have bugs, but we can iron out the issues in the abstraction such that we don't actually build them in the real system.
    spoken · machine transcript hear it at 0:26:19 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 11th of 24 in this recording

  12. I think a large part of the problem of why it's hard for us is because you don't get a lot of practice. Usually when you have a race condition in a system, you find out months later and then you try a fix and you find out weeks later after that if the fix actually worked.
    spoken · machine transcript hear it at 0:42:42 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 12th of 24 in this recording

  13. mathematics

    But I think it is more useful for most developers to have an exposure to like what math has in the various fields versus just going all in every single field when they see them, right? You've got to know what's available to know what's most useful for you. And most math will not be useful for you.
    spoken · machine transcript hear it at 0:47:02 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 13th of 24 in this recording

  14. mathematics

    And I wonder sometimes if that is the reason people don't recognize the use of math in software engineering is because the math they do need is not the math they've been exposed to.
    spoken · machine transcript hear it at 0:49:13 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 14th of 24 in this recording

  15. formal proof

    I think the case of TLA+ and most, not all, but most formal methods, they shine the most in highly computational domains, where most of the problems are highly technical and not like business embedded.
    spoken · machine transcript hear it at 0:50:29 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 15th of 24 in this recording

  16. formal proof

    I think a lot of the reason people are skeptical of these is because they've been burned by things like case and UML and all these other miracle solutions that were forced on them by people who wanted them to use it no matter what.
    spoken · machine transcript hear it at 0:52:31 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 16th of 24 in this recording

  17. formal proofsoftware quality

    I love formal methods, but I think it's a fairly niche tool for most people and I think like property-based testing is in general going to be useful for more people.
    spoken · machine transcript hear it at 1:05:13 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 17th of 24 in this recording

  18. design

    And often I found with my clients I have to tell them like it's doing a good job at generating the actual design, but in actually expressing what the design is supposed to do, it cannot do that yet. You have to do that part yourself.
    spoken · machine transcript hear it at 1:07:38 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 18th of 24 in this recording

  19. LLMs

    As a general thing we've seen like to get good results you have to already know how to get good results without it. It just helps you get good results faster.
    spoken · machine transcript hear it at 1:09:03 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 19th of 24 in this recording

  20. formal proof

    I think it is making it more popular. I don't know if it'll make it go mainstream, but it's definitely making it a lot more popular. It's bringing it from maybe like 0.1% to 0.3% which is huge.
    spoken · machine transcript hear it at 1:10:32 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 20th of 24 in this recording

  21. LLMsinterest rates

    So, it's hard to tell how much of like the loss of the past few years was AI versus the end of like zero interest rate policy and like the post-COVID crash. And I think it's more the latter, but like again, LLMs are still getting better.
    spoken · machine transcript hear it at 1:16:05 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 21st of 24 in this recording

  22. AI and jobs

    I predict that in the next 10 years software development will survive, but it will become like any other white-collar professional work. No more $200,000 salaries, unlimited vacation, or incredible employee bargaining power.
    spoken · machine transcript hear it at 1:19:09 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 22nd of 24 in this recording

  23. And up until now that like could only really happen if one of those people in that family that community or that school was like really really into computers. But now it's possible for everybody to have situated software.
    spoken · machine transcript hear it at 1:21:02 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 23rd of 24 in this recording

  24. But this is the book that I give to every junior engineer because I think like nobody ever really talks about debugging as like a discipline outside of like basic heuristics.
    spoken · machine transcript hear it at 1:22:43 · all korrents from this recording

    ↗Formal methods with Hillel Wayneyoutube.com 24th of 24 in this recording

  25. 6 years earlier
  26. Almost everything we think is unique about software appears in every other field of engineering.

    ↗We Are Not Specialhillelwayne.com 1st of 7 in this piece

  27. humility

    To assume that software is uniquely unpredictable is a special kind of arrogance.

    ↗We Are Not Specialhillelwayne.com 2nd of 7 in this piece

  28. software quality

    Plenty would kill to get the same kind of automated testing we treat as a given.

    ↗We Are Not Specialhillelwayne.com 3rd of 7 in this piece

  29. Software is far more consistent than any other kind of engineering.

    ↗We Are Not Specialhillelwayne.com 4th of 7 in this piece

  30. We can change software much faster than anybody else can change their systems.

    ↗We Are Not Specialhillelwayne.com 5th of 7 in this piece

  31. aviation

    Rather than fix a trad issue with trad engineering, Boeing opted for the software kludge, and then people died.

    ↗We Are Not Specialhillelwayne.com 6th of 7 in this piece