Week 9: Subset types
- Author
Adam Chlipala, with modifications by CS-428 staff.
- License
No redistribution allowed (usage by permission in CS-428).
So far, we have seen many examples of what we might call "classical program verification." We write programs, write their specifications, and then prove that the programs satisfy their specifications. The programs that we have written in Coq have been normal functional programs that we could just as well have written in Haskell or ML. In this lecture, we start investigating uses of dependent types to integrate programming, specification, and proving into a single phase.
A few programs to puzzle over
Inductive tree := | Leaf (* an empty tree *) | Node (d : nat) (l r : tree). Fixpoint bst (tr : tree) (s : nat -> Prop) : Prop := match tr with | Leaf => forall x, not (s x) | Node d l r => s d /\ bst l (fun x => s x /\ x < d) /\ bst r (fun x => s x /\ d < x) end. Definition bool_tf_p := forall b: bool, b = true \/ b = false.Definition bool_if_s := forall b: bool, if b then nat else string.Definition bool_if: bool_if_s := fun b: bool => match b with | true => 1 | false => "one" end.Definition bool_if_rect: bool_if_s := bool_rec (fun b => if b then nat else string) 1 "one". Definition read (mode: string): match mode with | "r" => string | "rb" => list Byte.byte | _ => unit end := match mode with | "r" => "Hi!" | "rb" => [Byte.x48; Byte.x69; Byte.x21] | _ => tt end. Module Heterogeneous. Inductive type : Set := | Nat : type | Bool : type | Prod : type -> type -> type. Inductive exp : type -> Set := | NConst : nat -> exp Nat | Plus : exp Nat -> exp Nat -> exp Nat | Eq : exp Nat -> exp Nat -> exp Bool | BConst : bool -> exp Bool | And : exp Bool -> exp Bool -> exp Bool | If : forall {t}, exp Bool -> exp t -> exp t -> exp t | Pair : forall {t1 t2}, exp t1 -> exp t2 -> exp (Prod t1 t2) | Fst : forall {t1 t2}, exp (Prod t1 t2) -> exp t1 | Snd : forall {t1 t2}, exp (Prod t1 t2) -> exp t2. Fixpoint typeDenote (t : type) : Set := match t with | Nat => nat | Bool => bool | Prod t1 t2 => typeDenote t1 * typeDenote t2 end%type.Fixpoint expDenote {t} (e : exp t) : typeDenote t := match e with | NConst n => n | Plus e1 e2 => expDenote e1 + expDenote e2 | Eq e1 e2 => if PeanoNat.Nat.eq_dec (expDenote e1) (expDenote e2) then true else false | BConst b => b | And e1 e2 => expDenote e1 && expDenote e2 | If e' e1 e2 => if expDenote e' then expDenote e1 else expDenote e2 | Pair e1 e2 => (expDenote e1, expDenote e2) | Fst e' => fst (expDenote e') | Snd e' => snd (expDenote e') end.End Heterogeneous.2 <> 32 <> 32 = 3 -> FalseH: 2 = 3False(* pattern 2. set (fun _ => _) as f. *)H: 2 = 3match 2 with | 2 => False | _ => True end(* subst f. cbv beta. cbv iota. *) auto. Qed.H: 2 = 3True
Introducing Subset Types
Let us consider several ways of implementing the natural-number-predecessor function. We start by displaying the definition from the standard library:
We can use a new command, Extraction
, to produce an OCaml version of this
function.
Returning 0 as the predecessor of 0 can come across as somewhat of a hack.
In some situations, we might like to be sure that we never try to take the
predecessor of 0. We can enforce this by giving pred
a stronger, dependent
type.
0 > 0 -> Falselia. Qed. Definition pred_strong1 {n : nat} : n > 0 -> nat := match n with | O => fun pf : 0 > 0 => match zgtz pf with end | S n' => fun _ => n' end.0 > 0 -> False
We expand the type of pred
to include a proof that its argument n
is
greater than 0. When n
is 0, we use the proof to derive a contradiction,
which we can use to build a value of any type via a vacuous pattern match.
When n
is a successor, we have no need for the proof and just return the
answer. The proof argument can be said to have a dependent type, because
its type depends on the value of the argument n
.
Coq's Compute
command can execute particular invocations of pred_strong1
just as easily as it can execute more traditional functional programs.
2 > 0lia. Qed.2 > 0
One aspect in particular of the definition of pred_strong1
may be
surprising. We took advantage of Definition
's syntactic sugar for defining
function arguments in the case of n
, but we bound the proofs later with
explicit fun
expressions. Let us see what happens if we write this
function in the way that at first seems most natural.
The term zgtz pf
fails to type-check. Somehow the type checker has failed
to take into account information that follows from which match
branch that
term appears in. The problem is that, by default, match
does not let us
use such implied information. To get refined typing, we must always rely on
match
annotations, either written explicitly or inferred.
In this case, we must use a return
annotation to declare the relationship
between the value of the match
discriminee and the type of the result.
There is no annotation that lets us declare a relationship between the
discriminee and the type of a variable that is already in scope; hence, we
delay the binding of pf
, so that we can use the return
annotation to
express the needed relationship.
We are lucky that Coq's heuristics infer the return
clause (specifically,
return n > 0 -> nat
) for us in the definition of pred_strong1
, leading to
the following elaborated code:
Definition pred_strong1' (n : nat) : n > 0 -> nat :=
match n return n > 0 -> nat with
| O => fun pf : 0 > 0 => match zgtz pf with end
| S n' => fun _ => n'
end.
By making explicit the functional relationship between value n
and the
result type of the match
, we guide Coq toward proper type checking. The
clause for this example follows by simple copying of the original annotation
on the definition. In general, however, the match
annotation inference
problem is undecidable. The known undecidable problem of
higher-order unification reduces to the match
type inference problem.
Over time, Coq is enhanced with more and more heuristics to get around this
problem, but there must always exist match
es whose types Coq cannot infer
without annotations.
Let us now take a look at the OCaml code Coq generates for pred_strong1
.
The proof argument has disappeared! We get exactly the OCaml code we would have written manually. This is our first demonstration of the main technically interesting feature of Coq program extraction: proofs are erased systematically.
We can reimplement our dependently typed pred
based on subset types,
defined in the standard library with the type family sig
.
We rewrite pred_strong1
, using some syntactic sugar for subset types, after
we deactivate some clashing notations for set literals.
Definition pred_strong2 (s : {n : nat | n > 0} ) : nat := match s with | exist _ O pf => match zgtz pf with end | exist _ (S n') _ => n' end.
To build a value of a subset type, we use the exist
constructor, and the
details of how to do that follow from the output of our earlier Print sig
command, where we elided the extra information that parameter A
is
implicit.
We arrive at the same OCaml code as was extracted from pred_strong1
, which
may seem surprising at first. The reason is that a value of sig
is a pair
of two pieces, a value and a proof about it. Extraction erases the proof,
which reduces the constructor exist
of sig
to taking just a single
argument. An optimization eliminates uses of datatypes with single
constructors taking single arguments, and we arrive back where we started.
We can continue on in the process of refining pred
's type. Let us change
its result type to capture that the output is really the predecessor of the
input.
Definition pred_strong3 (s : {n : nat | n > 0}) : {m : nat | proj1_sig s = S m} := match s return {m : nat | proj1_sig s = S m} with | exist _ 0 pf => match zgtz pf with end | exist _ (S n') pf => exist _ n' (eq_refl _) end.
A value in a subset type can be thought of as a dependent pair (or
sigma type) of a base value and a proof about it. The function proj1_sig
extracts the first component of the pair. It turns out that we need to
include an explicit return
clause here, since Coq's heuristics are not
smart enough to propagate the result type that we wrote earlier.
By now, the reader is probably ready to believe that the new pred_strong
leads to the same OCaml code as we have seen several times so far, and Coq
does not disappoint.
We have managed to reach a type that is, in a formal sense, the most
expressive possible for pred
. Any other implementation of the same type
must have the same input-output behavior. However, there is still room for
improvement in making this kind of code easier to write. Here is a version
that takes advantage of tactic-based theorem proving. We switch back to
passing a separate proof argument instead of using a subset type for the
function's input, because this leads to cleaner code. (False_rec
is a
library function that can be used to produce a value in any type given a
proof of False
. It's defined in terms of the vacuous pattern match we saw
earlier.)
forall n : nat, n > 0 -> {m : nat | n = S m}forall n : nat, n > 0 -> {m : nat | n = S m}n: nat
g: 0 > 0Falsen, n': nat
g: S n' > 0S n' = S n'
We build pred_strong4
using tactic-based proving, beginning with a
Definition
command that ends in a period before a definition is given.
Such a command enters the interactive proving mode, with the type given for
the new identifier as our proof goal.
We do most of the work with the refine
tactic, to which we pass a partial
"proof" of the type we are trying to prove. There may be some pieces left
to fill in, indicated by underscores. Any underscore that Coq cannot
reconstruct with type inference is added as a proof subgoal. In this case,
we have two subgoals.
We can see that the first subgoal comes from the second underscore passed
to False_rec
, and the second subgoal comes from the second underscore
passed to exist
. In the first case, we see that, though we bound the
proof variable with an underscore, it is still available in our proof
context. Both subgoals are easy to discharge, so let us back up and ask to
prove all subgoals automatically.
refine (fun n => match n with | O => fun _ => False_rec _ _ | S n' => fun _ => exist _ n' _ end); congruence || lia. Defined.forall n : nat, n > 0 -> {m : nat | n = S m}
We end the "proof" with Defined
instead of Qed
, so that the definition we
constructed remains visible. This contrasts to the case of ending a proof
with Qed
, where the details of the proof are hidden afterward. (More
formally, Defined
marks an identifier as transparent, allowing it to be
unfolded; while Qed
marks an identifier as opaque, preventing unfolding.)
Let us see what our proof script constructed.
We see the code we entered, with some (pretty long!) proofs filled in.
We are almost done with the ideal implementation of dependent predecessor. We can use Coq's syntax-extension facility to arrive at code with almost no complexity beyond a Haskell or ML program with a complete specification in a comment. In this lecture, we will not dwell on the details of syntax extensions; the Coq manual gives a straightforward introduction to them.
Notation "!" := (False_rec _ _). Notation "[ e ]" := (exist _ e _).forall n : nat, n > 0 -> {m : nat | n = S m}refine (fun n => match n with | O => fun _ => ! | S n' => fun _ => [n'] end); congruence || lia. Defined.forall n : nat, n > 0 -> {m : nat | n = S m}
By default, notations are also used in pretty-printing terms, including results of evaluation.
Decidable Proposition Types
There is another type in the standard library that captures the idea of a program value indicating which of two propositions is true.
We have been using this type family behind the scenes for various equality checks, for instance:
Infix "==" := string_dec (at level 70).
Here, the constructors of sumbool
have types written in terms of a
registered notation for sumbool
, such that the result type of each
constructor desugars to sumbool A B
. We can define some notations of our
own to make working with sumbool
more convenient.
Notation "'Yes'" := (left _ _). Notation "'No'" := (right _ _).
The Reduce
notation is notable because it demonstrates how if
is
overloaded in Coq. The if
form actually works when the test expression has
any two-constructor inductive type. Moreover, in the then
and else
branches, the appropriate constructor arguments are bound. This is important
when working with sumbool
s, when we want to have the proof stored in the
test expression available when proving the proof obligations generated in the
appropriate branch.
Now we can write eq_nat_dec
, which compares two natural numbers, returning
either a proof of their equality or a proof of their inequality.
forall n m : nat, {n = m} + {n <> m}refine (fix f (n m : nat) : {n = m} + {n <> m} := match n, m with | O, O => Yes | S n', S m' => Reduce (f n' m') | _, _ => No end); congruence. Defined.forall n m : nat, {n = m} + {n <> m}
Note that the Yes
and No
notations are hiding proofs establishing the
correctness of the outputs.
Our definition extracts to reasonable OCaml code.
Proving this kind of decidable equality result is so common that Coq comes with a tactic for automating it.
decide equality. Defined.n, m: nat{n = m} + {n <> m}
Curious readers can verify that the decide equality
version extracts to the
same OCaml code as our more manual version does. That OCaml code had one
undesirable property, which is that it uses Left
and Right
constructors
instead of the Boolean values built into OCaml. We can fix this, by using
Coq's facility for mapping Coq inductive types to OCaml variant types.
Extract Inductive sumbool => "bool" ["true" "false"].
We can build "smart" versions of the usual Boolean operators and put them to
good use in certified programming. For instance, here is a sumbool
version
of Boolean "or."
Notation "x || y" := (if x then Yes else Reduce y).
Let us use it for building a function that decides list membership. We need to assume the existence of an equality decision procedure for the type of list elements.
Section In_dec. Context {A : Set}. Variable A_eq_dec : forall x y : A, {x = y} + {x <> y}.
The final function is easy to write using the techniques we have developed so far.
A: Set
A_eq_dec: forall x y : A, {x = y} + {x <> y}forall (x : A) (ls : list A), {In x ls} + {~ In x ls}refine (fix f (x : A) (ls : list A) : {In x ls} + {~ In x ls} := match ls with | nil => No | x' :: ls' => A_eq_dec x x' || f x ls' end); simpl; intuition congruence. Defined. End In_dec.A: Set
A_eq_dec: forall x y : A, {x = y} + {x <> y}forall (x : A) (ls : list A), {In x ls} + {~ In x ls}
The In_dec
function has a reasonable extraction to OCaml.
This is more or less the code for the corresponding function from the OCaml standard library.
Partial Subset Types
Our final implementation of dependent predecessor used a very specific
argument type to ensure that execution could always complete normally.
Sometimes we want to allow execution to fail, and we want a more principled
way of signaling failure than returning a default value, as pred
does for
0
. One approach is to define this type family maybe
, which is a version
of sig
that allows obligation-free failure.
Inductive maybe {A : Set} (P : A -> Prop) : Set :=
| Unknown : maybe P
| Found : forall x : A, P x -> maybe P.
We can define some new notations, analogous to those we defined for subset types.
Notation "{{ x | P }}" := (maybe (fun x => P)). Notation "??" := (Unknown _). Notation "[| x |]" := (Found _ x _).
Now our next version of pred
is trivial to write.
forall n : nat, {{m | n = S m}}refine (fun n => match n return {{m | n = S m}} with | O => ?? | S n' => [|n'|] end); trivial. Defined.forall n : nat, {{m | n = S m}}
Because we used maybe
, one valid implementation of the type we gave
pred_strong7
would return ??
in every case. We can strengthen the type
to rule out such vacuous implementations, and the type family sumor
from
the standard library provides the easiest starting point. For type A
and
proposition B
, A + {B}
desugars to sumor A B
, whose values are either
values of A
or proofs of B
.
We add notations for easy use of the sumor
constructors. The second
notation is specialized to sumor`s whose `A
parameters are instantiated
with regular subset types, since this is how we will use sumor
below.
Notation "!!" := (inright _ _). Notation "[|| x ||]" := (inleft _ [x]).
Now we are ready to give the final version of possibly failing predecessor.
The sumor
-based type that we use is maximally expressive; any
implementation of the type has the same input-output behavior.
forall n : nat, {m : nat | n = S m} + {n = 0}refine (fun n => match n with | O => !! | S n' => [||n'||] end); trivial. Defined.forall n : nat, {m : nat | n = S m} + {n = 0}
As with our other maximally expressive pred
function, we arrive at quite
simple output values, thanks to notations.
Monadic Notations
We can treat maybe
like a monad, in the same way that the Haskell Maybe
type is interpreted as a failure monad. Our maybe
has the wrong type to be
a literal monad, but a "bind"-like notation will still be helpful.
Notation "x <- e1 ; e2" := (match e1 with
| Unknown _ => ??
| Found _ x _ => e2
end)
(right associativity, at level 60).
The meaning of x <- e1; e2
is: First run e1
. If it fails to find an
answer, then announce failure for our derived computation, too. If e1
does find an answer, pass that answer on to e2
to find the final result.
The variable x
can be considered bound in e2
.
This notation is very helpful for composing richly typed procedures. For instance, here is a very simple implementation of a function to take the predecessors of two naturals at once.
forall n1 n2 : nat, {{p | n1 = S (fst p) /\ n2 = S (snd p)}}refine (fun n1 n2 => m1 <- pred_strong7 n1; m2 <- pred_strong7 n2; [|(m1, m2)|]); intuition. Defined.forall n1 n2 : nat, {{p | n1 = S (fst p) /\ n2 = S (snd p)}}
We can build a sumor
version of the "bind" notation and use it to write a
similarly straightforward version of this function.
Notation "x <-- e1 ; e2" := (match e1 with | inright _ _ => !! | inleft (exist _ x _) => e2 end) (right associativity, at level 60).forall n1 n2 : nat, {p : nat * nat | n1 = S (fst p) /\ n2 = S (snd p)} + {n1 = 0 \/ n2 = 0}refine (fun n1 n2 => m1 <-- pred_strong8 n1; m2 <-- pred_strong8 n2; [||(m1, m2)||]); intuition. Defined.forall n1 n2 : nat, {p : nat * nat | n1 = S (fst p) /\ n2 = S (snd p)} + {n1 = 0 \/ n2 = 0}
This example demonstrates how judicious selection of notations can hide complexities in the rich types of programs.
A Type-Checking Example
We can apply these specification types to build a certified type checker for a simple expression language.
Inductive exp :=
| Nat (n : nat)
| Plus (e1 e2 : exp)
| Bool (b : bool)
| And (e1 e2 : exp).
We define a simple language of types and its typing rules.
Inductive type := TNat | TBool. Inductive hasType : exp -> type -> Prop := | HtNat : forall n, hasType (Nat n) TNat | HtPlus : forall e1 e2, hasType e1 TNat -> hasType e2 TNat -> hasType (Plus e1 e2) TNat | HtBool : forall b, hasType (Bool b) TBool | HtAnd : forall e1 e2, hasType e1 TBool -> hasType e2 TBool -> hasType (And e1 e2) TBool.
It will be helpful to have a function for comparing two types. We build one
using decide equality
.
decide equality. Defined.forall t1 t2 : type, {t1 = t2} + {t1 <> t2}
Another notation complements the monadic notation for maybe
that we defined
earlier. Sometimes we want to include "assertions" in our procedures. That
is, we want to run a decision procedure and fail if it fails; otherwise, we
want to continue, with the proof that it produced made available to us. This
infix notation captures that idea, for a procedure that returns an arbitrary
two-constructor type.
Notation "e1 ;; e2" := (if e1 then e2 else ??)
(right associativity, at level 60).
Despite manipulating proofs, our type checker is easy to run.
The type checker also extracts to some reasonable OCaml code.
We can adapt this implementation to use sumor
, so that we know our type-checker
only fails on ill-typed inputs. First, we define an analogue to the
"assertion" notation.
Notation "e1 ;;; e2" := (if e1 then e2 else !!)
(right associativity, at level 60).
Our new function remains easy to test:
The results of simplifying calls to typeCheck'
look deceptively similar to
the results for typeCheck
, but now the types of the results provide more
information.