The existence and uniqueness of multilinear extensions
For our purposes here, we work over the fieldF2. We can now moreover write F2[X0,…,Xℓ−1] for the ring of multivariate polynomials over F2 in ℓ indeterminates. A polynomial t(X0,…,Xℓ−1)∈F2[X0,…,Xℓ−1] is multilinear if each indeterminate appears in it with individual degree at most 1. We write F2[X0,…,Xℓ−1]⪯1 for the set of multilinears. This thing is 2ℓ-dimensional over F2 (a basis is given by the multilinear monomials1,X0,X1,X0⋅X1,X2,…,X0⋅⋯⋅Xℓ−1).
Multilinear polynomials and lists of field elements are basically the same thing, as we argue now. We will write Bℓ:={0,1}ℓ for the ℓ-dimensional discrete unit cube.
The Equality Indicator Polynomial
For each fixed ℓ≥0, the 2⋅ℓ-variate equality indicator polynomialeq(X0,…,Xℓ−1,Y0,…,Yℓ−1) is defined to be:
This polynomial is multilinear. Moreover, its restriction to the cube Bℓ×Bℓ yields the equality indicator function, the function that, on each pair of bitstrings u and u∗, equals 1 if u=u∗ and 0 otherwise.
Multilinear Extensions
Given some multilinear t(X0,…,Xℓ−1)∈F2[X0,…,Xℓ−1]⪯1, the evaluation map sends t(X0,…,Xℓ−1) to its evaluations on the cube; that is,
eval:t(X0,…,Xℓ−1)↦(t(u))u∈Bℓ.
The problem of reversing this mapping is called "multilinear extension". We're going from the list (tu)u∈Bℓ of prescribed values back to the multilinear t(X0,…,Xℓ−1) takes those values.
We argue that eval is a bijection (multilinear extensions exist and are unique). For dimension-count reasons, it suffices to argue that it's surjective (multilinear extensions exist). Indeed, it's linear over F2, and both the domain and the codomain are 2ℓ-dimensional. If it's surjective, it must also be injective (multilinear extensions are unique).
We fix a list (tu)u∈Bℓ of prescribed values. We're going to solve this problem using multilinear Lagrange interpolation. Indeed, the polynomial
gives us what we want. Why? First off, t(X0,…,Xℓ−1) is definitely multilinear, since each of the partial specializations eq(u0,…,uℓ−1,X0,…,Xℓ−1) is. Moreover, let's pick an arbitrary u∗∈Bℓ. Since eq(u0,…,uℓ−1,u0∗,…,uℓ−1∗) equals 1 if and only if u=u∗, the sum t(u∗) winds up with just one nonzero summand, tu∗⋅eq(u∗,u∗)=tu∗. In other words, t(u∗)=tu∗ holds for each u∗∈Bℓ, which is what we wanted to show.
It's worth pointing out that you can show directly that eval is injective, without relying on dimension-counting or Lagrange interpolation. This proof is fairly interesting too; it's carried out in Thaler [Tha23, Fact 3.5.].
Succinctness
There is one final fact that makes things work. The equality indicator polynomial eq(X0,…,Xℓ−1,Y0,…,Yℓ−1) is succinct, meaning that for each pair of points r and r′ in F2128ℓ, the evaluation eq(r,r′) can be computed in O(ℓ) time.
To see why this is true, just look at the defining equation of eq. It's a product, with ℓ terms; moreover, each term in the product can be computed using just a few operations. Actually, in characteristic 2, things get even nicer: we get the simplification