Lenstra–Lenstra–Lovász lattice basis reduction algorithm
In-game article clicks load inline without leaving the challenge.
The Lenstra–Lenstra–Lovász (LLL) lattice basis reduction algorithm is a polynomial time lattice reduction algorithm invented by Arjen Lenstra, Hendrik Lenstra and László Lovász in 1982. Given a basis B = { b 1 , b 2 , … , b d } {\displaystyle \mathbf {B} =\{\mathbf {b} _{1},\mathbf {b} _{2},\dots ,\mathbf {b} _{d}\}} with n-dimensional integer coordinates, for a lattice L (a discrete subgroup of Rn) with d ≤ n {\displaystyle d\leq n}, the LLL algorithm calculates an LLL-reduced (short, nearly orthogonal) lattice basis in time O ( d 5 n log 3 B ) {\displaystyle {\mathcal {O}}(d^{5}n\log ^{3}B)} where B {\displaystyle B} is the largest length of b i {\displaystyle \mathbf {b} _{i}} under the Euclidean norm, that is, B = max ( ‖ b 1 ‖ 2 , ‖ b 2 ‖ 2 , … , ‖ b d ‖ 2 ) {\displaystyle B=\max \left(\|\mathbf {b} _{1}\|_{2},\|\mathbf {b} _{2}\|_{2},\dots ,\|\mathbf {b} _{d}\|_{2}\right)}.
The original applications were to give polynomial-time algorithms for factorizing polynomials with rational coefficients, for finding simultaneous rational approximations to real numbers, and for solving the integer linear programming problem in fixed dimensions.
LLL reduction
The precise definition of LLL-reduced is as follows: Given a basis B = { b 1 , b 2 , … , b n } , {\displaystyle \mathbf {B} =\{\mathbf {b} _{1},\mathbf {b} _{2},\dots ,\mathbf {b} _{n}\},} define its Gram–Schmidt process orthogonal basis B ∗ = { b 1 ∗ , b 2 ∗ , … , b n ∗ } , {\displaystyle \mathbf {B} ^{*}=\{\mathbf {b} _{1}^{*},\mathbf {b} _{2}^{*},\dots ,\mathbf {b} _{n}^{*}\},} and the Gram-Schmidt coefficients μ i , j = ⟨ b i , b j ∗ ⟩ ⟨ b j ∗ , b j ∗ ⟩ , {\displaystyle \mu _{i,j}={\frac {\langle \mathbf {b} _{i},\mathbf {b} _{j}^{*}\rangle }{\langle \mathbf {b} _{j}^{*},\mathbf {b} _{j}^{*}\rangle }},} for any 1 ≤ j < i ≤ n {\displaystyle 1\leq j<i\leq n}.
Then the basis B {\displaystyle B} is LLL-reduced if there exists a parameter δ {\displaystyle \delta } in (0.25, 1] such that the following holds:
- (size-reduced) For 1 ≤ j < i ≤ n : | μ i , j | ≤ 0.5 {\displaystyle 1\leq j<i\leq n\colon \left|\mu _{i,j}\right|\leq 0.5}. By definition, this property guarantees the length reduction of the ordered basis.
- (Lovász condition) For k = 2,3,..,n : δ ‖ b k − 1 ∗ ‖ 2 ≤ ‖ b k ∗ ‖ 2 + μ k , k − 1 2 ‖ b k − 1 ∗ ‖ 2 {\displaystyle \colon \delta \Vert \mathbf {b} _{k-1}^{*}\Vert ^{2}\leq \Vert \mathbf {b} _{k}^{*}\Vert ^{2}+\mu _{k,k-1}^{2}\Vert \mathbf {b} _{k-1}^{*}\Vert ^{2}}.
Here, estimating the value of the δ {\displaystyle \delta } parameter, we can conclude how well the basis is reduced. Greater values of δ {\displaystyle \delta } lead to stronger reductions of the basis. Initially, A. Lenstra, H. Lenstra and L. Lovász demonstrated the LLL-reduction algorithm for δ = 3 4 {\displaystyle \delta ={\frac {3}{4}}}. Note that although LLL-reduction is well-defined for δ = 1 {\displaystyle \delta =1}, the polynomial-time complexity is guaranteed only for δ {\displaystyle \delta } in ( 0.25 , 1 ) {\displaystyle (0.25,1)}.
The LLL algorithm computes LLL-reduced bases. There is no known efficient algorithm to compute a basis in which the basis vectors are as short as possible for lattices of dimensions greater than 4. However, an LLL-reduced basis is nearly as short as possible, in the sense that there are absolute bounds c i > 1 {\displaystyle c_{i}>1} such that the first basis vector is no more than c 1 {\displaystyle c_{1}} times as long as a shortest vector in the lattice, the second basis vector is likewise within c 2 {\displaystyle c_{2}} of the second successive minimum, and so on.
Applications
An early successful application of the LLL algorithm was its use by Andrew Odlyzko and Herman te Riele in disproving the Mertens conjecture.
The LLL algorithm has found numerous other applications in MIMO detection algorithms and cryptanalysis of public-key encryption schemes: knapsack cryptosystems, RSA with particular settings, NTRUEncrypt, and so forth. The algorithm can be used to find integer solutions to many problems.
In particular, the LLL algorithm forms a core of one of the integer relation algorithms. For example, if it is believed that r=1.618034 is a (slightly rounded) root to an unknown quadratic equation with integer coefficients, one may apply LLL reduction to the lattice in R 4 {\displaystyle \mathbf {R} ^{4}} spanned by [ 1 , 0 , 0 , 10000 r 2 ] , [ 0 , 1 , 0 , 10000 r ] , {\displaystyle [1,0,0,10000r^{2}],[0,1,0,10000r],} and [ 0 , 0 , 1 , 10000 ] {\displaystyle [0,0,1,10000]}. The first vector in the reduced basis will be an integer linear combination of these three, thus necessarily of the form [ a , b , c , 10000 ( a r 2 + b r + c ) ] {\displaystyle [a,b,c,10000(ar^{2}+br+c)]}; but such a vector is "short" only if a, b, c are small and a r 2 + b r + c {\displaystyle ar^{2}+br+c} is even smaller. Thus the first three entries of this short vector are likely to be the coefficients of the integral quadratic polynomial which has r as a root. In this example the LLL algorithm finds the shortest vector to be [1, -1, -1, 0.00025] and indeed x 2 − x − 1 {\displaystyle x^{2}-x-1} has a root equal to the golden ratio, 1.6180339887....
Properties of LLL-reduced basis
Let B = { b 1 , b 2 , … , b n } {\displaystyle \mathbf {B} =\{\mathbf {b} _{1},\mathbf {b} _{2},\dots ,\mathbf {b} _{n}\}} be a δ {\displaystyle \delta }-LLL-reduced basis of a lattice L {\displaystyle {\mathcal {L}}}. From the definition of LLL-reduced basis, we can derive several other useful properties about B {\displaystyle \mathbf {B} }.
- The first vector in the basis cannot be much larger than the shortest non-zero vector: ‖ b 1 ‖ ≤ ( 2 / ( 4 δ − 1 ) ) n − 1 ⋅ λ 1 ( L ) {\displaystyle \Vert \mathbf {b} _{1}\Vert \leq (2/({\sqrt {4\delta -1}}))^{n-1}\cdot \lambda _{1}({\mathcal {L}})}. In particular, for δ = 3 / 4 {\displaystyle \delta =3/4}, this gives ‖ b 1 ‖ ≤ 2 ( n − 1 ) / 2 ⋅ λ 1 ( L ) {\displaystyle \Vert \mathbf {b} _{1}\Vert \leq 2^{(n-1)/2}\cdot \lambda _{1}({\mathcal {L}})}.
- The first vector in the basis is also bounded by the determinant of the lattice: ‖ b 1 ‖ ≤ ( 2 / ( 4 δ − 1 ) ) ( n − 1 ) / 2 ⋅ ( det ( L ) ) 1 / n {\displaystyle \Vert \mathbf {b} _{1}\Vert \leq (2/({\sqrt {4\delta -1}}))^{(n-1)/2}\cdot (\det({\mathcal {L}}))^{1/n}}. In particular, for δ = 3 / 4 {\displaystyle \delta =3/4}, this gives ‖ b 1 ‖ ≤ 2 ( n − 1 ) / 4 ⋅ ( det ( L ) ) 1 / n {\displaystyle \Vert \mathbf {b} _{1}\Vert \leq 2^{(n-1)/4}\cdot (\det({\mathcal {L}}))^{1/n}}.
- The product of the norms of the vectors in the basis cannot be much larger than the determinant of the lattice: let δ = 3 / 4 {\displaystyle \delta =3/4}, then ∏ i = 1 n ‖ b i ‖ ≤ 2 n ( n − 1 ) / 4 ⋅ det ( L ) {\textstyle \prod _{i=1}^{n}\Vert \mathbf {b} _{i}\Vert \leq 2^{n(n-1)/4}\cdot \det({\mathcal {L}})}.
LLL algorithm pseudocode
The following description is based on (Hoffstein, Pipher & Silverman 2008, Theorem 6.68), with the corrections from the errata.
Examples
Example from Z 3
Let a lattice basis b 1 , b 2 , b 3 ∈ Z 3 {\displaystyle \mathbf {b} _{1},\mathbf {b} _{2},\mathbf {b} _{3}\in \mathbf {Z} ^{3}}, be given by the columns of [ 1 − 1 3 1 0 5 1 2 6 ] {\displaystyle {\begin{bmatrix}1&-1&3\\1&0&5\\1&2&6\end{bmatrix}}} then the reduced basis is [ 0 1 − 1 1 0 0 0 1 2 ] , {\displaystyle {\begin{bmatrix}0&1&-1\\1&0&0\\0&1&2\end{bmatrix}},} which is size-reduced, satisfies the Lovász condition, and is hence LLL-reduced, as described above. See W. Bosma. for details of the reduction process.
Example from Z[ i ] 4
Likewise, for the basis over the complex integers given by the columns of the matrix below, [ − 2 + 2 i 7 + 3 i 7 + 3 i − 5 + 4 i 3 + 3 i − 2 + 4 i 6 + 2 i − 1 + 4 i 2 + 2 i − 8 + 0 i − 9 + 1 i − 7 + 5 i 8 + 2 i − 9 + 0 i 6 + 3 i − 4 + 4 i ] , {\displaystyle {\begin{bmatrix}-2+2i&7+3i&7+3i&-5+4i\\3+3i&-2+4i&6+2i&-1+4i\\2+2i&-8+0i&-9+1i&-7+5i\\8+2i&-9+0i&6+3i&-4+4i\end{bmatrix}},} then the columns of the matrix below give an LLL-reduced basis. [ − 6 + 3 i − 2 + 2 i 2 − 2 i − 3 + 6 i 6 − 1 i 3 + 3 i 5 − 5 i 2 + 1 i 2 − 2 i 2 + 2 i − 3 − 1 i − 5 + 3 i − 2 + 1 i 8 + 2 i 7 + 1 i − 2 − 4 i ] . {\displaystyle {\begin{bmatrix}-6+3i&-2+2i&2-2i&-3+6i\\6-1i&3+3i&5-5i&2+1i\\2-2i&2+2i&-3-1i&-5+3i\\-2+1i&8+2i&7+1i&-2-4i\\\end{bmatrix}}.}
Implementations
LLL is implemented in
- as the function
lll_reduction_int - as a stand-alone implementation
- FLINT as the function
fmpz_lll - GAP as the function
LLLReducedBasis - Macaulay2 as the function
LLLin the packageLLLBases - Magma as the functions
LLLandLLLGram(taking a gram matrix) - Maple as the function
IntegerRelations[LLL] - Mathematica as the function
LatticeReduce - as the function
LLL - PARI/GP as the function
qflll - as the function
analysis.get_lll_reduced_lattice - SageMath as the method
LLLdriven by fpLLL and NTL - Isabelle/HOL in the 'archive of formal proofs' entry
LLL_Basis_Reduction. This code exports to efficiently executable Haskell.
See also
Notes
- Napias, Huguette (1996). . Journal de Théorie des Nombres de Bordeaux. 8 (2): 387–396. doi:.
- Cohen, Henri (2000). A course in computational algebraic number theory. GTM. Vol. 138. Springer. ISBN 3-540-55640-0.
- Borwein, Peter (2002). Computational Excursions in Analysis and Number Theory. Springer. ISBN 0-387-95444-9.
- Luk, Franklin T.; Qiao, Sanzheng (2011). . Linear Algebra and Its Applications. 434 (11): 2296–2307. doi:.
- Hoffstein, Jeffrey; Pipher, Jill; Silverman, J.H. (2008). An Introduction to Mathematical Cryptography. Springer. ISBN 978-0-387-77993-5.