Tag Archive

You are currently browsing the tag archive for the ‘parity problem’ tag.

Notes on the Bombieri asymptotic sieve

17 July, 2016 in expository, math.NT | Tags: Bombieri sieve, parity problem, sieve theory, twin primes | by Terence Tao | 45 comments

The twin prime conjecture, still unsolved, asserts that there are infinitely many primes ${p}$ such that ${p+2}$ is also prime. A more precise form of this conjecture is (a special case) of the Hardy-Littlewood prime tuples conjecture, which asserts that

$\displaystyle \sum_{n \leq x} \Lambda(n) \Lambda(n+2) = (2\Pi_2+o(1)) x \ \ \ \ \ (1)$

as ${x \rightarrow \infty}$ , where ${\Lambda}$ is the von Mangoldt function and ${\Pi_2 = 0.6606\dots}$ is the twin prime constant

$\displaystyle \prod_{p>2} (1 - \frac{1}{(p-1)^2}).$

Because ${\Lambda}$ is almost entirely supported on the primes, it is not difficult to see that (1) implies the twin prime conjecture.

One can give a heuristic justification of the asymptotic (1) (and hence the twin prime conjecture) via sieve theoretic methods. Recall that the von Mangoldt function can be decomposed as a Dirichlet convolution

$\displaystyle \Lambda(n) = \sum_{d|n} \mu(d) \log \frac{n}{d}$

where ${\mu}$ is the Möbius function. Because of this, we can rewrite the left-hand side of (1) as

$\displaystyle \sum_{d \leq x} \mu(d) \sum_{n \leq x: d|n} \log\frac{n}{d} \Lambda(n+2). \ \ \ \ \ (2)$

To compute this double sum, it is thus natural to consider sums such as

$\displaystyle \sum_{n \leq x: d|n} \log \frac{n}{d} \Lambda(n+2)$

or (to simplify things by removing the logarithm)

$\displaystyle \sum_{n \leq x: d|n} \Lambda(n+2).$

The prime number theorem in arithmetic progressions suggests that one has an asymptotic of the form

$\displaystyle \sum_{n \leq x: d|n} \Lambda(n+2) \approx \frac{g(d)}{d} x \ \ \ \ \ (3)$

where ${g}$ is the multiplicative function with ${g(d)=0}$ for ${d}$ even and

$\displaystyle g(d) := \frac{d}{\phi(d)} = \prod_{p|d} (1-\frac{1}{p})^{-1}$

for ${d}$ odd. Summing by parts, one then expects

$\displaystyle \sum_{n \leq x: d|n} \Lambda(n+2)\log \frac{n}{d} \approx \frac{g(d)}{d} x \log \frac{x}{d}$

and so we heuristically have

$\displaystyle \sum_{n \leq x} \Lambda(n) \Lambda(n+2) \approx x \sum_{d \leq x} \frac{\mu(d) g(d)}{d} \log \frac{x}{d}.$

The Dirichlet series

$\displaystyle \sum_n \frac{\mu(n) g(n)}{n^s}$

has an Euler product factorisation

$\displaystyle \sum_n \frac{\mu(n) g(n)}{n^s} = \prod_p (1 - \frac{g(p)}{p^s})$

for ${\hbox{Re} s > 1}$ ; comparing this with the Euler product factorisation

$\displaystyle \zeta(s) = \prod_p (1 - \frac{1}{p^s})^{-1}$

for the Riemann zeta function, and recalling that ${\zeta}$ has a simple pole of residue ${1}$ at ${s=1}$ , we see that

$\displaystyle \sum_n \frac{\mu(n) g(n)}{n^s} = \frac{1}{\zeta(s)} \prod_p \frac{1-g(p)/p^s}{1-p^s}$

has a simple zero at ${s=1}$ with first derivative

$\displaystyle \prod_p \frac{1 - g(p)/p}{1-1/p} = 2 \Pi_2.$

From this and standard multiplicative number theory manipulations, one can calculate the asymptotic

$\displaystyle \sum_{d \leq x} \frac{\mu(d) g(d)}{d} \log \frac{x}{d} = 2 \Pi_2 + o(1)$

which concludes the heuristic justification of (1).

What prevents us from making the above heuristic argument rigorous, and thus proving (1) and the twin prime conjecture? Note that the variable ${d}$ in (2) ranges to be as large as ${x}$ . On the other hand, the prime number theorem in arithmetic progressions (3) is not expected to hold for ${d}$ anywhere that large (for instance, the left-hand side of (3) vanishes as soon as ${d}$ exceeds ${x}$ ). The best unconditional result known of the type (3) is the Siegel-Walfisz theorem, which allows ${d}$ to be as large as ${\log^{O(1)} x}$ . Even the powerful generalised Riemann hypothesis (GRH) only lets one prove an estimate of the form (3) for ${d}$ up to about ${x^{1/2-o(1)}}$ .

However, because of the averaging effect of the summation in ${d}$ in (2), we don’t need the asymptotic (3) to be true for all ${d}$ in a particular range; having it true for almost all ${d}$ in that range would suffice. Here the situation is much better; the celebrated Bombieri-Vinogradov theorem (sometimes known as “GRH on the average”) implies, roughly speaking, that the approximation (3) is valid for almost all ${d \leq x^{1/2-\varepsilon}}$ for any fixed ${\varepsilon>0}$ . While this is not enough to control (2) or (1), the Bombieri-Vinogradov theorem can at least be used to control variants of (1) such as

$\displaystyle \sum_{n \leq x} (\sum_{d|n} \lambda_d) \Lambda(n+2)$

for various sieve weights ${\lambda_d}$ whose associated divisor function ${\sum_{d|n} \lambda_d}$ is supposed to approximate the von Mangoldt function ${\Lambda}$ , although that theorem only lets one do this when the weights ${\lambda_d}$ are supported on the range ${d \leq x^{1/2-\varepsilon}}$ . This is still enough to obtain some partial results towards (1); for instance, by selecting weights according to the Selberg sieve, one can use the Bombieri-Vinogradov theorem to establish the upper bound

$\displaystyle \sum_{n \leq x} \Lambda(n) \Lambda(n+2) \leq (4+o(1)) 2 \Pi_2 x, \ \ \ \ \ (4)$

which is off from (1) by a factor of about ${4}$ . See for instance this blog post for details.

It has been difficult to improve upon the Bombieri-Vinogradov theorem in its full generality, although there are various improvements to certain restricted versions of the Bombieri-Vinogradov theorem, for instance in the famous work of Zhang on bounded gaps between primes. Nevertheless, it is believed that the Elliott-Halberstam conjecture (EH) holds, which roughly speaking would mean that (3) now holds for almost all ${d \leq x^{1-\varepsilon}}$ for any fixed ${\varepsilon>0}$ . (Unfortunately, the ${\varepsilon}$ factor cannot be removed, as investigated in a series of papers by Friedlander, Granville, and also Hildebrand and Maier.) This comes tantalisingly close to having enough distribution to control all of (1). Unfortunately, it still falls short. Using this conjecture in place of the Bombieri-Vinogradov theorem leads to various improvements to sieve theoretic bounds; for instance, the factor of ${4+o(1)}$ in (4) can now be improved to ${2+o(1)}$ .

In two papers from the 1970s (which can be found online here and here respectively, the latter starting on page 255 of the pdf), Bombieri developed what is now known as the Bombieri asymptotic sieve to clarify the situation more precisely. First, he showed that on the Elliott-Halberstam conjecture, while one still could not establish the asymptotic (1), one could prove the generalised asymptotic

$\displaystyle \sum_{n \leq x} \Lambda_k(n) \Lambda(n+2) = (2\Pi_2+o(1)) k x \log^{k-1} x \ \ \ \ \ (5)$

for all natural numbers ${k \geq 2}$ , where the generalised von Mangoldt functions ${\Lambda_k}$ are defined by the formula

$\displaystyle \Lambda_k(n) := \sum_{d|n} \mu(d) \log^k \frac{n}{d}.$

These functions behave like the von Mangoldt function, but are concentrated on ${k}$ -almost primes (numbers with at most ${k}$ prime factors) rather than primes. The right-hand side of (5) corresponds to what one would expect if one ran the same heuristics used to justify (1). Sadly, the ${k=1}$ case of (5), which is just (1), is just barely excluded from Bombieri’s analysis.

More generally, on the assumption of EH, the Bombieri asymptotic sieve provides the asymptotic

$\displaystyle \sum_{n \leq x} \Lambda_{(k_1,\dots,k_r)}(n) \Lambda(n+2) \ \ \ \ \ (6)$

$\displaystyle = (2\Pi_2+o(1)) \frac{\prod_{i=1}^r k_i!}{(k_1+\dots+k_r-1)!} x \log^{k_1+\dots+k_r-1} x$

for any fixed ${r \geq 1}$ and any tuple ${(k_1,\dots,k_r)}$ of natural numbers other than ${(1,\dots,1)}$ , where

$\displaystyle \Lambda_{(k_1,\dots,k_r)} := \Lambda_{k_1} * \dots * \Lambda_{k_r}$

is a further generalisation of the von Mangoldt function (now concentrated on ${k_1+\dots+k_r}$ -almost primes). By combining these asymptotics with some elementary identities involving the ${\Lambda_{(k_1,\dots,k_r)}}$ , together with the Weierstrass approximation theorem, Bombieri was able to control a wide family of sums including (1), except for one undetermined scalar ${\delta_x \in [0,2]}$ . Namely, he was able to show (again on EH) that for any fixed ${r \geq 1}$ and any continuous function ${g_r}$ on the simplex ${\Delta_r := \{ (t_1,\dots,t_r) \in {\bf R}^r: t_1+\dots+t_r = 1; 0 \leq t_1 \leq \dots \leq t_r\}}$ that had suitable vanishing at the boundary, the sum

$\displaystyle \sum_{n \leq x: n=p_1 \dots p_r} g_r( \frac{\log p_1}{\log n}, \dots, \frac{\log p_r}{\log n} ) \Lambda(n+2)$

was equal to

$\displaystyle (\delta_x+o(1)) \int_{\Delta_r} g_r \frac{x}{\log x} \ \ \ \ \ (7)$

when ${r}$ was odd and

$\displaystyle (2-\delta_x+o(1)) \int_{\Delta_r} g_r \frac{x}{\log x} \ \ \ \ \ (8)$

when ${r}$ was even, where the integral on ${\Delta_r}$ is with respect to the measure ${\frac{dt_1 \dots dt_{r-1}}{t_1 \dots t_r}}$ (this is Dirac measure in the case ${r=1}$ ). In particular, we have

$\displaystyle \sum_{n \leq x} \Lambda(n) \Lambda(n+2) = (\delta_x + o(1)) 2 \Pi_2 x$

and the twin prime conjecture would be proved if one could show that ${\delta_x}$ is bounded away from zero, while (1) is equivalent to the assertion that ${\delta_x}$ is equal to ${1+o(1)}$ . Unfortunately, no additional bound beyond the inequalities ${0 \leq \delta_x \leq 2}$ provided by the Bombieri asymptotic sieve is known, even if one assumes all other major conjectures in number theory than the prime tuples conjecture and its variants (e.g. GRH, GEH, GUE, abc, Chowla, …).

To put it another way, the Bombieri asymptotic sieve is able (on EH) to compute asymptotics for sums

$\displaystyle \sum_{n \leq x} f(n) \Lambda(n+2) \ \ \ \ \ (9)$

without needing to know the unknown scalar ${\delta_x}$ , when ${f}$ is a function supported on almost primes of the form

$\displaystyle f(p_1 \dots p_r) = g_r( \frac{\log p_1}{\log n}, \dots, \frac{\log p_r}{\log n} )$

for ${1 \leq r \leq r_*}$ and some fixed ${r_*}$ , with ${f}$ vanishing elsewhere and for some continuous (symmetric) functions ${g_r: \Delta_r \rightarrow {\bf C}}$ obeying some vanishing at the boundary, so long as the parity condition

$\displaystyle \sum_{r \hbox{ odd}} \int_{\Delta_r} g_r = \sum_{r \hbox{ even}} \int_{\Delta_r} g_r$

is obeyed (informally: ${f}$ gives the same weight to products of an odd number of primes as to products of an even number of primes, or to put it another way, ${f}$ is asymptotically orthogonal to the Möbius function ${\mu}$ ). But when ${f}$ violates the parity condition, the asymptotic involves the unknown ${\delta_x}$ . This scalar ${\delta_x}$ thus embodies the “parity problem” for the twin prime conjecture (discussed in these previous blog posts).

Because the obstruction to the parity problem is only one-dimensional (on EH), one can replace any parity-violating weight (such as ${\Lambda}$ ) with any other parity-violating weight and obtain a logically equivalent estimate. For instance, to prove the twin prime conjecture on EH, it would suffice to show that

$\displaystyle \sum_{p_1 p_2 p_3 \leq x: p_1,p_2,p_3 \geq x^\alpha} \Lambda(p_1 p_2 p_3 + 2) \gg \frac{x}{\log x}$

for some fixed ${\alpha>0}$ , or equivalently that there are ${\gg \frac{x}{\log^2 x}}$ solutions to the equation ${p - p_1 p_2 p_3 = 2}$ in primes with ${p \leq x}$ and ${p_1,p_2,p_3 \geq x^\alpha}$ . (In some cases, this sort of reduction can also be made using other sieves than the Bombieri asymptotic sieve, as was observed by Ng.) As another example, the Bombieri asymptotic sieve can be used to show that the asymptotic (1) is equivalent to the asymptotic

$\displaystyle \sum_{n \leq x} \mu(n) 1_R(n) \Lambda(n+2) = o( \frac{x}{\log x})$

where ${R}$ is the set of numbers that are rough in the sense that they have no prime factors less than ${x^\alpha}$ for some fixed ${\alpha>0}$ (the function ${\mu 1_R}$ clearly correlates with ${\mu}$ and so must violate the parity condition). One can replace ${1_R}$ with similar sieve weights (e.g. a Selberg sieve) that concentrate on almost primes if desired.

As it turns out, if one is willing to strengthen the assumption of the Elliott-Halberstam (EH) conjecture to the assumption of the generalised Elliott-Halberstam (GEH) conjecture (as formulated for instance in Claim 2.6 of the Polymath8b paper), one can also swap the ${\Lambda(n+2)}$ factor in the above asymptotics with other parity-violating weights and obtain a logically equivalent estimate, as the Bombieri asymptotic sieve also applies to weights such as ${\mu 1_R}$ under the assumption of GEH. For instance, on GEH one can use two such applications of the Bombieri asymptotic sieve to show that the twin prime conjecture would follow if one could show that there are ${\gg \frac{x}{\log^2 x}}$ solutions to the equation

$\displaystyle p_1 p_2 - p_3 p_4 = 2$

in primes with ${p_1,p_2,p_3,p_4 \geq x^\alpha}$ and ${p_1 p_2 \leq x}$ , for some ${\alpha > 0}$ . Similarly, on GEH the asymptotic (1) is equivalent to the asymptotic

$\displaystyle \sum_{n \leq x} \mu(n) 1_R(n) \mu(n+2) 1_R(n+2) = o( \frac{x}{\log^2 x})$

for some fixed ${\alpha>0}$ , and similarly with ${1_R}$ replaced by other sieves. This form of the quantitative twin primes conjecture is appealingly similar to the (special case)

$\displaystyle \sum_{n \leq x} \mu(n) \mu(n+2) = o(x)$

of the Chowla conjecture, for which there has been some recent progress (discussed for instance in these recent posts). Informally, the Bombieri asymptotic sieve lets us (on GEH) view the twin prime conjecture as a sort of Chowla conjecture restricted to almost primes. Unfortunately, the recent progress on the Chowla conjecture relies heavily on the multiplicativity of ${\mu}$ at small primes, which is completely destroyed by inserting a weight such as ${1_R}$ , so this does not yet yield a viable path towards the twin prime conjecture even assuming GEH. Still, the similarity is striking, and one can hope that further ways to attack the Chowla conjecture may emerge that could impact the twin prime conjecture. (Alternatively, if one assumes a sufficiently optimistic version of the GEH, one could perhaps relax the notion of “almost prime” to the extent that one could start usefully using multiplicativity at smallish primes, though this seems rather wishful at present, particularly since the most optimistic versions of GEH are known to be false.)

The Bombieri asymptotic sieve is already well explained in the original two papers of Bombieri; there is also a slightly different treatment of the sieve by Friedlander and Iwaniec, as well as a simplified version in the book of Friedlander and Iwaniec (in which the distribution hypothesis is strengthened in order to shorten the arguments. I’ve decided though to write up my own notes on the sieve below the fold; this is primarily for my own benefit, but may be useful to some readers also. I largely follow the treatment of Bombieri, with the one idiosyncratic twist of replacing the usual “elementary” Selberg sieve with the “analytic” Selberg sieve used in particular in many of the breakthrough works in small gaps between primes; I prefer working with the latter due to its Fourier-analytic flavour.

— 1. Controlling generalised von Mangoldt sums —

To prove (5), we shall first generalise it, by replacing the sequence ${\Lambda(n+2)}$ by a more general sequence ${a_n}$ obeying the following axioms:

(i) (Non-negativity) One has ${a_n \geq 0}$ for all ${n}$ .
(ii) (Crude size bound) One has ${a_n \ll \tau(n)^{O(1)} \log^{O(1)} n}$ for all ${n}$ , where ${\tau}$ is the divisor function.
(iii) (Size) We have ${\sum_{n \leq x} a_n = (C+o(1)) x}$ for some constant ${C>0}$ .
(iv) (Elliott-Halberstam type conjecture) For any ${\varepsilon,A>0}$ , one has
$\displaystyle \sum_{d \leq x^{1-\varepsilon}} |\sum_{n \leq x: d|n} a_n - C x \frac{g(d)}{d}| \ll_{\varepsilon,A} x \log^{-A} x$

where ${g}$ is a multiplicative function with ${g(p^j) = 1 + O(1/p)}$ for all primes ${p}$ and ${j \geq 1}$ .

These axioms are a little bit stronger than what is actually needed to make the Bombieri asymptotic sieve work, but we will not attempt to work with the weakest possible axioms here.

We introduce the function

$\displaystyle G(s) := \prod_p \frac{1-g(p)/p^s}{1-1/p^s}$

which is analytic for ${\hbox{Re}(s) > 0}$ ; in particular it can be evaluated at ${s=1}$ to yield

$\displaystyle G(1) = \prod_p \frac{1-g(p)/p}{1-1/p}.$

There are two model examples of data ${a_n, C, g}$ to keep in mind. The first, discussed in the introduction, is when ${a_n =\Lambda(n+2)}$ , then ${C = 2 \Pi_2}$ and ${g}$ is as in the introduction; one of course needs EH to justify axiom (iv) in this case. The other is when ${a_n=1}$ , in which case ${C=1}$ and ${g(n)=1}$ for all ${n}$ . We will later take advantage of the second example to avoid doing some (routine, but messy) main term computations.

The main result of this section is then

Theorem 1 Let ${a_n, g, C, G}$ be as above. Let ${\vec k = (k_1,\dots,k_r)}$ be a tuple of natural numbers (independent of ${x}$ ) that is not equal to ${(1,\dots,1)}$ . Then one has the asymptotic

$\displaystyle \sum_{n \leq x} \Lambda_{\vec k}(n) a_n = (G(1)+o(1)) \frac{\prod_{i=1}^r k_i!}{(|\vec k|-1)!} C x \log^{|\vec k|-1} x$

as ${x \rightarrow \infty}$ , where ${|\vec k| := k_1 + \dots + k_r}$ .

Note that this recovers (5) (on EH) as a special case.

We now begin the proof of this theorem. Henceforth we allow implied constants in the ${O()}$ or ${\ll}$ notation to depend on ${r, \vec k}$ and ${g,G}$ .

It will be convenient to replace the range ${n \leq x}$ by a shorter range by the following standard localisation trick. Let ${B}$ be a large quantity depending on ${r, \vec k}$ to be chosen later, and let ${I}$ denote the interval ${\{ n: x - x \log^{-B} x \leq n \leq x \}}$ . We will show the estimate

$\displaystyle \sum_{n \in I} \Lambda_{\vec k}(n) a_n = (G(1)+o(1)) \frac{\prod_{i=1}^r k_i!}{(|\vec k|-1)!} C |I| \log^{|\vec k|-1} x \ \ \ \ \ (10)$

from which the original claim follows by a routine summation argument. Observe from axiom (iv) and the triangle inequality that

$\displaystyle \sum_{d \leq x^{1-\varepsilon}: \mu^2(d)=1} |\sum_{n \in I: d|n} a_n - C |I| \frac{g(d)}{d}| \ll_{\varepsilon,A} x \log^{-A} x$

for any ${\varepsilon,A > 0}$ .

Write ${L}$ for the logarithm function ${L(n) := \log n}$ , thus ${\Lambda_k = \mu * L^k}$ for any ${k}$ . Without loss of generality we may assume that ${k_r > 1}$ ; we then factor ${\Lambda_{\vec k} = \mu_{\vec k} * L^{k_r}}$ , where

$\displaystyle \mu_{\vec k} := \Lambda_{k_1} * \dots * \Lambda_{k_{r-1}} * \mu.$

This function is just ${\mu}$ when ${r=1}$ . When ${r>1}$ the function is more complicated, but we at least have the following crude bound:

Lemma 2 One has the pointwise bound ${|\mu_{\vec k}| \leq L^{|\vec k|-k_r}}$ .

Proof: We induct on ${r}$ . The case ${r=1}$ is obvious, so suppose ${r>1}$ and the claim has already been proven for ${r-1}$ . Since ${\mu_{\vec k} = \Lambda_{k_1} * \mu_{(k_2,\dots,k_r)}}$ , we see from induction hypothesis and the triangle inequality that

$\displaystyle |\mu_{\vec k}| \leq \Lambda_{k_1} * L^{|\vec k| - k_r - k_1} \leq L^{|\vec k| - k_r - k_1} (\Lambda_{k_1} * 1).$

Since ${\Lambda_{k_1}*1 = L^{k_1}}$ by Möbius inversion, the claim follows. $\Box$

We can write

$\displaystyle \Lambda_{\vec k}(n) = \sum_{d|n} \mu_{\vec k}(d) \log^{k_r} \frac{n}{d}.$

In the region ${n \in I}$ , we have ${\log^{k_r} \frac{n}{d} = \log^{k_r} \frac{x}{d} + O( \log^{-B+O(1)} x )}$ . Thus

$\displaystyle \Lambda_{\vec k}(n) = \sum_{d|n} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d} + O( \tau(x) \log^{-B+O(1)} x )$

for ${n \in I}$ . The contribution of the error term to ${O( \tau(x) \log^{-B+O(1)} x )}$ to (10) is easily seen to be negligible if ${B}$ is large enough, so we may freely replace ${\Lambda_{\vec k}(n)}$ with ${\sum_{d|n} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d}}$ with little difficulty.

If we insert this replacement directly into the left-hand side of (10) and rearrange, we get

$\displaystyle \sum_{d \leq x} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d} \sum_{n \in I: d|n} a_d.$

We can’t quite control this using axiom (iv) because the range of ${d}$ is a bit too big, as explained in the introduction. So let us introduce a truncated function

$\displaystyle \Lambda_{\vec k,\varepsilon}(n) := \sum_{d|n} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d} \eta_\varepsilon( \frac{\log d}{\log x} ) \ \ \ \ \ (11)$

where ${\varepsilon>0}$ is a small quantity to be chosen later, and ${\eta_\varepsilon: {\bf R} \rightarrow [0,1]}$ is a smooth function that equals ${1}$ on ${(-\infty,1-4\varepsilon)}$ and equals ${0}$ on ${(1-3\varepsilon,+\infty)}$ . Suppose one could establish the following two estimates for any fixed ${\varepsilon>0}$ :

$\displaystyle \sum_{n \in I} \Lambda_{\vec k}(n) a_n = \sum_{n \in I} \Lambda_{\vec k,\varepsilon}(n) a_n + O( (\varepsilon+o(1)) C |I| \log^{|\vec k|-1} x ) \ \ \ \ \ (12)$

and

$\displaystyle \sum_{n \in I} \Lambda_{\vec k,\varepsilon}(n) a_n = C Q_{\varepsilon,x} G(1) + o( |I| \log^{|\vec k|-1} x ) \ \ \ \ \ (13)$

where ${Q_{\varepsilon,x}}$ is a quantity that depends on ${\varepsilon, \eta_\varepsilon, \vec k, B, x}$ but not on ${C, g,G}$ . Then on combining the two estimates we would have

$\displaystyle \sum_{n \in I} \Lambda_{\vec k}(n) a_n = C Q_{\varepsilon,x} G(1) + (O(\varepsilon) + o(1)) C |I| \log^{|\vec k|-1} x. \ \ \ \ \ (14)$

One could in principle compute ${Q_{\varepsilon,x}}$ explicitly from the proof of (13), but one can avoid doing so by the following comparison trick. In the special case ${a_n=1}$ , standard multiplicative number theory (noting that the Dirichlet series ${\sum_n \frac{\Lambda_{\vec k}(n)}{n^s}}$ has a pole of order ${|\vec k|}$ at ${s=1}$ , with top Laurent coefficient ${\prod_{j=1}^r k_j!}$ ) gives the asymptotic

$\displaystyle \sum_{n \in I} \Lambda_{\vec k}(n) a_n = \frac{\prod_{i=1}^r k_i!}{(|\vec k|-1)!} + o(1)) |I| \log^{|\vec k|-1} x$

which when compared with (14) for ${a_n=1}$ (recalling that ${G(1)=C=1}$ in this case) gives the formula

$\displaystyle Q_{\varepsilon,x} = (\prod_{j=1}^r k_j + O(\varepsilon)) |I| \log^{|\vec k|-1} x.$

Inserting this back into (14) and recalling that ${\varepsilon>0}$ can be made arbitrarily small, we obtain (10).

As it turns out, the estimate (13) is easy to establish, but the estimate (12) is not, roughly speaking because the typical number ${n}$ in ${I}$ has too many divisors ${d}$ in the range ${[x^{1-4\varepsilon},1]}$ , each of which gives a contribution to the error term. (In the book of Friedlander and Iwaniec, the estimate (13) is established anyway, but only after assuming a stronger version of (iv), roughly speaking in which ${d}$ is allowed to be as large as ${x \exp( -\log^{1/4} x)}$ .) To resolve this issue, we will insert a preliminary sieve ${\nu_\varepsilon}$ that will remove most of the potential divisors ${d}$ i the range ${[x^{1-4\varepsilon},1]}$ (leaving only about ${O(1)}$ such divisors on the average for typical ${n}$ ), making the analogue of (12) easier to prove (at the cost of making the analogue of (13) more difficult). Namely, if one can find a function ${\nu_\varepsilon: {\bf N} \rightarrow {\bf R}}$ for which one has the estimates

$\displaystyle \sum_{n \in I} \Lambda_{\vec k}(n) a_n = \sum_{n \in I} \Lambda_{\vec k}(n) \nu_\varepsilon(n) a_n + O( (\varepsilon+o(1)) C |I| \log^{|\vec k|-1} x ), \ \ \ \ \ (15)$

$\displaystyle \sum_{n \in I} \Lambda_{\vec k}(n) \nu_\varepsilon(n) a_n$

$\displaystyle = \sum_{n \in I} \Lambda_{\vec k,\varepsilon}(n) \nu_\varepsilon(n) a_n + O( (\varepsilon+o(1)) C |I| \log^{|\vec k|-1} x ) \ \ \ \ \ (16)$

and

$\displaystyle \sum_{n \in I} \Lambda_{\vec k,\varepsilon}(n) \nu_\varepsilon(n) a_n = C Q'_{\varepsilon,x} G(1) + o( |I| \log^{|\vec k|-1} x ) \ \ \ \ \ (17)$

for some quantity ${Q'_{\varepsilon,x}}$ that depends on ${\varepsilon, \eta_\varepsilon, \vec k, B, x}$ but not on ${C, g, G,}$ , then by repeating the previous arguments we will again be able to establish (10).

The key estimate is (16). As we shall see, when comparing ${\Lambda_{\vec k}(n) \nu_\varepsilon(n)}$ with ${\Lambda_{\vec k,\varepsilon}(n) \nu_\varepsilon(n)}$ , the weight ${\nu_\varepsilon}$ will cost us a factor of ${1/\varepsilon}$ , but the ${\log^{k_r} \frac{x}{d}}$ term in the definitions of ${\Lambda_{\vec k}}$ and ${\Lambda_{\vec k,\varepsilon}}$ will recover a factor of ${\varepsilon^{k_r}}$ , which will give the desired bound since we are assuming ${k_r > 1}$ .

One has some flexibility in how to select the weight ${\nu_\varepsilon}$ : basically any standard sieve that uses divisors of size at most ${x^{2\varepsilon}}$ to localise (at least approximately) to numbers that are rough in the sense that they have no (or at least very few) factors less than ${x^\varepsilon}$ , will do. We will use the analytic Selberg sieve choice

$\displaystyle \nu_\varepsilon(n) := (\sum_{d|n} \mu(d) \psi( \frac{\log d}{\varepsilon \log x} ))^2 \ \ \ \ \ (18)$

where ${\psi: {\bf R} \rightarrow [0,1]}$ is a smooth function supported on ${[-1,1]}$ that equals ${1}$ on ${[-1/2,1/2]}$ .

It remains to establish the bounds (15), (16), (17). To warm up and introduce the various methods needed, we begin with the standard bound

$\displaystyle \sum_{n \in I} \nu_\varepsilon(n) a_n = \frac{C|I|}{\varepsilon \log x} (\int_0^1 \psi'(u)^2\ du) G(1) + o(1)), \ \ \ \ \ (19)$

where ${\psi'}$ denotes the derivative of ${\psi}$ . Note the loss of ${1/\varepsilon}$ that had previously been pointed out. In the arguments that follows I will be a little brief with the details, as they are standard (see e.g. this previous post).

We now prove (19). The left-hand side can be expanded as

$\displaystyle \sum_{d_1,d_2} \mu(d_1) \mu(d_2) \psi( \frac{\log d_1}{\varepsilon \log x} ) \psi( \frac{\log d_2}{\varepsilon \log x} ) \sum_{n \in I: [d_1,d_2]|n} a_n$

where ${[d_1,d_2]}$ denotes the least common multiple of ${d_1}$ and ${d_2}$ . From the support of ${\psi}$ we see that the summand is only non-vanishing when ${[d_1,d_2] \leq x^{2\varepsilon}}$ . We now use axiom (iv) and split the left-hand side into a main term

$\displaystyle \sum_{d_1,d_2} \mu(d_1) \mu(d_2) \psi( \frac{\log d_1}{\varepsilon \log x} ) \psi( \frac{\log d_2}{\varepsilon \log x} ) \frac{g(d)}{d} C |I|$

and an error term that is at most

$\displaystyle O_\varepsilon( \sum_{d \leq x^{2\varepsilon}} \tau(d)^{O(1)} | \sum_{n \in I: d|n} a_n - \frac{g(d)}{d} C |I|| ). \ \ \ \ \ (20)$

From axiom (ii) and elementary multiplicative number theory, we have the bound

$\displaystyle \sum_{d \leq x} \tau(d)^{O(1)} | \sum_{n \in I: d|n} a_n - \frac{g(d)}{d} C |I| \ll C |I| \log^{O(1)} x$

so from axiom (iv) and Cauchy-Schwarz we see that the error term (20) is acceptable. Thus it will suffice to establish the bound

$\displaystyle \sum_{d_1,d_2} \mu(d_1) \mu(d_2) \psi( \frac{\log d_1}{\varepsilon \log x} ) \psi( \frac{\log d_2}{\varepsilon \log x} ) \frac{g([d_1,d_2])}{[d_1,d_2]}$

$\displaystyle = \frac{1}{\varepsilon \log x} (\int_0^1 \psi'(u)^2\ du) G(1) + o(\frac{1}{\log x}). \ \ \ \ \ (21)$

The summand here is almost, but not quite, multiplicative in ${d_1,d_2}$ . To make it genuinely multiplicative, we perform a (shifted) Fourier expansion

$\displaystyle \psi(u) = \int_{\bf R} e^{-(1+it)u} \Psi(t)\ dt \ \ \ \ \ (22)$

for some rapidly decreasing function ${\Psi}$ (essentially the Fourier transform of ${e^u \psi(u)}$ ). Thus

$\displaystyle \psi( \frac{\log d}{\varepsilon \log x} ) = \int_{\bf R} \frac{1}{d^{\frac{1+it}{\varepsilon \log x}}} \Psi(t)\ dt,$

and so the left-hand side of (21) can be rearranged using Fubini’s theorem as

$\displaystyle \int_{\bf R} \int_{\bf R} E(\frac{1+it_1}{\varepsilon \log x},\frac{1+it_2}{\varepsilon \log x})\ \Psi(t_1) \Psi(t_2) dt_1 dt_2 \ \ \ \ \ (23)$

where

$\displaystyle E(s_1,s_2) := \sum_{d_1,d_2} \frac{\mu(d_1) \mu(d_2)}{d_1^{s_1}d_2^{s_2}} \frac{g([d_1,d_2])}{[d_1,d_2]}.$

We can factorise ${E(s_1,s_2)}$ as an Euler product:

$\displaystyle E(s_1,s_2) = \prod_p (1 - \frac{g(p)}{p^{1+s_1}} - \frac{g(p)}{p^{1+s_2}} + \frac{g(p)}{p^{1+s_1+s_2}}).$

Taking absolute values and using Mertens’ theorem leads to the crude bound

$\displaystyle E(\frac{1+it_1}{\varepsilon \log x},\frac{1+it_2}{\varepsilon \log x}) \ll_\varepsilon \log^{O(1)} x$

which when combined with the rapid decrease of ${\Psi}$ , allows us to restrict the region of integration in (23) to the square ${\{ |t_1|, |t_2| \leq \sqrt{\log x} \}}$ (say) with negligible error. Next, we use the Euler product

$\displaystyle \zeta(s) = \prod_p (1-\frac{1}{p^s})^{-1}$

for ${\hbox{Re} s > 1}$ to factorise

$\displaystyle E(s_1,s_2) = \frac{\zeta(1+s_1+s_2)}{\zeta(1+s_1) \zeta(1+s_2)} \prod_p E_p(s_1,s_2)$

where

$\displaystyle E_p(s_1,s_2) := \frac{(1 - \frac{g(p)}{p^{1+s_1}} - \frac{g(p)}{p^{1+s_2}} + \frac{g(p)}{p^{1+s_1+s_2}})(1 - \frac{1}{p^{1+s_1+s_2}})}{(1-\frac{1}{p^{1+s_1}})(1-\frac{1}{p^{1+s_2}})}.$

For ${s_1,s_2=o(1)}$ with nonnegative real part, one has

$\displaystyle E_p(s_1,s_2) = 1 + O(1/p^2)$

and so by the Weierstrass ${M}$ -test, ${\prod_p E_p(s_1,s_2)}$ is continuous at ${s_1=s_2=0}$ . Since

$\displaystyle \prod_p E_p(0,0) = G(1)$

we thus have

$\displaystyle \prod_p E_p(s_1,s_2) = G(1) + o(1)$

Also, since ${\zeta}$ has a pole of order ${1}$ at ${s=1}$ with residue ${1}$ , we have

$\displaystyle \frac{\zeta(1+s_1+s_2)}{\zeta(1+s_1) \zeta(1+s_2)} = (1+o(1)) \frac{s_1 s_2}{s_1+s_2}$

and thus

$\displaystyle E(s_1,s_2) = (G(1)+o(1)) \frac{s_1s_2}{s_1+s_2}.$

The quantity (23) can thus be written, up to errors of ${o(\frac{1}{\log x})}$ , as

$\displaystyle \frac{G(1)}{\varepsilon \log x} \int_{|t_1|, |t_2| \leq \sqrt{\log x}} \frac{(1+it_1)(1+it_2)}{1+it_1+1+it_2} \Psi(t_1) \Psi(t_2)\ dt_1 dt_2.$

Using the rapid decrease of ${\Psi}$ , we may remove the restriction on ${t_1,t_2}$ , and it will now suffice to prove the identity

$\displaystyle \int_{\bf R} \int_{\bf R} \frac{(1+it_1)(1+it_2)}{1+it_1+1+it_2} \Psi(t_1) \Psi(t_2)\ dt_1 dt_2 = (\int_0^1 \psi'(u)^2\ du)^2.$

But on differentiating and then squaring (22) we have

$\displaystyle \psi'(u)^2 = \int_{\bf R} \int_{\bf R} (1+it_1)(1+it_2) e^{-(1+it_1+1+it_2)u}\Psi(t_1) \Psi(t_2)\ dt_1 dt_2$

and the claim follows by integrating in ${u}$ from zero to infinity (noting that ${\psi'}$ vanishes for ${u>1}$ ).

We have the following variant of (19):

Lemma 3 For any ${d \leq x^{1-3\varepsilon}}$ , one has

$\displaystyle \sum_{n \in I: d|n} \nu_\varepsilon(n) a_n \ll \frac{C|I|}{\varepsilon \log x} \frac{\prod_{p|d} O( \min( \frac{\log p}{\varepsilon \log x}, 1 )^2 )}{d} + R_d \ \ \ \ \ (24)$

where the ${R_d}$ are such that

$\displaystyle \sum_{d \leq x^{1-3\varepsilon}} R_d \ll_A |I| \log^{-A} x \ \ \ \ \ (25)$

for any ${A>0}$ . We also have the variant

$\displaystyle \sum_{n \in I: d|n} \nu_\varepsilon(n/d) a_n \ll \frac{C|I|}{\varepsilon \log x} \frac{\prod_{p|d} O(1 ) )}{d} + R_d. \ \ \ \ \ (26)$

If in addition ${d}$ has no prime factors less than ${x^\delta}$ for some fixed ${\delta>0}$ , one has

$\displaystyle \sum_{n \in I: d|n} \nu_\varepsilon(n) a_n$

$\displaystyle = \frac{1+o(1)}{d} \frac{C|I|}{\varepsilon \log x} (\int_0^1 \psi'(u)^2\ du) G(1) + O(R_d). \ \ \ \ \ (27)$

Roughly speaking, the above estimates assert that ${\nu_\varepsilon}$ is concentrated on those numbers ${n}$ with no prime factors much less than ${x^\varepsilon}$ , but factors ${d}$ without such small prime divisors occur with about the same relative density as they do in the integers.

Proof: The left-hand side of (24) can be expanded as

$\displaystyle \sum_{d_1,d_2} \mu(d_1) \mu(d_2) \psi( \frac{\log d_1}{\varepsilon \log x} ) \psi( \frac{\log d_2}{\varepsilon \log x} ) \sum_{n \in I: [d_1,d_2,d]|n} a_n.$

If we define

$\displaystyle R_d := \sum_{d' \leq x^{1-\varepsilon}: d|d'} \tau(d')^2 |\sum_{n \in I:d'|n} a_n - \frac{g(d')}{d'} C|I||$

then the previous expression can be written as

$\displaystyle \sum_{d_1,d_2} \mu(d_1) \mu(d_2) \psi( \frac{\log d_1}{\varepsilon \log x} ) \psi( \frac{\log d_2}{\varepsilon \log x} ) \frac{g([d_1,d_2,d])}{[d_1,d_2,d]} C|I| + O(R_d),$

while one has

$\displaystyle \sum_{d \leq x^{1-3\varepsilon}} R_d \leq \sum_{d' \leq x^{1-\varepsilon}} \tau(d')^3 |\sum_{n \in I:d'|n} a_n - \frac{g(d')}{d'} C|I||$

which gives (25) from Axiom (iv). To prove (24), it now suffices to show that

$\displaystyle \sum_{d_1,d_2} \mu(d_1) \mu(d_2) \psi( \frac{\log d_1}{\varepsilon \log x} ) \psi( \frac{\log d_2}{\varepsilon \log x} ) \frac{g([d_1,d_2,d])}{[d_1,d_2,d]}$

$\displaystyle \ll \frac{1}{\varepsilon \log x} \frac{\prod_{p|d} O( \min( \frac{\log p}{\varepsilon \log x}, 1 )^2 )}{d}. \ \ \ \ \ (28)$

Arguing as before, the left-hand side is

$\displaystyle \int_{\bf R} \int_{\bf R} E^{(d)}(\frac{1+it_1}{\varepsilon \log x},\frac{1+it_2}{\varepsilon \log x})\ \Psi(t_1) \Psi(t_2) dt_1 dt_2$

where

$\displaystyle E^{(d)}(s_1,s_2) := \sum_{d_1,d_2} \frac{\mu(d_1) \mu(d_2)}{d_1^{s_1}d_2^{s_2}} \frac{g([d_1,d_2,d])}{[d_1,d_2,d]}.$

From Mertens’ theorem we have

$\displaystyle E^{(d)}(s_1,s_2) \ll_\varepsilon \frac{\prod_{p|d} O(1)}{d} \log^{O(1)} x$

when ${\hbox{Re} s_1, \hbox{Re} s_2 = \frac{1}{\varepsilon \log x}}$ , so the contribution of the terms where ${|t_1|, |t_2| \geq \sqrt{\log x}}$ can be absorbed into the ${R_d}$ error (after increasing that error slightly). For the remaining contributions, we see that

$\displaystyle E^{(d)}(s_1,s_2) = \frac{\zeta(1+s_1+s_2)}{\zeta(1+s_1) \zeta(1+s_2)} \prod_p E^{(d)}_p(s_1,s_2)$

where ${E^{(d)}_p(s_1,s_2) = E_p(s_1,s_2)}$ if ${p}$ does not divide ${d}$ , and

$\displaystyle E^{(d)}_p(s_1,s_2) = \frac{g(p^j)}{p^j} \frac{(1 - \frac{1}{p^{s_1}}) (1 - \frac{1}{p^{s_2}}) (1 - \frac{1}{p^{1+s_1+s_2}})}{(1-\frac{1}{p^{1+s_1}})(1-\frac{1}{p^{1+s_2}})}$

if ${p}$ divides ${d}$ ${j}$ times for some ${j \geq 1}$ . In the latter case, Taylor expansion gives the bounds

$\displaystyle |E^{(d)}_p(\frac{1+it_1}{\varepsilon \log x},\frac{1+it_2}{\varepsilon \log x})| \lesssim (1+|t_1|+|t_2|)^{O(1)} \frac{\min( \frac{\log p}{\varepsilon \log x}, 1 )^2}{p}$

and the claim (28) follows. When ${p \geq x^\delta}$ and ${|t_1|, |t_2| \leq \sqrt{\log x}}$ we have

$\displaystyle E^{(d)}_p(\frac{1+it_1}{\varepsilon \log x},\frac{1+it_2}{\varepsilon \log x}) = \frac{1+o(1)}{p^j}$

and (27) follows by repeating the previous calculations. Finally, (26) is proven similarly to (24) (using ${d[d_1,d_2]}$ in place of ${[d_1,d_2,d]}$ ). $\Box$

Now we can prove (15), (16), (17). We begin with (15). Using the Leibniz rule ${L(f*g) = (Lf)*g + f*(Lg)}$ applied to the identity ${\mu = \mu * 1 * \mu}$ and using ${\Lambda = \mu*L}$ and Möbius inversion (and the associativity and commutativity of Dirichlet convolution) we see that

$\displaystyle L\mu = - \mu * \Lambda. \ \ \ \ \ (29)$

Next, by applying the Leibniz rule to ${\Lambda_k = \mu * L^k}$ for some ${k \geq 1}$ and using (29) we see that

$\displaystyle L \Lambda_k = L \mu * L^k + \mu * L^{k+1}$

$\displaystyle = - \mu * \Lambda * L^k + \Lambda_{k+1}$

and hence we have the recursive identity

$\displaystyle \Lambda_{k+1} = L \Lambda_k + \Lambda *\Lambda_k. \ \ \ \ \ (30)$

In particular, from induction we see that ${\Lambda_k}$ is supported on numbers with at most ${k}$ distinct prime factors, and hence ${\Lambda_{\vec k}}$ is supported on numbers with at most ${|\vec k|}$ distinct prime factors. In particular, from (18) we see that ${\nu_\varepsilon(n) = O(1)}$ on the support of ${\Lambda_{\vec k}}$ . Thus it will suffice to show that

$\displaystyle \sum_{n \in I: \nu_\varepsilon(n) \neq 1} \Lambda_{\vec k}(n) a_n \ll (\varepsilon+o(1)) C |I| \log^{|\vec k|-1} x.$

If ${\nu_\varepsilon(n) \neq 1}$ and ${\Lambda_{\vec k}(n) \neq 0}$ , then ${n}$ has at most ${|\vec k|}$ distinct prime factors ${p_1 < p_2 < \dots < p_r}$ , with ${p_1 \leq x^\varepsilon}$ . If we factor ${n = n_1 n_2}$ , where ${n_1}$ is the contribution of those ${p_i}$ with ${p_i \leq x^{1/10|\vec k|}}$ , and ${n_2}$ is the contribution of those ${p_i}$ with ${p_i > x^{1/10|\vec k|}}$ , then at least one of the following two statements hold:

(a) ${n_1}$ (and hence ${n}$ ) is divisible by a square number of size at least ${x^{1/10}}$ .
(b) ${n_1 \leq x^{1/5}}$ .

The contribution of case (a) is easily seen to be acceptable by axiom (ii). For case (b), we observe from (30) and induction that

$\displaystyle \Lambda_k(n) \ll \log^{|\vec k|} x \prod_{j=1}^k \frac{\log p_j}{\log x}$

and so it will suffice to show that

$\displaystyle \sum_{n_1} (\prod_{p|n_1} \frac{\log p}{\log x}) \sum_{n \in I: n_1 | n} 1_R(n/n_1) a_n \ll (\varepsilon + o(1)) C |I| \log^{-1} x$

where ${n_1}$ ranges over numbers bounded by ${x^{1/5}}$ with at most ${|\vec k|}$ distinct prime factors, the smallest of which is at most ${x^\varepsilon}$ , and ${R}$ consists of those numbers with no prime factor less than or equal to ${x^{1/10|\vec k|}}$ . Applying (26) (with ${\varepsilon}$ replaced by ${1/10|\vec k|}$ ) gives the bound

$\displaystyle \sum_{n \in I: d|n} 1_R(n/n_1) a_n \ll \frac{C|I|}{\log x} \frac{1}{n_1} + R_d$

so by (25) it suffices to show that

$\displaystyle \sum_{n_1} (\prod_{p|n_1} \frac{\log p}{\log x}) \frac{1}{n_1} \ll \varepsilon$

subject to the same constraints on ${n_1}$ as before. The contribution of those ${n_1}$ with ${r}$ distinct prime factors can be bounded by

$\displaystyle O(\sum_{p_1 \leq x^\varepsilon} \frac{\log p_1}{p_1 \log x}) \times O(\sum_{p \leq x^{1/5}} \frac{\log p}{p\log x})^{r-1};$

applying Mertens’ theorem and summing over ${1 \leq r \leq |\vec k|}$ , one obtains the claim.

Now we show (16). As discussed previously in this section, we can replace ${\Lambda_{\vec k}(n)}$ by ${\sum_{d|n} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d}}$ with negligible error. Comparing this with (16) and (11), we see that it suffices to show that

$\displaystyle \sum_{n \in I} \sum_{d|n} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d} (1 - \eta_\varepsilon(\frac{\log d}{\log x})) \nu_\varepsilon(n) a_n \ll (\varepsilon+o(1)) C |I| \log^{|\vec k|-1} x.$

From the support of ${\eta_\varepsilon}$ , the summand on the left-hand side is only non-zero when ${d \geq x^{1-4\varepsilon}}$ , which makes ${\log^{k_r} \frac{x}{d} \ll \varepsilon^{k_r} \log^{k_r} x \leq \varepsilon^2 \log^{k_r} x}$ , where we use the crucial hypothesis ${k_r > 1}$ to gain enough powers of ${\varepsilon}$ to make the argument here work. Applying Lemma 2, we reduce to showing that

$\displaystyle \sum_{n \in I} \sum_{d|n: d \geq x^{1-4\varepsilon}} \nu_\varepsilon(n) a_n \ll \frac{1+o(1)}{\varepsilon \log x} C |I|.$

We can make the change of variables ${d \mapsto n/d}$ to flip the sum

$\displaystyle \sum_{d|n: d \geq x^{1-4\varepsilon}} 1 \leq \sum_{d|n: d \leq x^{3\varepsilon}} 1$

and then swap the sums to reduce to showing that

$\displaystyle \sum_{d \leq x^{4\varepsilon}} \sum_{n \in I} \nu_\varepsilon(n) a_n \ll \frac{1+o(1)}{\varepsilon \log x} C |I|.$

By Lemma 3, it suffices to show that

$\displaystyle \sum_{d \leq x^{4\varepsilon}} \frac{\prod_{p|d} O( \min( \frac{\log p}{\varepsilon \log x}, 1 )^2 )}{d} \ll 1.$

To prove this, we use the Rankin trick, bounding the implied weight ${1_{d \leq x^{4\varepsilon}}}$ by ${O( \frac{1}{d^{1/\varepsilon \log x}} )}$ . We can then bound the left-hand side by the Euler product

$\displaystyle \prod_p (1 + O( \frac{\min( \frac{\log p}{\varepsilon \log x}, 1 )^2}{p^{1+1/\varepsilon \log x}} ))$

which can be bounded by

$\displaystyle \exp( O( \sum_p \frac{\min( \frac{\log p}{\varepsilon \log x}, 1 )^2}{p^{1+1/\varepsilon \log x}} ) )$

and the claim follows from Mertens’ theorem.

Finally, we show (17). By (11), the left-hand side expands as

$\displaystyle \sum_{d \leq x^{1-3\varepsilon}} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d} \eta_\varepsilon(\frac{\log d}{\log x}) \sum_{n \in I: d|n} \nu_\varepsilon(n) a_n.$

We let ${\delta>0}$ be a small constant to be chosen later. We divide the outer sum into two ranges, depending on whether ${d}$ only has prime factors greater than ${x^\delta}$ or not. In the former case, we can apply (27) to write this contribution as

$\displaystyle \sum_{d \leq x^{1-3\varepsilon}} \mu_{\vec k}(d) \log^{k_r} \frac{x}{d} \eta_\varepsilon(\frac{\log d}{\log x}) \frac{1+o(1)}{d} \frac{C|I|}{\varepsilon \log x} (\int_0^1 \psi'(u)^2\ du) G(1)$

plus a negligible error, where the ${d}$ is implicitly restricted to numbers with all prime factors greater than ${x^\delta}$ . The main term is messy, but it is of the required form ${C Q'_{\varepsilon,x} G(1)}$ up to an acceptable error, so there is no need to compute it any further. It remains to consider those ${d}$ that have at least one prime factor less than ${x^\delta}$ . Here we use (24) instead of (27) as well as Lemma 3 to dominate this contribution by

$\displaystyle \sum_{d \leq x^{1-3\varepsilon}} O( \log^{|\vec k|} x \frac{C|I|}{\varepsilon \log x} \frac{\prod_{p|d} O( \min( \frac{\log p}{\varepsilon \log x}, 1 )^2 )}{d} )$

up to negligible errors, where ${d}$ is now restricted to have at least one prime factor less than ${x^\delta}$ . This makes at least one of the factors ${\min( \frac{\log p}{\varepsilon \log x}, 1 )}$ to be at most ${O_\varepsilon(\delta)}$ . A routine application of Rankin’s trick shows that

$\displaystyle \sum_{d \leq x^{1-3\varepsilon}} \frac{\prod_{p|d} O( \min( \frac{\log p}{\varepsilon \log x}, 1 ) )}{d} \ll_\varepsilon 1$

and so the total contribution of this case is ${O_\varepsilon((\delta+o(1)) |I| \log^{|\vec k|-1} x)}$ . Since ${\delta>0}$ can be made arbitrarily small, (17) follows.

— 2. Weierstrass approximation —

Having proved Theorem 1, we now take linear combinations of this theorem, combined with the Weierstrass approximation theorem, to give the asymptotics (7), (8) described in the introduction.

Let ${a_n}$ , ${g}$ , ${C}$ , ${G}$ be as in that theorem. It will be convenient to normalise the weights ${\Lambda_{\vec k}}$ by ${L^{1-|\vec k|}}$ to make their mean value comparable to ${1}$ . From Theorem 1 and summation by parts we have

$\displaystyle \sum_{n \leq x} L^{1-|\vec k|} \Lambda_{\vec k}(n) a_n = (G(1)+o(1)) \frac{\prod_{i=1}^r k_i!}{(|\vec k|-1)!} C x \ \ \ \ \ (31)$

whenever ${\vec k}$ does not consist entirely of ones.

We now take a closer look at what happens when ${\vec k}$ does consist entirely of ones. Let ${1^r}$ denote the ${r}$ -tuple ${(1,\dots,1)}$ . Convolving the ${k=1}$ case of (30) with ${r-1}$ copies of ${\Lambda}$ for some ${r \geq 1}$ and using the Leibniz rule, we see that

$\displaystyle \Lambda_{(1^{r-1}, 2)} = \frac{1}{r} L \Lambda_{1^r} + \Lambda_{1^{r+1}}$

and hence

$\displaystyle L^{-r} \Lambda_{1^{r+1}} = L^{-r} \Lambda_{(1^{r-1},2)} - \frac{1}{r} L^{1-r} \Lambda_{1^r}.$

Multiplying by ${a_n}$ and summing over ${n \leq x}$ , and using (31) to control the ${\Lambda_{(1^{r-1},2)}}$ term, one has

$\displaystyle \sum_{n \leq x} L^{-r} \Lambda_{1^{r+1}}(n) a_n = (G(1)+o(1)) \frac{2}{r!} - \frac{1}{r} \sum_{n \leq x} L^{1-r} \Lambda_{1^{r}}(n) a_n.$

If we define ${\delta_x}$ (up to an error of ${o(1)}$ ) by the formula

$\displaystyle \sum_{n \leq x} \Lambda(n) a_n = (\delta_x G(1) + o(1)) C x$

then an induction then shows that

$\displaystyle \sum_{n \leq x} L^{1-r} \Lambda_{1^r}(n) a_n = \frac{1}{(r-1)!} (\delta_x G(1) + o(1)) C x$

for odd ${r}$ , and

$\displaystyle \sum_{n \leq x} L^{1-r} \Lambda_{1^r}(n) a_n = \frac{1}{(r-1)!} ((2-\delta_x) G(1) + o(1)) C x$

for even ${r}$ . In particular, after adjusting ${\delta_x}$ by ${o(1)}$ if necessary, we have ${0 \leq \delta_x \leq 2}$ since the left-hand sides are non-negative.

If we now define the comparison sequence ${b_n := C G(1) (1 + (1-\delta_x) \mu(n))}$ , standard multiplicative number theory shows that the above estimates also hold when ${a_n}$ is replaced by ${b_n}$ ; thus

$\displaystyle \sum_{n \leq x} L^{1-r} \Lambda_{1^r}(n) a_n = \sum_{n \leq x} L^{1-r} \Lambda_{1^r}(n) b_n + o( x )$

for both odd and even ${r}$ . The bound (31) also holds for ${b_n}$ when ${\vec k}$ does not consist entirely of ones, and hence

$\displaystyle \sum_{n \leq x} L^{1-|\vec k|} \Lambda_{\vec k}(n) a_n = \sum_{n \leq x} L^{1-|\vec k|} \Lambda_{\vec k}(n) b_n + o( x )$

for any fixed ${\vec k}$ (which may or may not consist entirely of ones).

Next, from induction (on ${j_1+\dots+j_r}$ ), the Leibniz rule, and (30), we see that for any ${r \geq 1}$ and ${j_1,\dots,j_r \geq 0}$ , ${k_1,\dots,k_r}$ , the function

$\displaystyle L^{1-j_1-\dots-j_r-|\vec k|} ((L^{j_1} \Lambda_{k_1}) * \dots * (L^{j_r} \Lambda_{k_r})) \ \ \ \ \ (32)$

is a finite linear combination of functions of the form ${L^{1-|\vec k'|} \Lambda_{\vec k'}}$ for tuples ${\vec k'}$ that may possibly consist entirely of ones. We thus have

$\displaystyle \sum_{n \leq x} f(n) a_n = \sum_{n \leq x}f(n) b_n + o( x )$

whenever ${f}$ is one of these functions (32). Specialising to the case ${k_1=\dots=k_r=1}$ , we thus have

$\displaystyle \sum_{n_1 \dots n_r \leq x} a_{n} \log^{1-r} n \prod_{i=1}^r (\log n_i/\log n)^{j_i} \Lambda(n_i)$

$\displaystyle = \sum_{n_1 \dots n_r \leq x} b_{n} \log^{1-r} n \prod_{i=1}^r (\log n_i/\log n)^{j_i} \Lambda(n_i) + o(x )$

where ${n := n_1 \dots n_r}$ . The contribution of those ${n_i}$ that are powers of primes can be easily seen to be negligible, leading to

$\displaystyle \sum_{p_1 \dots p_r \leq x} a_{n} \log n \prod_{i=1}^r (\log p_i/\log n)^{j_i+1}$

$\displaystyle = \sum_{p_1 \dots p_r \leq x} b_{n} \prod_{i=1}^r (\log p_i/\log n)^{j_i+1} + o(x)$

where now ${n := p_1 \dots p_r}$ . The contribution of the case where two of the primes ${p_i}$ agree can also be seen to be negligible, as can the error when replacing ${\log n}$ with ${\log x}$ , and then by symmetry

$\displaystyle \sum_{p_1 \dots p_r \leq x: p_1 < \dots < p_r} a_{n} \prod_{i=1}^r (\log p_i/\log n)^{j_i+1}$

$\displaystyle = \sum_{p_1 \dots p_r \leq x: p_1 < \dots < p_r} b_{n} \prod_{i=1}^r (\log p_i/\log n)^{j_i+1} + o(x / \log x).$

By linearity, this implies that

$\displaystyle \sum_{p_1 \dots p_r \leq x: p_1 < \dots < p_r} a_{n} P( \log p_1/\log n, \dots, \log p_r/\log n)$

$\displaystyle = \sum_{p_1 \dots p_r \leq x: p_1 < \dots < p_r} b_{n} P( \log p_1/\log n, \dots, \log p_r/\log n) + o(x / \log x)$

for any polynomial ${P(t_1,\dots,t_r)}$ that vanishes on the coordinate hyperplanes ${t_i=0}$ . The right-hand side can also be evaluated by Mertens’ theorem as

$\displaystyle CG(1) \delta_x \int_{\Delta_r} P x + o(x)$

when ${r}$ is odd and

$\displaystyle CG(1) (2-\delta_x) \int_{\Delta_r} P x + o(x)$

when ${r}$ is even. Using the Weierstrass approximation theorem, we then have

$\displaystyle \sum_{p_1 \dots p_r \leq x: p_1 < \dots < p_r} a_{n} g_r( \log p_1/\log n, \dots, \log p_r/\log n)$

$\displaystyle = \sum_{p_1 \dots p_r \leq x: p_1 < \dots < p_r} b_{n} g_r( \log p_1/\log n, \dots, \log p_r/\log n) + o(x / \log x)$

for any continuous function ${g_r}$ that is compactly supported in the interior of ${\Delta_r}$ . Computing the right-hand side using Mertens’ theorem as before, we obtain the claimed asymptotics (7), (8).

Remark 4 The Bombieri asymptotic sieve has to use the full power of EH (or GEH); there are constructions due to Ford that show that if one only has a distributional hypothesis up to ${x^{1-c}}$ for some fixed constant ${c>0}$ , then the asymptotics of sums such as (5), or more generally (9), are not determined by a single scalar parameter ${\delta_x}$ , but can also vary in other ways as well. Thus the Bombieri asymptotic sieve really is asymptotic; in order to get ${o(1)}$ type error terms one needs the level ${1-\varepsilon}$ of distribution to be asymptotically equal to ${1}$ as ${x \rightarrow \infty}$ . Related to this, the quantitative decay of the ${o(1)}$ error terms in the Bombieri asymptotic sieve are extremely poor; in particular, they depend on the dependence of implied constant in axiom (iv) on the parameters ${\varepsilon,A}$ , for which there is no consensus on what one should conjecturally expect.

254A, Notes 4: Some sieve theory

21 January, 2015 in 254A - analytic prime number theory, math.NT | Tags: fundamental lemma of sieve theory, parity problem, Selberg sieve, sieve theory | by Terence Tao | 27 comments

Many problems in non-multiplicative prime number theory can be recast as sieving problems. Consider for instance the problem of counting the number ${N(x)}$ of pairs of twin primes ${p,p+2}$ contained in ${[x/2,x]}$ for some large ${x}$ ; note that the claim that ${N(x) > 0}$ for arbitrarily large ${x}$ is equivalent to the twin prime conjecture. One can obtain this count by any of the following variants of the sieve of Eratosthenes:

Let ${A}$ be the set of natural numbers in ${[x/2,x-2]}$ . For each prime ${p \leq \sqrt{x}}$ , let ${E_p}$ be the union of the residue classes ${0\ (p)}$ and ${-2\ (p)}$ . Then ${N(x)}$ is the cardinality of the sifted set ${A \backslash \bigcup_{p \leq \sqrt{x}} E_p}$ .
Let ${A}$ be the set of primes in ${[x/2,x-2]}$ . For each prime ${p \leq \sqrt{x}}$ , let ${E_p}$ be the residue class ${-2\ (p)}$ . Then ${N(x)}$ is the cardinality of the sifted set ${A \backslash \bigcup_{p \leq \sqrt{x}} E_p}$ .
Let ${A}$ be the set of primes in ${[x/2+2,x]}$ . For each prime ${p \leq \sqrt{x}}$ , let ${E_p}$ be the residue class ${2\ (p)}$ . Then ${N(x)}$ is the cardinality of the sifted set ${A \backslash \bigcup_{p \leq \sqrt{x}} E_p}$ .
Let ${A}$ be the set ${\{ n(n+2): x/2 \leq n \leq x-2 \}}$ . For each prime ${p \leq \sqrt{x}}$ , let ${E_p}$ be the residue class ${0\ (p)}$ Then ${N(x)}$ is the cardinality of the sifted set ${A \backslash \bigcup_{p \leq \sqrt{x}} E_p}$ .

Exercise 1 Develop similar sifting formulations of the other three Landau problems.

In view of these sieving interpretations of number-theoretic problems, it becomes natural to try to estimate the size of sifted sets ${A \backslash \bigcup_{p | P} E_p}$ for various finite sets ${A}$ of integers, and subsets ${E_p}$ of integers indexed by primes ${p}$ dividing some squarefree natural number ${P}$ (which, in the above examples, would be the product of all primes up to ${\sqrt{x}}$ ). As we see in the above examples, the sets ${E_p}$ in applications are typically the union of one or more residue classes modulo ${p}$ , but we will work at a more abstract level of generality here by treating ${E_p}$ as more or less arbitrary sets of integers, without caring too much about the arithmetic structure of such sets.

It turns out to be conceptually more natural to replace sets by functions, and to consider the more general the task of estimating sifted sums

$\displaystyle \sum_{n \in {\bf Z}} a_n 1_{n \not \in \bigcup_{p | P} E_p} \ \ \ \ \ (1)$

for some finitely supported sequence ${(a_n)_{n \in {\bf Z}}}$ of non-negative numbers; the previous combinatorial sifting problem then corresponds to the indicator function case ${a_n=1_{n \in A}}$ . (One could also use other index sets here than the integers ${{\bf Z}}$ if desired; for much of sieve theory the index set and its subsets ${E_p}$ are treated as abstract sets, so the exact arithmetic structure of these sets is not of primary importance.)

Continuing with twin primes as a running example, we thus have the following sample sieving problem:

Problem 2 (Sieving problem for twin primes) Let ${x, z \geq 1}$ , and let ${\pi_2(x,z)}$ denote the number of natural numbers ${n \leq x}$ which avoid the residue classes ${0, -2\ (p)}$ for all primes ${p < z}$ . In other words, we have

$\displaystyle \pi_2(x,z) := \sum_{n \in {\bf Z}} a_n 1_{n \not \in \bigcup_{p | P(z)} E_p}$

where ${a_n := 1_{n \in [1,x]}}$ , ${P(z) := \prod_{p < z} p}$ is the product of all the primes strictly less than ${z}$ (we omit ${z}$ itself for minor technical reasons), and ${E_p}$ is the union of the residue classes ${0, -2\ (p)}$ . Obtain upper and lower bounds on ${\pi_2(x,z)}$ which are as strong as possible in the asymptotic regime where ${x}$ goes to infinity and the sifting level ${z}$ grows with ${x}$ (ideally we would like ${z}$ to grow as fast as ${\sqrt{x}}$ ).

From the preceding discussion we know that the number of twin prime pairs ${p,p+2}$ in ${(x/2,x]}$ is equal to ${\pi_2(x-2,\sqrt{x}) - \pi_2(x/2,\sqrt{x})}$ , if ${x}$ is not a perfect square; one also easily sees that the number of twin prime pairs in ${[1,x]}$ is at least ${\pi_2(x-2,\sqrt{x})}$ , again if ${x}$ is not a perfect square. Thus we see that a sufficiently good answer to Problem 2 would resolve the twin prime conjecture, particularly if we can get the sifting level ${z}$ to be as large as ${\sqrt{x}}$ .

We return now to the general problem of estimating (1). We may expand

$\displaystyle 1_{n \not \in \bigcup_{p | P} E_p} = \prod_{p | P} (1 - 1_{E_p}(n)) \ \ \ \ \ (2)$

$\displaystyle = \sum_{k=0}^\infty (-1)^k \sum_{p_1 \dots p_k|P: p_1 < \dots < p_k} 1_{E_{p_1}} \dots 1_{E_{p_k}}(n)$

$\displaystyle = \sum_{d|P} \mu(d) 1_{E_d}(n)$

where ${E_d := \bigcap_{p|d} E_p}$ (with the convention that ${E_1={\bf Z}}$ ). We thus arrive at the Legendre sieve identity

$\displaystyle \sum_{n \in {\bf Z}} a_n 1_{n \not \in \bigcup_{p | P} E_p} = \sum_{d|P} \mu(d) \sum_{n \in E_d} a_n. \ \ \ \ \ (3)$

Specialising to the case of an indicator function ${a_n=1_{n \in A}}$ , we recover the inclusion-exclusion formula

$\displaystyle |A \backslash \bigcup_{p|P} E_p| = \sum_{d|P} \mu(d) |A \cap E_d|.$

Such exact sieving formulae are already satisfactory for controlling sifted sets or sifted sums when the amount of sieving is relatively small compared to the size of ${A}$ . For instance, let us return to the running example in Problem 2 for some ${x,z \geq 1}$ . Observe that each ${E_p}$ in this example consists of ${\omega(p)}$ residue classes modulo ${p}$ , where ${\omega(p)}$ is defined to equal ${1}$ when ${p=2}$ and ${2}$ when ${p}$ is odd. By the Chinese remainder theorem, this implies that for each ${d|P(z)}$ , ${E_d}$ consists of ${\prod_{p|d} \omega(p)}$ residue classes modulo ${d}$ . Using the basic bound

$\displaystyle \sum_{n \leq x: n = a\ (q)} 1 = \frac{x}{q} + O(1) \ \ \ \ \ (4)$

for any ${x > 0}$ and any residue class ${a\ (q)}$ , we conclude that

$\displaystyle \sum_{n \in E_d} a_n = g(d) x + O( \prod_{p|d} \omega(p) ) \ \ \ \ \ (5)$

for any ${d|P(z)}$ , where ${g}$ is the multiplicative function

$\displaystyle g(d) := \prod_{p|d: p|P(z)} \frac{\omega(p)}{p}.$

Since ${\omega(p) \leq 2}$ and there are at most ${\pi(z)}$ primes dividing ${P(z)}$ , we may crudely bound ${\prod_{p|d} \omega(p) \leq 2^{\pi(z)}}$ , thus

$\displaystyle \sum_{n \in E_d} a_n = g(d) x + O( 2^{\pi(z)} ). \ \ \ \ \ (6)$

Also, the number of divisors of ${P(z)}$ is at most ${2^{\pi(z)}}$ . From the Legendre sieve (3), we thus conclude that

$\displaystyle \pi_2(x,z) = (\sum_{d|P(z)} \mu(d) g(d) x) + O( 4^{\pi(z)} ).$

We can factorise the main term to obtain

$\displaystyle \pi_2(x,z) = x \prod_{p < z} (1-\frac{\omega(p)}{p}) + O( 4^{\pi(z)} ).$

This is compatible with the heuristic

$\displaystyle \pi_2(x,z) \approx x \prod_{p < z} (1-\frac{\omega(p)}{p}) \ \ \ \ \ (7)$

coming from the equidistribution of residues principle (Section 3 of Supplement 4), bearing in mind (from the modified Cramér model, see Section 1 of Supplement 4) that we expect this heuristic to become inaccurate when ${z}$ becomes very large. We can simplify the right-hand side of (7) by recalling the twin prime constant

$\displaystyle \Pi_2 := \prod_{p>2} (1 - \frac{1}{(p-1)^2}) = 0.6601618\dots$

(see equation (7) from Supplement 4); note that

$\displaystyle \prod_p (1-\frac{1}{p})^{-2} (1-\frac{\omega(p)}{p}) = 2 \Pi_2$

so from Mertens’ third theorem (Theorem 42 from Notes 1) one has

$\displaystyle \prod_{p < z} (1-\frac{\omega(p)}{p}) = (2\Pi_2+o(1)) \frac{1}{(e^\gamma \log z)^2} \ \ \ \ \ (8)$

as ${z \rightarrow \infty}$ . Bounding ${4^{\pi(z)}}$ crudely by ${\exp(o(z))}$ , we conclude in particular that

$\displaystyle \pi_2(x,z) = (2\Pi_2 +o(1)) \frac{x}{(e^\gamma \log z)^2}$

when ${x,z \rightarrow \infty}$ with ${z = O(\log x)}$ . This is somewhat encouraging for the purposes of getting a sufficiently good answer to Problem 2 to resolve the twin prime conjecture, but note that ${z}$ is currently far too small: one needs to get ${z}$ as large as ${\sqrt{x}}$ before one is counting twin primes, and currently ${z}$ can only get as large as ${\log x}$ .

The problem is that the number of terms in the Legendre sieve (3) basically grows exponentially in ${z}$ , and so the error terms in (4) accumulate to an unacceptable extent once ${z}$ is significantly larger than ${\log x}$ . An alternative way to phrase this problem is that the estimate (4) is only expected to be truly useful in the regime ${q=o(x)}$ ; on the other hand, the moduli ${d}$ appearing in (3) can be as large as ${P}$ , which grows exponentially in ${z}$ by the prime number theorem.

To resolve this problem, it is thus natural to try to truncate the Legendre sieve, in such a way that one only uses information about the sums ${\sum_{n \in E_d} a_n}$ for a relatively small number of divisors ${d}$ of ${P}$ , such as those ${d}$ which are below a certain threshold ${D}$ . This leads to the following general sieving problem:

Problem 3 (General sieving problem) Let ${P}$ be a squarefree natural number, and let ${{\mathcal D}}$ be a set of divisors of ${P}$ . For each prime ${p}$ dividing ${P}$ , let ${E_p}$ be a set of integers, and define ${E_d := \bigcap_{p|d} E_p}$ for all ${d|P}$ (with the convention that ${E_1={\bf Z}}$ ). Suppose that ${(a_n)_{n \in {\bf Z}}}$ is an (unknown) finitely supported sequence of non-negative reals, whose sums

$\displaystyle X_d := \sum_{n \in E_d} a_n \ \ \ \ \ (9)$

are known for all ${d \in {\mathcal D}}$ . What are the best upper and lower bounds one can conclude on the quantity (1)?

Here is a simple example of this type of problem (corresponding to the case ${P = 6}$ , ${{\mathcal D} = \{1, 2, 3\}}$ , ${X_1 = 100}$ , ${X_2 = 60}$ , and ${X_3 = 10}$ ):

Exercise 4 Let ${(a_n)_{n \in {\bf Z}}}$ be a finitely supported sequence of non-negative reals such that ${\sum_{n \in {\bf Z}} a_n = 100}$ , ${\sum_{n \in {\bf Z}: 2|n} a_n = 60}$ , and ${\sum_{n \in {\bf Z}: 3|n} a_n = 10}$ . Show that

$\displaystyle 30 \leq \sum_{n \in {\bf Z}: (n,6)=1} a_n \leq 40$

and give counterexamples to show that these bounds cannot be improved in general, even when ${a_n}$ is an indicator function sequence.

Problem 3 is an example of a linear programming problem. By using linear programming duality (as encapsulated by results such as the Hahn-Banach theorem, the separating hyperplane theorem, or the Farkas lemma), we can rephrase the above problem in terms of upper and lower bound sieves:

Theorem 5 (Dual sieve problem) Let ${P, {\mathcal D}, E_p, E_d, X_d}$ be as in Problem 3. We assume that Problem 3 is feasible, in the sense that there exists at least one finitely supported sequence ${(a_n)_{n \in {\bf Z}}}$ of non-negative reals obeying the constraints in that problem. Define an (normalised) upper bound sieve to be a function ${\nu^+: {\bf Z} \rightarrow {\bf R}}$ of the form

$\displaystyle \nu^+ = \sum_{d \in {\mathcal D}} \lambda^+_d 1_{E_d}$

for some coefficients ${\lambda^+_d \in {\bf R}}$ , and obeying the pointwise lower bound

$\displaystyle \nu^+(n) \geq 1_{n \not \in\bigcup_{p|P} E_p}(n) \ \ \ \ \ (10)$

for all ${n \in {\bf Z}}$ (in particular ${\nu^+}$ is non-negative). Similarly, define a (normalised) lower bound sieve to be a function ${\nu^-: {\bf Z} \rightarrow {\bf R}}$ of the form

$\displaystyle \nu^-(n) = \sum_{d \in {\mathcal D}} \lambda^-_d 1_{E_d}$

for some coefficients ${\lambda^-_d \in {\bf R}}$ , and obeying the pointwise upper bound

$\displaystyle \nu^-(n) \leq 1_{n \not \in\bigcup_{p|P} E_p}(n)$

for all ${n \in {\bf Z}}$ . Thus for instance ${1}$ and ${0}$ are (trivially) upper bound sieves and lower bound sieves respectively.

(i) The supremal value of the quantity (1), subject to the constraints in Problem 3, is equal to the infimal value of the quantity ${\sum_{d \in {\mathcal D}} \lambda^+_d X_d}$ , as ${\nu^+ = \sum_{d \in {\mathcal D}} \lambda^+_d 1_{E_d}}$ ranges over all upper bound sieves.

(ii) The infimal value of the quantity (1), subject to the constraints in Problem 3, is equal to the supremal value of the quantity ${\sum_{d \in {\mathcal D}} \lambda^-_d X_d}$ , as ${\nu^- = \sum_{d \in {\mathcal D}} \lambda^-_d 1_{E_d}}$ ranges over all lower bound sieves.

Proof: We prove part (i) only, and leave part (ii) as an exercise. Let ${A}$ be the supremal value of the quantity (1) given the constraints in Problem 3, and let ${B}$ be the infimal value of ${\sum_{d \in {\mathcal D}} \lambda^+_d X_d}$ . We need to show that ${A=B}$ .

We first establish the easy inequality ${A \leq B}$ . If the sequence ${a_n}$ obeys the constraints in Problem 3, and ${\nu^+ = \sum_{d \in {\mathcal D}} \lambda^+_d 1_{E_d}}$ is an upper bound sieve, then

$\displaystyle \sum_n \nu^+(n) a_n = \sum_{d \in {\mathcal D}} \lambda^+_d X_d$

and hence (by the non-negativity of ${\nu^+}$ and ${a_n}$ )

$\displaystyle \sum_{n \not \in \bigcup_{p|P} E_p} a_n \leq \sum_{d \in {\mathcal D}} \lambda^+_d X_d;$

taking suprema in ${f}$ and infima in ${\nu^+}$ we conclude that ${A \leq B}$ .

Now suppose for contradiction that ${A<B}$ , thus ${A < C < B}$ for some real number ${C}$ . We will argue using the hyperplane separation theorem; one can also proceed using one of the other duality results mentioned above. (See this previous blog post for some discussion of the connections between these various forms of linear duality.) Consider the affine functional

$\displaystyle \rho_0: (a_n)_{n \in{\bf Z}} \mapsto C - \sum_{n \not \in \bigcup_{p|P} E_p} a_n.$

on the vector space of finitely supported sequences ${(a_n)_{n \in {\bf Z}}}$ of reals. On the one hand, since ${C > A}$ , this functional is positive for every sequence ${(a_n)_{n \in{\bf Z}}}$ obeying the constraints in Problem 3. Next, let ${K}$ be the space of affine functionals ${\rho}$ of the form

$\displaystyle \rho: (a_n)_{n \in {\bf Z}} \mapsto -\sum_{d \in {\mathcal D}} \lambda^+_d ( \sum_{n \in E_d} a_n - X_d ) + \sum_n a_n \nu(n) + X$

for some real numbers ${\lambda^+_d \in {\bf R}}$ , some non-negative function ${\nu: {\bf Z} \rightarrow {\bf R}^+}$ which is a finite linear combination of the ${1_{E_d}}$ for ${d|P}$ , and some non-negative ${X}$ . This is a closed convex cone in a finite-dimensional vector space ${V}$ ; note also that ${\rho_0}$ lies in ${V}$ . Suppose first that ${\rho_0 \in K}$ , thus we have a representation of the form

$\displaystyle C - \sum_{n \not \in \bigcup_{p|P} E_p} a_n = -\sum_{d \in {\mathcal D}} \lambda^+_d ( \sum_{n \in E_d} a_n - X_d ) + \sum_n a_n \nu(n) + X$

for any finitely supported sequence ${(a_n)_{n \in {\bf Z}}}$ . Comparing coefficients, we conclude that

$\displaystyle \sum_{d \in {\mathcal D}} \lambda^+_d 1_{E_d}(n) \geq 1_{n \not \in \bigcup_{p|P} E_p}$

for any ${n}$ (i.e., ${\sum_{d \in {\mathcal D}} \lambda^+_d 1_{E_d}}$ is an upper bound sieve), and also

$\displaystyle C \geq \sum_{d \in {\mathcal D}} \lambda^+_d X_d,$

and thus ${C \geq B}$ , a contradiction. Thus ${\rho_0}$ lies outside of ${K}$ . But then by the hyperplane separation theorem, we can find an affine functional ${\iota: V \rightarrow {\bf R}}$ on ${V}$ that is non-negative on ${K}$ and negative on ${\rho_0}$ . By duality, such an affine functional takes the form ${\iota: \rho \mapsto \rho((b_n)_{n \in {\bf Z}}) + c}$ for some finitely supported sequence ${(b_n)_{n \in {\bf Z}}}$ and ${c \in {\bf R}}$ (indeed, ${(b_n)_{n \in {\bf Z}}}$ can be supported on a finite set consisting of a single representative for each atom of the finite ${\sigma}$ -algebra generated by the ${E_p}$ ). Since ${\iota}$ is non-negative on the cone ${K}$ , we see (on testing against multiples of the functionals ${(a_n)_{n \in {\bf Z}} \mapsto \sum_{n \in E_d} a_n - X_d}$ or ${(a_n)_{n \in {\bf Z}} \mapsto a_n}$ ) that the ${b_n}$ and ${c}$ are non-negative, and that ${\sum_{n \in E_d} b_n - X_d = 0}$ for all ${d \in {\mathcal D}}$ ; thus ${(b_n)_{n \in {\bf Z}}}$ is feasible for Problem 3. Since ${\iota}$ is negative on ${\rho_0}$ , we see that

$\displaystyle \sum_{n \not \in \bigcup_{p|P} E_p} b_n \geq C$

and thus ${A \geq C}$ , giving the desired contradiction. $\Box$

Exercise 6 Prove part (ii) of the above theorem.

Exercise 7 Show that the infima and suprema in the above theorem are actually attained (so one can replace “infimal” and “supremal” by “minimal” and “maximal” if desired).

Exercise 8 What are the optimal upper and lower bound sieves for Exercise 4?

In the case when ${{\mathcal D}}$ consists of all the divisors of ${P}$ , we see that the Legendre sieve ${\sum_{d|P} \mu(d) 1_{E_d}}$ is both the optimal upper bound sieve and the optimal lower bound sieve, regardless of what the quantities ${X_d}$ are. However, in most cases of interest, ${{\mathcal D}}$ will only be some strict subset of the divisors of ${P}$ , and there will be a gap between the optimal upper and lower bounds.

Observe that a sequence ${(\lambda^+_d)_{d \in {\mathcal D}}}$ of real numbers will form an upper bound sieve ${\sum_d \lambda^+_d 1_{E_d}}$ if one has the inequalities

$\displaystyle \lambda^+_1 \geq 1$

and

$\displaystyle \sum_{d|n} \lambda^+_d \geq 0$

for all ${n|P}$ ; we will refer to such sequences as upper bound sieve coefficients. (Conversely, if the sets ${E_p}$ are in “general position” in the sense that every set of the form ${\bigcap_{p|n} E_p \backslash \bigcup_{p|P; p\not | n} E_p}$ for ${n|P}$ is non-empty, we see that every upper bound sieve arises from a sequence of upper bound sieve coefficients.) Similarly, a sequence ${(\lambda^-_d)_{d \in {\mathcal D}}}$ of real numbers will form a lower bound sieve ${\sum_d \lambda^-_d 1_{E_d}}$ if one has the inequalities

$\displaystyle \lambda^-_1 \leq 1$

and

$\displaystyle \sum_{d|n} \lambda^-_d \leq 0$

for all ${n|P}$ with ${n>1}$ ; we will refer to such sequences as lower bound sieve coefficients.

Exercise 9 (Brun pure sieve) Let ${P}$ be a squarefree number, and ${k}$ a non-negative integer. Show that the sequence ${(\lambda_d)_{d \in P}}$ defined by

$\displaystyle \lambda_d := 1_{\omega(d) \leq k} \mu(d),$

where ${\omega(d)}$ is the number of prime factors of ${d}$ , is a sequence of upper bound sieve coefficients for even ${k}$ , and a sequence of lower bound sieve coefficients for odd ${k}$ . Deduce the Bonferroni inequalities

$\displaystyle \sum_{n \in {\bf Z}} a_n 1_{n \not \in \bigcup_{p | P} E_p} \leq \sum_{d|P: \omega(p) \leq k} \mu(d) X_d \ \ \ \ \ (11)$

when ${k}$ is even, and

$\displaystyle \sum_{n \in {\bf Z}} a_n 1_{n \not \in \bigcup_{p | P} E_p} \geq \sum_{d|P: \omega(p) \leq k} \mu(d) X_d \ \ \ \ \ (12)$

when ${k}$ is odd, whenever one is in the situation of Problem 3 (and ${{\mathcal D}}$ contains all ${d|P}$ with ${\omega(p) \leq k}$ ). The resulting upper and lower bound sieves are sometimes known as Brun pure sieves. The Legendre sieve can be viewed as the limiting case when ${k \geq \omega(P)}$ .

In many applications the sums ${X_d}$ in (9) take the form

$\displaystyle \sum_{n \in E_d} a_n = g(d) X + r_d \ \ \ \ \ (13)$

for some quantity ${X}$ independent of ${d}$ , some multiplicative function ${g}$ with ${0 \leq g(p) \leq 1}$ , and some remainder term ${r_d}$ whose effect is expected to be negligible on average if ${d}$ is restricted to be small, e.g. less than a threshold ${D}$ ; note for instance that (5) is of this form if ${D \leq x^{1-\varepsilon}}$ for some fixed ${\varepsilon>0}$ (note from the divisor bound, Lemma 23 of Notes 1, that ${\prod_{p|d} \omega(p) \ll x^{o(1)}}$ if ${d \ll x^{O(1)}}$ ). We are thus led to the following idealisation of the sieving problem, in which the remainder terms ${r_d}$ are ignored:

Problem 10 (Idealised sieving) Let ${z, D \geq 1}$ (we refer to ${z}$ as the sifting level and ${D}$ as the level of distribution), let ${g}$ be a multiplicative function with ${0 \leq g(p) \leq 1}$ , and let ${{\mathcal D} := \{ d|P(z): d \leq D \}}$ . How small can one make the quantity

$\displaystyle \sum_{d \in {\mathcal D}} \lambda^+_d g(d) \ \ \ \ \ (14)$

for a sequence ${(\lambda^+_d)_{d \in {\mathcal D}}}$ of upper bound sieve coefficients, and how large can one make the quantity

$\displaystyle \sum_{d \in {\mathcal D}} \lambda^-_d g(d) \ \ \ \ \ (15)$

for a sequence ${(\lambda^-_d)_{d \in {\mathcal D}}}$ of lower bound sieve coefficients?

Thus, for instance, the trivial upper bound sieve ${\lambda^+_d := 1_{d=1}}$ and the trivial lower bound sieve ${\lambda^-_d := 0}$ show that (14) can equal ${1}$ and (15) can equal ${0}$ . Of course, one hopes to do better than these trivial bounds in many situations; usually one can improve the upper bound quite substantially, but improving the lower bound is significantly more difficult, particularly when ${z}$ is large compared with ${D}$ .

If the remainder terms ${r_d}$ in (13) are indeed negligible on average for ${d \leq D}$ , then one expects the upper and lower bounds in Problem 3 to essentially be the optimal bounds in (14) and (15) respectively, multiplied by the normalisation factor ${X}$ . Thus Problem 10 serves as a good model problem for Problem 3, in which all the arithmetic content of the original sieving problem has been abstracted into two parameters ${z,D}$ and a multiplicative function ${g}$ . In many applications, ${g(p)}$ will be approximately ${\kappa/p}$ on the average for some fixed ${\kappa>0}$ , known as the sieve dimension; for instance, in the twin prime sieving problem discussed above, the sieve dimension is ${2}$ . The larger one makes the level of distribution ${D}$ compared to ${z}$ , the more choices one has for the upper and lower bound sieves; it is thus of interest to obtain equidistribution estimates such as (13) for ${d}$ as large as possible. When the sequence ${a_d}$ is of arithmetic origin (for instance, if it is the von Mangoldt function ${\Lambda}$ ), then estimates such as the Bombieri-Vinogradov theorem, Theorem 17 from Notes 3, turn out to be particularly useful in this regard; in other contexts, the required equidistribution estimates might come from other sources, such as homogeneous dynamics, or the theory of expander graphs (the latter arises in the recent theory of the affine sieve, discussed in this previous blog post). However, the sieve-theoretic tools developed in this post are not particularly sensitive to how a certain level of distribution is attained, and are generally content to use sieve axioms such as (13) as “black boxes”.

In some applications one needs to modify Problem 10 in various technical ways (e.g. in altering the product ${P(z)}$ , the set ${{\mathcal D}}$ , or the definition of an upper or lower sieve coefficient sequence), but to simplify the exposition we will focus on the above problem without such alterations.

As the exercise below (or the heuristic (7)) suggests, the “natural” size of (14) and (15) is given by the quantity ${V(z) := \prod_{p < z} (1 - g(p))}$ (so that the natural size for Problem 3 is ${V(z) X}$ ):

Exercise 11 Let ${z,D,g}$ be as in Problem 10, and set ${V(z) := \prod_{p \leq z} (1 - g(p))}$ .

(i) Show that the quantity (14) is always at least ${V(z)}$ when ${(\lambda^+_d)_{d \in {\mathcal D}}}$ is a sequence of upper bound sieve coefficients. Similarly, show that the quantity (15) is always at most ${V(z)}$ when ${(\lambda^-_d)_{d \in {\mathcal D}}}$ is a sequence of lower bound sieve coefficients. (Hint: compute the expected value of ${\sum_{d|n} \lambda^\pm_d}$ when ${n}$ is a random factor of ${P(z)}$ chosen according to a certain probability distribution depending on ${g}$ .)

(ii) Show that (14) and (15) can both attain the value of ${V(z)}$ when ${D \geq P(z)}$ . (Hint: translate the Legendre sieve to this setting.)

The problem of finding good sequences of upper and lower bound sieve coefficients in order to solve problems such as Problem 10 is one of the core objectives of sieve theory, and has been intensively studied. This is more of an optimisation problem rather than a genuinely number theoretic problem; however, the optimisation problem is sufficiently complicated that it has not been solved exactly or even asymptotically, except in a few special cases. (It can be reduced to a optimisation problem involving multilinear integrals of certain unknown functions of several variables, but this problem is rather difficult to analyse further; see these lecture notes of Selberg for further discussion.) But while we do not yet have a definitive solution to this problem in general, we do have a number of good general-purpose upper and lower bound sieve coefficients that give fairly good values for (14), (15), often coming within a constant factor of the idealised value ${V(z)}$ , and which work well for sifting levels ${z}$ as large as a small power of the level of distribution ${D}$ . Unfortunately, we also know of an important limitation to the sieve, known as the parity problem, that prevents one from taking ${z}$ as large as ${D^{1/2}}$ while still obtaining non-trivial lower bounds; as a consequence, sieve theory is not able, on its own, to sift out primes for such purposes as establishing the twin prime conjecture. However, it is still possible to use these sieves, in conjunction with additional tools, to produce various types of primes or prime patterns in some cases; examples of this include the theorem of Ben Green and myself in which an upper bound sieve is used to demonstrate the existence of primes in arbitrarily long arithmetic progressions, or the more recent theorem of Zhang in which (among other things) used an upper bound sieve was used to demonstrate the existence of infinitely many pairs of primes whose difference was bounded. In such arguments, the upper bound sieve was used not so much to count the primes or prime patterns directly, but to serve instead as a sort of “container” to efficiently envelop such prime patterns; when used in such a manner, the upper bound sieves are sometimes known as enveloping sieves. If the original sequence was supported on primes, then the enveloping sieve can be viewed as a “smoothed out indicator function” that is concentrated on almost primes, which in this context refers to numbers with no small prime factors.

In a somewhat different direction, it can be possible in some cases to break the parity barrier by assuming additional equidistribution axioms on the sequence ${a_n}$ than just (13), in particular controlling certain bilinear sums involving ${a_{nm}}$ rather than just linear sums of the ${a_n}$ . This approach was in particular pursued by Friedlander and Iwaniec, leading to their theorem that there are infinitely many primes of the form ${n^2+m^4}$ .

The study of sieves is an immense topic; see for instance the recent 527-page text by Friedlander and Iwaniec. We will limit attention to two sieves which give good general-purpose results, if not necessarily the most optimal ones:

(i) The beta sieve (or Rosser-Iwaniec sieve), which is a modification of the classical combinatorial sieve of Brun. (A collection of sieve coefficients ${\lambda_d^{\pm}}$ is called combinatorial if its coefficients lie in ${\{-1,0,+1\}}$ .) The beta sieve is a family of upper and lower bound combinatorial sieves, and are particularly useful for efficiently sieving out all primes up to a parameter ${z = x^{1/u}}$ from a set of integers of size ${x}$ , in the regime where ${u}$ is moderately large, leading to what is sometimes known as the fundamental lemma of sieve theory.
(ii) The Selberg upper bound sieve, which is a general-purpose sieve that can serve both as an upper bound sieve for classical sieving problems, as well as an enveloping sieve for sets such as the primes. (One can also convert the Selberg upper bound sieve into a lower bound sieve in a number of ways, but we will only touch upon this briefly.) A key advantage of the Selberg sieve is that, due to the “quadratic” nature of the sieve, the difficult optimisation problem in Problem 10 is replaced with a much more tractable quadratic optimisation problem, which can often be solved for exactly.

Remark 12 It is possible to compose two sieves together, for instance by using the observation that the product of two upper bound sieves is again an upper bound sieve, or that the product of an upper bound sieve and a lower bound sieve is a lower bound sieve. Such a composition of sieves is useful in some applications, for instance if one wants to apply the fundamental lemma as a “preliminary sieve” to sieve out small primes, but then use a more precise sieve like the Selberg sieve to sieve out medium primes. We will see an example of this in later notes, when we discuss the linear beta-sieve.

We will also briefly present the (arithmetic) large sieve, which gives a rather different approach to Problem 3 in the case that each ${E_p}$ consists of some number (typically a large number) of residue classes modulo ${p}$ , and is powered by the (analytic) large sieve inequality of the preceding section. As an application of these methods, we will utilise the Selberg upper bound sieve as an enveloping sieve to establish Zhang’s theorem on bounded gaps between primes. Finally, we give an informal discussion of the parity barrier which gives some heuristic limitations on what sieve theory is able to accomplish with regards to counting prime patters such as twin primes.

These notes are only an introduction to the vast topic of sieve theory; more detailed discussion can be found in the Friedlander-Iwaniec text, in these lecture notes of Selberg, and in many further texts.

Read the rest of this entry »

A general parity problem obstruction

21 November, 2014 in expository, math.NT | Tags: parity problem, sieve theory, Zeb Brady | by Terence Tao | 10 comments

Many problems and results in analytic prime number theory can be formulated in the following general form: given a collection of (affine-)linear forms ${L_1(n),\dots,L_k(n)}$ , none of which is a multiple of any other, find a number ${n}$ such that a certain property ${P( L_1(n),\dots,L_k(n) )}$ of the linear forms ${L_1(n),\dots,L_k(n)}$ are true. For instance:

For the twin prime conjecture, one can use the linear forms ${L_1(n) := n}$ , ${L_2(n) := n+2}$ , and the property ${P( L_1(n), L_2(n) )}$ in question is the assertion that ${L_1(n)}$ and ${L_2(n)}$ are both prime.
For the even Goldbach conjecture, the claim is similar but one uses the linear forms ${L_1(n) := n}$ , ${L_2(n) := N-n}$ for some even integer ${N}$ .
For Chen’s theorem, we use the same linear forms ${L_1(n),L_2(n)}$ as in the previous two cases, but now ${P(L_1(n), L_2(n))}$ is the assertion that ${L_1(n)}$ is prime and ${L_2(n)}$ is an almost prime (in the sense that there are at most two prime factors).
In the recent results establishing bounded gaps between primes, we use the linear forms ${L_i(n) = n + h_i}$ for some admissible tuple ${h_1,\dots,h_k}$ , and take ${P(L_1(n),\dots,L_k(n))}$ to be the assertion that at least two of ${L_1(n),\dots,L_k(n)}$ are prime.

For these sorts of results, one can try a sieve-theoretic approach, which can broadly be formulated as follows:

First, one chooses a carefully selected sieve weight ${\nu: {\bf N} \rightarrow {\bf R}^+}$ , which could for instance be a non-negative function having a divisor sum form
$\displaystyle \nu(n) := \sum_{d_1|L_1(n), \dots, d_k|L_k(n); d_1 \dots d_k \leq x^{1-\varepsilon}} \lambda_{d_1,\dots,d_k}$

for some coefficients ${\lambda_{d_1,\dots,d_k}}$ , where ${x}$ is a natural scale parameter. The precise choice of sieve weight is often quite a delicate matter, but will not be discussed here. (In some cases, one may work with multiple sieve weights ${\nu_1, \nu_2, \dots}$ .)
Next, one uses tools from analytic number theory (such as the Bombieri-Vinogradov theorem) to obtain upper and lower bounds for sums such as
$\displaystyle \sum_n \nu(n) \ \ \ \ \ (1)$

or

$\displaystyle \sum_n \nu(n) 1_{L_i(n) \hbox{ prime}} \ \ \ \ \ (2)$

or more generally of the form

$\displaystyle \sum_n \nu(n) f(L_i(n)) \ \ \ \ \ (3)$

where ${f(L_i(n))}$ is some “arithmetic” function involving the prime factorisation of ${L_i(n)}$ (we will be a bit vague about what this means precisely, but a typical choice of ${f}$ might be a Dirichlet convolution ${\alpha*\beta(L_i(n))}$ of two other arithmetic functions ${\alpha,\beta}$ ).
Using some combinatorial arguments, one manipulates these upper and lower bounds, together with the non-negative nature of ${\nu}$ , to conclude the existence of an ${n}$ in the support of ${\nu}$ (or of at least one of the sieve weights ${\nu_1, \nu_2, \dots}$ being considered) for which ${P( L_1(n), \dots, L_k(n) )}$ holds

For instance, in the recent results on bounded gaps between primes, one selects a sieve weight ${\nu}$ for which one has upper bounds on

$\displaystyle \sum_n \nu(n)$

and lower bounds on

$\displaystyle \sum_n \nu(n) 1_{n+h_i \hbox{ prime}}$

so that one can show that the expression

$\displaystyle \sum_n \nu(n) (\sum_{i=1}^k 1_{n+h_i \hbox{ prime}} - 1)$

is strictly positive, which implies the existence of an ${n}$ in the support of ${\nu}$ such that at least two of ${n+h_1,\dots,n+h_k}$ are prime. As another example, to prove Chen’s theorem to find ${n}$ such that ${L_1(n)}$ is prime and ${L_2(n)}$ is almost prime, one uses a variety of sieve weights to produce a lower bound for

$\displaystyle S_1 := \sum_{n \leq x} 1_{L_1(n) \hbox{ prime}} 1_{L_2(n) \hbox{ rough}}$

and an upper bound for

$\displaystyle S_2 := \sum_{z \leq p < x^{1/3}} \sum_{n \leq x} 1_{L_1(n) \hbox{ prime}} 1_{p|L_2(n)} 1_{L_2(n) \hbox{ rough}}$

and

$\displaystyle S_3 := \sum_{n \leq x} 1_{L_1(n) \hbox{ prime}} 1_{L_2(n)=pqr \hbox{ for some } z \leq p \leq x^{1/3} < q \leq r},$

where ${z}$ is some parameter between ${1}$ and ${x^{1/3}}$ , and “rough” means that all prime factors are at least ${z}$ . One can observe that if ${S_1 - \frac{1}{2} S_2 - \frac{1}{2} S_3 > 0}$ , then there must be at least one ${n}$ for which ${L_1(n)}$ is prime and ${L_2(n)}$ is almost prime, since for any rough number ${m}$ , the quantity

$\displaystyle 1 - \frac{1}{2} \sum_{z \leq p < x^{1/3}} 1_{p|m} - \frac{1}{2} \sum_{z \leq p \leq x^{1/3} < q \leq r} 1_{m = pqr}$

is only positive when ${m}$ is an almost prime (if ${m}$ has three or more factors, then either it has at least two factors less than ${x^{1/3}}$ , or it is of the form ${pqr}$ for some ${p \leq x^{1/3} < q \leq r}$ ). The upper and lower bounds on ${S_1,S_2,S_3}$ are ultimately produced via asymptotics for expressions of the form (1), (2), (3) for various divisor sums ${\nu}$ and various arithmetic functions ${f}$ .

Unfortunately, there is an obstruction to sieve-theoretic techniques working for certain types of properties ${P(L_1(n),\dots,L_k(n))}$ , which Zeb Brady and I recently formalised at an AIM workshop this week. To state the result, we recall the Liouville function ${\lambda(n)}$ , defined by setting ${\lambda(n) = (-1)^j}$ whenever ${n}$ is the product of exactly ${j}$ primes (counting multiplicity). Define a sign pattern to be an element ${(\epsilon_1,\dots,\epsilon_k)}$ of the discrete cube ${\{-1,+1\}^k}$ . Given a property ${P(l_1,\dots,l_k)}$ of ${k}$ natural numbers ${l_1,\dots,l_k}$ , we say that a sign pattern ${(\epsilon_1,\dots,\epsilon_k)}$ is forbidden by ${P}$ if there does not exist any natural numbers ${l_1,\dots,l_k}$ obeying ${P(l_1,\dots,l_k)}$ for which

$\displaystyle (\lambda(l_1),\dots,\lambda(l_k)) = (\epsilon_1,\dots,\epsilon_k).$

Example 1 Let ${P(l_1,l_2,l_3)}$ be the property that at least two of ${l_1,l_2,l_3}$ are prime. Then the sign patterns ${(+1,+1,+1)}$ , ${(+1,+1,-1)}$ , ${(+1,-1,+1)}$ , ${(-1,+1,+1)}$ are forbidden, because prime numbers have a Liouville function of ${-1}$ , so that ${P(l_1,l_2,l_3)}$ can only occur when at least two of ${\lambda(l_1),\lambda(l_2), \lambda(l_3)}$ are equal to ${-1}$ .

Example 2 Let ${P(l_1,l_2)}$ be the property that ${l_1}$ is prime and ${l_2}$ is almost prime. Then the only forbidden sign patterns are ${(+1,+1)}$ and ${(+1,-1)}$ .

Example 3 Let ${P(l_1,l_2)}$ be the property that ${l_1}$ and ${l_2}$ are both prime. Then ${(+1,+1), (+1,-1), (-1,+1)}$ are all forbidden sign patterns.

We then have a parity obstruction as soon as ${P}$ has “too many” forbidden sign patterns, in the following (slightly informal) sense:

Claim 1 (Parity obstruction) Suppose ${P(l_1,\dots,l_k)}$ is such that that the convex hull of the forbidden sign patterns of ${P}$ contains the origin. Then one cannot use the above sieve-theoretic approach to establish the existence of an ${n}$ such that ${P(L_1(n),\dots,L_k(n))}$ holds.

Thus for instance, the property in Example 3 is subject to the parity obstruction since ${0}$ is a convex combination of ${(+1,-1)}$ and ${(-1,+1)}$ , whereas the properties in Examples 1, 2 are not. One can also check that the property “at least ${j}$ of the ${k}$ numbers ${l_1,\dots,l_k}$ is prime” is subject to the parity obstruction as soon as ${j \geq \frac{k}{2}+1}$ . Thus, the largest number of elements of a ${k}$ -tuple that one can force to be prime by purely sieve-theoretic methods is ${k/2}$ , rounded up.

This claim is not precisely a theorem, because it presumes a certain “Liouville pseudorandomness conjecture” (a very close cousin of the more well known “Möbius pseudorandomness conjecture”) which is a bit difficult to formalise precisely. However, this conjecture is widely believed by analytic number theorists, see e.g. this blog post for a discussion. (Note though that there are scenarios, most notably the “Siegel zero” scenario, in which there is a severe breakdown of this pseudorandomness conjecture, and the parity obstruction then disappears. A typical instance of this is Heath-Brown’s proof of the twin prime conjecture (which would ordinarily be subject to the parity obstruction) under the hypothesis of a Siegel zero.) The obstruction also does not prevent the establishment of an ${n}$ such that ${P(L_1(n),\dots,L_k(n))}$ holds by introducing additional sieve axioms beyond upper and lower bounds on quantities such as (1), (2), (3). The proof of the Friedlander-Iwaniec theorem is a good example of this latter scenario.

Now we give a (slightly nonrigorous) proof of the claim.

Proof: (Nonrigorous) Suppose that the convex hull of the forbidden sign patterns contain the origin. Then we can find non-negative numbers ${p_{\epsilon_1,\dots,\epsilon_k}}$ for sign patterns ${(\epsilon_1,\dots,\epsilon_k)}$ , which sum to ${1}$ , are non-zero only for forbidden sign patterns, and which have mean zero in the sense that

$\displaystyle \sum_{(\epsilon_1,\dots,\epsilon_k)} p_{\epsilon_1,\dots,\epsilon_k} \epsilon_i = 0$

for all ${i=1,\dots,k}$ . By Fourier expansion (or Lagrange interpolation), one can then write ${p_{\epsilon_1,\dots,\epsilon_k}}$ as a polynomial

$\displaystyle p_{\epsilon_1,\dots,\epsilon_k} = 1 + Q( \epsilon_1,\dots,\epsilon_k)$

where ${Q(t_1,\dots,t_k)}$ is a polynomial in ${k}$ variables that is a linear combination of monomials ${t_{i_1} \dots t_{i_r}}$ with ${i_1 < \dots < i_r}$ and ${r \geq 2}$ (thus ${Q}$ has no constant or linear terms, and no monomials with repeated terms). The point is that the mean zero condition allows one to eliminate the linear terms. If we now consider the weight function

$\displaystyle w(n) := 1 + Q( \lambda(L_1(n)), \dots, \lambda(L_k(n)) )$

then ${w}$ is non-negative, is supported solely on ${n}$ for which ${(\lambda(L_1(n)),\dots,\lambda(L_k(n)))}$ is a forbidden pattern, and is equal to ${1}$ plus a linear combination of monomials ${\lambda(L_{i_1}(n)) \dots \lambda(L_{i_r}(n))}$ with ${r \geq 2}$ .

The Liouville pseudorandomness principle then predicts that sums of the form

$\displaystyle \sum_n \nu(n) Q( \lambda(L_1(n)), \dots, \lambda(L_k(n)) )$

and

$\displaystyle \sum_n \nu(n) Q( \lambda(L_1(n)), \dots, \lambda(L_k(n)) ) 1_{L_i(n) \hbox{ prime}}$

or more generally

$\displaystyle \sum_n \nu(n) Q( \lambda(L_1(n)), \dots, \lambda(L_k(n)) ) f(L_i(n))$

should be asymptotically negligible; intuitively, the point here is that the prime factorisation of ${L_i(n)}$ should not influence the Liouville function of ${L_j(n)}$ , even on the short arithmetic progressions that the divisor sum ${\nu}$ is built out of, and so any monomial ${\lambda(L_{i_1}(n)) \dots \lambda(L_{i_r}(n))}$ occurring in ${Q( \lambda(L_1(n)), \dots, \lambda(L_k(n)) )}$ should exhibit strong cancellation for any of the above sums. If one accepts this principle, then all the expressions (1), (2), (3) should be essentially unchanged when ${\nu(n)}$ is replaced by ${\nu(n) w(n)}$ .

Suppose now for sake of contradiction that one could use sieve-theoretic methods to locate an ${n}$ in the support of some sieve weight ${\nu(n)}$ obeying ${P( L_1(n),\dots,L_k(n))}$ . Then, by reweighting all sieve weights by the additional multiplicative factor of ${w(n)}$ , the same arguments should also be able to locate ${n}$ in the support of ${\nu(n) w(n)}$ for which ${P( L_1(n),\dots,L_k(n))}$ holds. But ${w}$ is only supported on those ${n}$ whose Liouville sign pattern is forbidden, a contradiction. $\Box$

Claim 1 is sharp in the following sense: if the convex hull of the forbidden sign patterns of ${P}$ do not contain the origin, then by the Hahn-Banach theorem (in the hyperplane separation form), there exist real coefficients ${c_1,\dots,c_k}$ such that

$\displaystyle c_1 \epsilon_1 + \dots + c_k \epsilon_k < -c$

for all forbidden sign patterns ${(\epsilon_1,\dots,\epsilon_k)}$ and some ${c>0}$ . On the other hand, from Liouville pseudorandomness one expects that

$\displaystyle \sum_n \nu(n) (c_1 \lambda(L_1(n)) + \dots + c_k \lambda(L_k(n)))$

is negligible (as compared against ${\sum_n \nu(n)}$ for any reasonable sieve weight ${\nu}$ . We conclude that for some ${n}$ in the support of ${\nu}$ , that

$\displaystyle c_1 \lambda(L_1(n)) + \dots + c_k \lambda(L_k(n)) > -c \ \ \ \ \ (4)$

and hence ${(\lambda(L_1(n)),\dots,\lambda(L_k(n)))}$ is not a forbidden sign pattern. This does not actually imply that ${P(L_1(n),\dots,L_k(n))}$ holds, but it does not prevent ${P(L_1(n),\dots,L_k(n))}$ from holding purely from parity considerations. Thus, we do not expect a parity obstruction of the type in Claim 1 to hold when the convex hull of forbidden sign patterns does not contain the origin.

Example 4 Let ${G}$ be a graph on ${k}$ vertices ${\{1,\dots,k\}}$ , and let ${P(l_1,\dots,l_k)}$ be the property that one can find an edge ${\{i,j\}}$ of ${G}$ with ${l_i,l_j}$ both prime. We claim that this property is subject to the parity problem precisely when ${G}$ is two-colourable. Indeed, if ${G}$ is two-colourable, then we can colour ${\{1,\dots,k\}}$ into two colours (say, red and green) such that all edges in ${G}$ connect a red vertex to a green vertex. If we then consider the two sign patterns in which all the red vertices have one sign and the green vertices have the opposite sign, these are two forbidden sign patterns which contain the origin in the convex hull, and so the parity problem applies. Conversely, suppose that ${G}$ is not two-colourable, then it contains an odd cycle. Any forbidden sign pattern then must contain more ${+1}$ s on this odd cycle than ${-1}$ s (since otherwise two of the ${-1}$ s are adjacent on this cycle by the pigeonhole principle, and this is not forbidden), and so by convexity any tuple in the convex hull of this sign pattern has a positive sum on this odd cycle. Hence the origin is not in the convex hull, and the parity obstruction does not apply. (See also this previous post for a similar obstruction ultimately coming from two-colourability).

Example 5 An example of a parity-obstructed property (supplied by Zeb Brady) that does not come from two-colourability: we let ${P( l_{\{1,2\}}, l_{\{1,3\}}, l_{\{1,4\}}, l_{\{2,3\}}, l_{\{2,4\}}, l_{\{3,4\}} )}$ be the property that ${l_{A_1},\dots,l_{A_r}}$ are prime for some collection ${A_1,\dots,A_r}$ of pair sets that cover ${\{1,\dots,4\}}$ . For instance, this property holds if ${l_{\{1,2\}}, l_{\{3,4\}}}$ are both prime, or if ${l_{\{1,2\}}, l_{\{1,3\}}, l_{\{1,4\}}}$ are all prime, but not if ${l_{\{1,2\}}, l_{\{1,3\}}, l_{\{2,3\}}}$ are the only primes. An example of a forbidden sign pattern is the pattern where ${\{1,2\}, \{2,3\}, \{1,3\}}$ are given the sign ${-1}$ , and the other three pairs are given ${+1}$ . Averaging over permutations of ${1,2,3,4}$ we see that zero lies in the convex hull, and so this example is blocked by parity. However, there is no sign pattern such that it and its negation are both forbidden, which is another formulation of two-colourability.

Of course, the absence of a parity obstruction does not automatically mean that the desired claim is true. For instance, given an admissible ${5}$ -tuple ${h_1,\dots,h_5}$ , parity obstructions do not prevent one from establishing the existence of infinitely many ${n}$ such that at least three of ${n+h_1,\dots,n+h_5}$ are prime, however we are not yet able to actually establish this, even assuming strong sieve-theoretic hypotheses such as the generalised Elliott-Halberstam hypothesis. (However, the argument giving (4) does easily give the far weaker claim that there exist infinitely many ${n}$ such that at least three of ${n+h_1,\dots,n+h_5}$ have a Liouville function of ${-1}$ .)

Remark 1 Another way to get past the parity problem in some cases is to take advantage of linear forms that are constant multiples of each other (which correlates the Liouville functions to each other). For instance, on GEH we can find two ${E_3}$ numbers (products of exactly three primes) that differ by exactly ${60}$ ; a direct sieve approach using the linear forms ${n,n+60}$ fails due to the parity obstruction, but instead one can first find ${n}$ such that two of ${n,n+4,n+10}$ are prime, and then among the pairs of linear forms ${(15n,15n+60)}$ , ${(6n,6n+60)}$ , ${(10n+40,10n+100)}$ one can find a pair of ${E_3}$ numbers that differ by exactly ${60}$ . See this paper of Goldston, Graham, Pintz, and Yildirim for more examples of this type.

I thank John Friedlander and Sid Graham for helpful discussions and encouragement.

The parity problem obstruction for the binary Goldbach problem with bounded error

9 July, 2014 in expository, math.NT | Tags: Goldbach conjecture, parity problem, sieve theory | by Terence Tao | 20 comments

Two of the most famous open problems in additive prime number theory are the twin prime conjecture and the binary Goldbach conjecture. They have quite similar forms:

Twin prime conjecture The equation ${p_1 - p_2 = 2}$ has infinitely many solutions with ${p_1,p_2}$ prime.
Binary Goldbach conjecture The equation ${p_1 + p_2 = N}$ has at least one solution with ${p_1,p_2}$ prime for any given even ${N \geq 4}$ .

In view of this similarity, it is not surprising that the partial progress on these two conjectures have tracked each other fairly closely; the twin prime conjecture is generally considered slightly easier than the binary Goldbach conjecture, but broadly speaking any progress made on one of the conjectures has also led to a comparable amount of progress on the other. (For instance, Chen’s theorem has a version for the twin prime conjecture, and a version for the binary Goldbach conjecture.) Also, the notorious parity obstruction is present in both problems, preventing a solution to either conjecture by almost all known methods (see this previous blog post for more discussion).

In this post, I would like to note a divergence from this general principle, with regards to bounded error versions of these two conjectures:

Twin prime with bounded error The inequalities ${0 < p_1 - p_2 < H}$ has infinitely many solutions with ${p_1,p_2}$ prime for some absolute constant ${H}$ .
Binary Goldbach with bounded error The inequalities ${N \leq p_1+p_2 \leq N+H}$ has at least one solution with ${p_1,p_2}$ prime for any sufficiently large ${N}$ and some absolute constant ${H}$ .

The first of these statements is now a well-known theorem of Zhang, and the Polymath8b project hosted on this blog has managed to lower ${H}$ to ${H=246}$ unconditionally, and to ${H=6}$ assuming the generalised Elliott-Halberstam conjecture. However, the second statement remains open; the best result that the Polymath8b project could manage in this direction is that (assuming GEH) at least one of the binary Goldbach conjecture with bounded error, or the twin prime conjecture with no error, had to be true.

All the known proofs of Zhang’s theorem proceed through sieve-theoretic means. Basically, they take as input equidistribution results that control the size of discrepancies such as

$\displaystyle \Delta(f; a\ (q)) := \sum_{x \leq n \leq 2x; n=a\ (q)} f(n) - \frac{1}{\phi(q)} \sum_{x \leq n \leq 2x} f(n) \ \ \ \ \ (1)$

for various congruence classes ${a\ (q)}$ and various arithmetic functions ${f}$ , e.g. ${f(n) = \Lambda(n+h_i)}$ (or more generaly ${f(n) = \alpha * \beta(n+h_i)}$ for various ${\alpha,\beta}$ ). After taking some carefully chosen linear combinations of these discrepancies, and using the trivial positivity lower bound

$\displaystyle a_n \geq 0 \hbox{ for all } n \implies \sum_n a_n \geq 0 \ \ \ \ \ (2)$

one eventually obtains (for suitable ${H}$ ) a non-trivial lower bound of the form

$\displaystyle \sum_{x \leq n \leq 2x} \nu(n) 1_A(n) > 0$

where ${\nu}$ is some weight function, and ${A}$ is the set of ${n}$ such that there are at least two primes in the interval ${[n,n+H]}$ . This implies at least one solution to the inequalities ${0 < p_1 - p_2 < H}$ with ${p_1,p_2 \sim x}$ , and Zhang’s theorem follows.

In a similar vein, one could hope to use bounds on discrepancies such as (1) (for ${x}$ comparable to ${N}$ ), together with the trivial lower bound (2), to obtain (for sufficiently large ${N}$ , and suitable ${H}$ ) a non-trivial lower bound of the form

$\displaystyle \sum_{n \leq N} \nu(n) 1_B(n) > 0 \ \ \ \ \ (3)$

for some weight function ${\nu}$ , where ${B}$ is the set of ${n}$ such that there is at least one prime in each of the intervals ${[n,n+H]}$ and ${[N-n-H,n]}$ . This would imply the binary Goldbach conjecture with bounded error.

However, the parity obstruction blocks such a strategy from working (for much the same reason that it blocks any bound of the form ${H \leq 4}$ in Zhang’s theorem, as discussed in the Polymath8b paper.) The reason is as follows. The sieve-theoretic arguments are linear with respect to the ${n}$ summation, and as such, any such sieve-theoretic argument would automatically also work in a weighted setting in which the ${n}$ summation is weighted by some non-negative weight ${\omega(n) \geq 0}$ . More precisely, if one could control the weighted discrepancies

$\displaystyle \Delta(f\omega; a\ (q)) = \sum_{x \leq n \leq 2x; n=a\ (q)} f(n) \omega(n) - \frac{1}{\phi(q)} \sum_{x \leq n \leq 2x} f(n) \omega(n)$

to essentially the same accuracy as the unweighted discrepancies (1), then thanks to the trivial weighted version

$\displaystyle a_n \geq 0 \hbox{ for all } n \implies \sum_n a_n \omega(n) \geq 0$

of (2), any sieve-theoretic argument that was capable of proving (3) would also be capable of proving the weighted estimate

$\displaystyle \sum_{n \leq N} \nu(n) 1_B(n) \omega(n) > 0. \ \ \ \ \ (4)$

However, (4) may be defeated by a suitable choice of weight ${\omega}$ , namely

$\displaystyle \omega(n) := \prod_{i=1}^H (1 + \lambda(n) \lambda(n+i)) \times \prod_{j=0}^H (1 - \lambda(n) \lambda(N-n-j))$

where ${n \mapsto \lambda(n)}$ is the Liouville function, which counts the parity of the number of prime factors of a given number ${n}$ . Since ${\lambda(n)^2 = 1}$ , one can expand out ${\omega(n)}$ as the sum of ${1}$ and a finite number of other terms, each of which consists of the product of two or more translates (or reflections) of ${\lambda}$ . But from the Möbius randomness principle (or its analogue for the Liouville function), such products of ${\lambda}$ are widely expected to be essentially orthogonal to any arithmetic function ${f(n)}$ that is arising from a single multiplicative function such as ${\Lambda}$ , even on very short arithmetic progressions. As such, replacing ${1}$ by ${\omega(n)}$ in (1) should have a negligible effect on the discrepancy. On the other hand, in order for ${\omega(n)}$ to be non-zero, ${\lambda(n+i)}$ has to have the same sign as ${\lambda(n)}$ and hence the opposite sign to ${\lambda(N-n-j)}$ cannot simultaneously be prime for any ${0 \leq i,j \leq H}$ , and so ${1_B(n) \omega(n)}$ vanishes identically, contradicting (4). This indirectly rules out any modification of the Goldston-Pintz-Yildirim/Zhang method for establishing the binary Goldbach conjecture with bounded error.

The above argument is not watertight, and one could envisage some ways around this problem. One of them is that the Möbius randomness principle could simply be false, in which case the parity obstruction vanishes. A good example of this is the result of Heath-Brown that shows that if there are infinitely many Siegel zeroes (which is a strong violation of the Möbius randomness principle), then the twin prime conjecture holds. Another way around the obstruction is to start controlling the discrepancy (1) for functions ${f}$ that are combinations of more than one multiplicative function, e.g. ${f(n) = \Lambda(n) \Lambda(n+2)}$ . However, controlling such functions looks to be at least as difficult as the twin prime conjecture (which is morally equivalent to obtaining non-trivial lower-bounds for ${\sum_{x \leq n \leq 2x} \Lambda(n) \Lambda(n+2)}$ ). A third option is not to use a sieve-theoretic argument, but to try a different method (e.g. the circle method). However, most other known methods also exhibit linearity in the “ ${n}$ ” variable and I would suspect they would be vulnerable to a similar obstruction. (In any case, the circle method specifically has some other difficulties in tackling binary problems, as discussed in this previous post.)

Heuristic limitations of the circle method

20 May, 2012 in expository, math.NT | Tags: circle method, exponential sums, Goldbach conjecture, major arcs, minor arcs, parity problem, prime number theorem, prime numbers, twin prime conjecture | by Terence Tao | 36 comments

One of the most basic methods in additive number theory is the Hardy-Littlewood circle method. This method is based on expressing a quantity of interest to additive number theory, such as the number of representations ${f_3(x)}$ of an integer ${x}$ as the sum of three primes ${x = p_1+p_2+p_3}$ , as a Fourier-analytic integral over the unit circle ${{\bf R}/{\bf Z}}$ involving exponential sums such as

$\displaystyle S(x,\alpha) := \sum_{p \leq x} e( \alpha p) \ \ \ \ \ (1)$

where the sum here ranges over all primes up to ${x}$ , and ${e(x) := e^{2\pi i x}}$ . For instance, the expression ${f(x)}$ mentioned earlier can be written as

$\displaystyle f_3(x) = \int_{{\bf R}/{\bf Z}} S(x,\alpha)^3 e(-x\alpha)\ d\alpha. \ \ \ \ \ (2)$

The strategy is then to obtain sufficiently accurate bounds on exponential sums such as ${S(x,\alpha)}$ in order to obtain non-trivial bounds on quantities such as ${f_3(x)}$ . For instance, if one can show that ${f_3(x)>0}$ for all odd integers ${x}$ greater than some given threshold ${x_0}$ , this implies that all odd integers greater than ${x_0}$ are expressible as the sum of three primes, thus establishing all but finitely many instances of the odd Goldbach conjecture.

Remark 1 In practice, it can be more efficient to work with smoother sums than the partial sum (1), for instance by replacing the cutoff ${p \leq x}$ with a smoother cutoff ${\chi(p/x)}$ for a suitable choice of cutoff function ${\chi}$ , or by replacing the restriction of the summation to primes by a more analytically tractable weight, such as the von Mangoldt function ${\Lambda(n)}$ . However, these improvements to the circle method are primarily technical in nature and do not have much impact on the heuristic discussion in this post, so we will not emphasise them here. One can also certainly use the circle method to study additive combinations of numbers from other sets than the set of primes, but we will restrict attention to additive combinations of primes for sake of discussion, as it is historically one of the most studied sets in additive number theory.

In many cases, it turns out that one can get fairly precise evaluations on sums such as ${S(x,\alpha)}$ in the major arc case, when ${\alpha}$ is close to a rational number ${a/q}$ with small denominator ${q}$ , by using tools such as the prime number theorem in arithmetic progressions. For instance, the prime number theorem itself tells us that

$\displaystyle S(x,0) \approx \frac{x}{\log x}$

and the prime number theorem in residue classes modulo ${q}$ suggests more generally that

$\displaystyle S(x,\frac{a}{q}) \approx \frac{\mu(q)}{\phi(q)} \frac{x}{\log x}$

when ${q}$ is small and ${a}$ is close to ${q}$ , basically thanks to the elementary calculation that the phase ${e(an/q)}$ has an average value of ${\mu(q)/\phi(q)}$ when ${n}$ is uniformly distributed amongst the residue classes modulo ${q}$ that are coprime to ${q}$ . Quantifying the precise error in these approximations can be quite challenging, though, unless one assumes powerful hypotheses such as the Generalised Riemann Hypothesis.

In the minor arc case when ${\alpha}$ is not close to a rational ${a/q}$ with small denominator, one no longer expects to have such precise control on the value of ${S(x,\alpha)}$ , due to the “pseudorandom” fluctuations of the quantity ${e(\alpha p)}$ . Using the standard probabilistic heuristic (supported by results such as the central limit theorem or Chernoff’s inequality) that the sum of ${k}$ “pseudorandom” phases should fluctuate randomly and be of typical magnitude ${\sim \sqrt{k}}$ , one expects upper bounds of the shape

$\displaystyle |S(x,\alpha)| \lessapprox \sqrt{\frac{x}{\log x}} \ \ \ \ \ (3)$

for “typical” minor arc ${\alpha}$ . Indeed, a simple application of the Plancherel identity, followed by the prime number theorem, reveals that

$\displaystyle \int_{{\bf R}/{\bf Z}} |S(x,\alpha)|^2\ d\alpha \sim \frac{x}{\log x} \ \ \ \ \ (4)$

which is consistent with (though weaker than) the above heuristic. In practice, though, we are unable to rigorously establish bounds anywhere near as strong as (3); upper bounds such as ${x^{4/5+o(1)}}$ are far more typical.

Because one only expects to have upper bounds on ${|S(x,\alpha)|}$ , rather than asymptotics, in the minor arc case, one cannot realistically hope to make much use of phases such as ${e(-x\alpha)}$ for the minor arc contribution to integrals such as (2) (at least if one is working with a single, deterministic, value of ${x}$ , so that averaging in ${x}$ is unavailable). In particular, from upper bound information alone, it is difficult to avoid the “conspiracy” that the magnitude ${|S(x,\alpha)|^3}$ oscillates in sympathetic resonance with the phase ${e(-x\alpha)}$ , thus essentially eliminating almost all of the possible gain in the bounds that could arise from exploiting cancellation from that phase. Thus, one basically has little option except to use the triangle inequality to control the portion of the integral on the minor arc region ${\Omega_{minor}}$ :

$\displaystyle |\int_{\Omega_{minor}} S(x,\alpha)^3 e(-x\alpha)\ d\alpha| \leq \int_{\Omega_{minor}} |S(x,\alpha)|^3\ d\alpha.$

Despite this handicap, though, it is still possible to get enough bounds on both the major and minor arc contributions of integrals such as (2) to obtain non-trivial lower bounds on quantities such as ${f(x)}$ , at least when ${x}$ is large. In particular, this sort of method can be developed to give a proof of Vinogradov’s famous theorem that every sufficiently large odd integer ${x}$ is the sum of three primes; my own result that all odd numbers greater than ${1}$ can be expressed as the sum of at most five primes is also proven by essentially the same method (modulo a number of minor refinements, and taking advantage of some numerical work on both the Goldbach problems and on the Riemann hypothesis ). It is certainly conceivable that some further variant of the circle method (again combined with a suitable amount of numerical work, such as that of numerically establishing zero-free regions for the Generalised Riemann Hypothesis) can be used to settle the full odd Goldbach conjecture; indeed, under the assumption of the Generalised Riemann Hypothesis, this was already achieved by Deshouillers, Effinger, te Riele, and Zinoviev back in 1997. I am optimistic that an unconditional version of this result will be possible within a few years or so, though I should say that there are still significant technical challenges to doing so, and some clever new ideas will probably be needed to get either the Vinogradov-style argument or numerical verification to work unconditionally for the three-primes problem at medium-sized ranges of ${x}$ , such as ${x \sim 10^{50}}$ . (But the intermediate problem of representing all even natural numbers as the sum of at most four primes looks somewhat closer to being feasible, though even this would require some substantially new and non-trivial ideas beyond what is in my five-primes paper.)

However, I (and many other analytic number theorists) are considerably more skeptical that the circle method can be applied to the even Goldbach problem of representing a large even number ${x}$ as the sum ${x = p_1 + p_2}$ of two primes, or the similar (and marginally simpler) twin prime conjecture of finding infinitely many pairs of twin primes, i.e. finding infinitely many representations ${2 = p_1 - p_2}$ of ${2}$ as the difference of two primes. At first glance, the situation looks tantalisingly similar to that of the Vinogradov theorem: to settle the even Goldbach problem for large ${x}$ , one has to find a non-trivial lower bound for the quantity

$\displaystyle f_2(x) = \int_{{\bf R}/{\bf Z}} S(x,\alpha)^2 e(-x\alpha)\ d\alpha \ \ \ \ \ (5)$

for sufficiently large ${x}$ , as this quantity ${f_2(x)}$ is also the number of ways to represent ${x}$ as the sum ${x=p_1+p_2}$ of two primes ${p_1,p_2}$ . Similarly, to settle the twin prime problem, it would suffice to obtain a lower bound for the quantity

$\displaystyle \tilde f_2(x) = \int_{{\bf R}/{\bf Z}} |S(x,\alpha)|^2 e(-2\alpha)\ d\alpha \ \ \ \ \ (6)$

that goes to infinity as ${x \rightarrow \infty}$ , as this quantity ${\tilde f_2(x)}$ is also the number of ways to represent ${2}$ as the difference ${2 = p_1-p_2}$ of two primes less than or equal to ${x}$ .

In principle, one can achieve either of these two objectives by a sufficiently fine level of control on the exponential sums ${S(x,\alpha)}$ . Indeed, there is a trivial (and uninteresting) way to take any (hypothetical) solution of either the asymptotic even Goldbach problem or the twin prime problem and (artificially) convert it to a proof that “uses the circle method”; one simply begins with the quantity ${f_2(x)}$ or ${\tilde f_2(x)}$ , expresses it in terms of ${S(x,\alpha)}$ using (5) or (6), and then uses (5) or (6) again to convert these integrals back into a the combinatorial expression of counting solutions to ${x=p_1+p_2}$ or ${2=p_1-p_2}$ , and then uses the hypothetical solution to the given problem to obtain the required lower bounds on ${f_2(x)}$ or ${\tilde f_2(x)}$ .

Of course, this would not qualify as a genuine application of the circle method by any reasonable measure. One can then ask the more refined question of whether one could hope to get non-trivial lower bounds on ${f_2(x)}$ or ${\tilde f_2(x)}$ (or similar quantities) purely from the upper and lower bounds on ${S(x,\alpha)}$ or similar quantities (and of various ${L^p}$ type norms on such quantities, such as the ${L^2}$ bound (4)). Of course, we do not yet know what the strongest possible upper and lower bounds in ${S(x,\alpha)}$ are yet (otherwise we would already have made progress on major conjectures such as the Riemann hypothesis); but we can make plausible heuristic conjectures on such bounds. And this is enough to make the following heuristic conclusions:

(i) For “binary” problems such as computing (5), (6), the contribution of the minor arcs potentially dominates that of the major arcs (if all one is given about the minor arc sums is magnitude information), in contrast to “ternary” problems such as computing (2), in which it is the major arc contribution which is absolutely dominant.
(ii) Upper and lower bounds on the magnitude of ${S(x,\alpha)}$ are not sufficient, by themselves, to obtain non-trivial bounds on (5), (6) unless these bounds are extremely tight (within a relative error of ${O(1/\log x)}$ or better); but
(iii) obtaining such tight bounds is a problem of comparable difficulty to the original binary problems.

I will provide some justification for these conclusions below the fold; they are reasonably well known “folklore” to many researchers in the field, but it seems that they are rarely made explicit in the literature (in part because these arguments are, by their nature, heuristic instead of rigorous) and I have been asked about them from time to time, so I decided to try to write them down here.

In view of the above conclusions, it seems that the best one can hope to do by using the circle method for the twin prime or even Goldbach problems is to reformulate such problems into a statement of roughly comparable difficulty to the original problem, even if one assumes powerful conjectures such as the Generalised Riemann Hypothesis (which lets one make very precise control on major arc exponential sums, but not on minor arc ones). These are not rigorous conclusions – after all, we have already seen that one can always artifically insert the circle method into any viable approach on these problems – but they do strongly suggest that one needs a method other than the circle method in order to fully solve either of these two problems. I do not know what such a method would be, though I can give some heuristic objections to some of the other popular methods used in additive number theory (such as sieve methods, or more recently the use of inverse theorems); this will be done at the end of this post.

Read the rest of this entry »

Open question: The parity problem in sieve theory

5 June, 2007 in expository, math.NT, question | Tags: parity problem, sieve theory | by Terence Tao | 75 comments

The parity problem is a notorious problem in sieve theory: this theory was invented in order to count prime patterns of various types (e.g. twin primes), but despite superb success in obtaining upper bounds on the number of such patterns, it has proven to be somewhat disappointing in obtaining lower bounds. [Sieves can also be used to study many other things than primes, of course, but we shall focus only on primes in this post.] Even the task of reproving Euclid’s theorem – that there are infinitely many primes – seems to be extremely difficult to do by sieve theoretic means, unless one of course injects into the theory an estimate at least as strong as Euclid’s theorem (e.g. the prime number theorem). The main obstruction is the parity problem: even assuming such strong hypotheses as the Elliott-Halberstam conjecture (a sort of “super-generalised Riemann Hypothesis” for sieves), sieve theory is largely (but not completely) unable to distinguish numbers with an odd number of prime factors from numbers with an even number of prime factors. This “parity barrier” has been broken for some select patterns of primes by injecting some powerful non-sieve theory methods into the subject, but remains a formidable obstacle in general.

I’ll discuss the parity problem in more detail later in this post, but I want to first discuss how sieves work [drawing in part on some excellent unpublished lecture notes of Iwaniec]; the basic ideas are elementary and conceptually simple, but there are many details and technicalities involved in actually executing these ideas, and which I will try to suppress for sake of exposition.

Read the rest of this entry »

	Regis Serinko on What are some useful, but litt…
	nttoan81 on What are some useful, but litt…
	CK Chio on Why global regularity for Navi…
	Steve Lawford on What are some useful, but litt…
	thebirdreader on What are some useful, but litt…
	alessandro on What are some useful, but litt…
	porton on What are some useful, but litt…
	Keiji on PCMI lecture notes on random m…
	alessandro on What are some useful, but litt…
	NobodySaysTomato on What are some useful, but litt…
	Victor V. Albert on What are some useful, but litt…
	Handy Math Thingies… on What are some useful, but litt…
	Frank Morgan on What are some useful, but litt…
	thebirdreader on What are some useful, but litt…
	Paata Ivanisvili on What are some useful, but litt…

Tag Archive

Notes on the Bombieri asymptotic sieve

254A, Notes 4: Some sieve theory

A general parity problem obstruction

The parity problem obstruction for the binary Goldbach problem with bounded error

Heuristic limitations of the circle method

Open question: The parity problem in sieve theory

Recent Comments

Articles by others

Diversions

Mathematics

Selected articles

Software

The sciences

Top Posts

Archives

Categories

The Polymath Blog

For commenters