0809.4041/ms.tex
1: %&LaTeX
2: %\def\putfigure{1}       % 0 input figures in text for preprints and net
3: %
4: %\documentstyle[12pt,aaspp4]{article}
5: %\documentclass[11pt,preprint]{aastex}
6: %\documentclass[referee,epsfig]{mn2e}
7: \documentclass[usenatbib]{mn2e}
8: \usepackage{epsfig}
9: %\documentstyle[11pt,aaspp4,flushrt,epsfig]{article}
10: %\usepackage{natbib}
11: %
12: %\oddsidemargin=0pt
13: %\evensidemargin=0pt
14: %\voffset=-0.5truein
15: \textheight=9in
16: \voffset=-0.5in
17: %\hoffset=0.06in
18: %\textwidth=6.4in
19: %\textheight=9in
20: %
21: \def\gtwid{\mathrel{\raise.3ex\hbox{$>$\kern-.75em\lower1ex\hbox{$\sim$}}}}
22: \def\ltwid{\mathrel{\raise.3ex\hbox{$<$\kern-.75em\lower1ex\hbox{$\sim$}}}}
23: \def\\{\hfil\break}
24: \def\ie{{\it i.e.\ }}
25: \def\eg{{\it e.g.\ }}
26: \def\etal{{\it et al.\ }}
27: \newcommand{\degree}{{\rm o}}
28: %\newcommand{\apj}{ApJ}
29: %\newcommand{\mnras}{MNRAS}
30: %\newcommand{\aj}{AJ}
31: 
32: % The following hacked from AASTeX4.0
33: % should be compatible with Springer-Verlag A&A
34: %
35: \def\phn{\phantom{0}}       % Phantom numeral for aligning columns in tables
36: \def\phd{\phantom{.}}       % Phantom decimal for aligning columns in tables
37: \def\phs{\phantom{$-$}}     % Phantom minus sign for aligning columns in tables
38: \def\phm#1{\phantom{#1}}    % Generic \phantom command
39: \def\sun{\hbox{$\odot$}}
40: \def\earth{\hbox{$\oplus$}}
41: \def\lesssim{\mathrel{\hbox{\rlap{\hbox{\lower4pt\hbox{$\sim$}}}\hbox{$<$}}}}
42: \def\gtrsim{\mathrel{\hbox{\rlap{\hbox{\lower4pt\hbox{$\sim$}}}\hbox{$>$}}}}
43: \def\sq{\hbox{\rlap{$\sqcap$}$\sqcup$}}
44: \def\arcdeg{\hbox{$^\circ$}}
45: \def\arcmin{\hbox{$^\prime$}}
46: \def\arcsec{\hbox{$^{\prime\prime}$}}
47: \def\fd{\hbox{$.\!\!^{\rm d}$}}
48: \def\fh{\hbox{$.\!\!^{\rm h}$}}
49: \def\fm{\hbox{$.\!\!^{\rm m}$}}
50: \def\fs{\hbox{$.\!\!^{\rm s}$}}
51: \def\fdg{\hbox{$.\!\!^\circ$}}
52: \def\farcm{\hbox{$.\mkern-4mu^\prime$}}
53: \def\farcs{\hbox{$.\!\!^{\prime\prime}$}}
54: \def\fp{\hbox{$.\!\!^{\scriptscriptstyle\rm p}$}}
55: \def\micron{\hbox{$\mu$m}}
56: % math mode macros
57: %
58: % force math mode
59: \newcommand{\mamo}[1]{\mbox{$#1$}}
60: %
61: % units in math mode in roman font
62: \newcommand{\unit}[1]{\ifmmode \:\mbox{\rm #1}\else \mbox{#1}\fi}
63: %
64: % bold vector
65: \newcommand{\bfv}[1]{{\bmi #1}}
66: %
67: % subscripts in roman font
68: \newcommand{\sbr}[1]{_{\rm #1}}
69: %
70: % expectation value
71: \newcommand{\expec}[1]{\mamo{\left\langle #1 \right\rangle}}
72: \newcommand{\mone}{\mamo{^{-1}}}
73: \newcommand{\nth}[1]{\mamo{#1^{\small th}}}
74: \newcommand{\ten}[1]{\mamo{\times 10^{#1}}}
75: \newcommand{\dif}{\mbox{d}}
76: %
77: % Astro stuff
78: %
79: % some units
80: \newcommand{\km}{\unit{km}}
81: \newcommand{\kms}{\unit{km~s\mone}}
82: \newcommand{\kpc}{\unit{kpc}}
83: \newcommand{\mpc}{\unit{Mpc}}
84: \newcommand{\hkpc}{\mamo{h\mone}\kpc}
85: \newcommand{\hmpc}{\mamo{h\mone}\mpc}
86: \newcommand{\parsec}{\unit{pc}}
87: \newcommand{\chisq}{\mamo{\chi^2}}
88: %
89: \newcommand{\hr}{\mamo{^{\rm h}}}
90: \newcommand{\m}{\mamo{^{\rm m}}}
91: %
92: \newcommand{\lb}[2]{\mamo{l = #1\arcdeg}, \mamo{b = #2\arcdeg}}
93: \newcommand{\dlb}[4]{\mamo{l = #1\fdg#2}, \mamo{b = #3\fdg#4}}
94: \newcommand{\lberr}[4]{\mamo{l = #1\pm#2\arcdeg}, \mamo{b = #3\pm#4\arcdeg}}
95: \newcommand{\lbapr}[2]{\mamo{l \approx #1\arcdeg}, \mamo{b \approx #2\arcdeg}}
96: %
97: \newcommand{\rightascen}{\mbox{R.A.}}
98: \newcommand{\declin}{\mbox{Dec.}}
99: \newcommand{\radec}[2]{\mamo{\alpha = #1^{\rm h}}, \mamo{\delta = #2\arcdeg}}
100: \newcommand{\dradec}[4]{\mamo{\alpha = #1\fh#2}, \mamo{\delta = #2\fdg#4}}
101: %
102: \newcommand{\xyz}[3]{($#1$, $#2$, $#3$)}
103: %
104: % useful abbreviations
105: \newcommand{\wrt}{with respect to}
106: \newcommand{\ebv}{\mbox{$E(B-V)$}}
107: \renewcommand{\lg}{\mamo{\sb{LG}}}
108: \newcommand{\cmb}{\mamo{\sb{CMB}}}
109: \newcommand{\rhat}{\mamo{\hat{\bfv{r}}}}
110: %
111: \newcommand{\secref}[1]{Section~\ref{sec:#1}}
112: \newcommand{\brref}[1]{(equation~\ref{eq:#1})}
113: %\newcommand{\eqref}[1]{equation~(\ref{eq:#1})}
114: \newcommand{\Eqref}[1]{Equation~(\ref{eq:#1})}
115: \newcommand{\figref}[1]{Fig.~\ref{fig:#1}}
116: \newcommand{\tabref}[1]{Table~\ref{tab:#1}}
117: 
118: \newcommand{\bt}{\mamo{B/T}}
119: \newcommand{\br}{\mamo{B-R}}
120: \newcommand{\del}{\mbox{d}}
121: 
122: \newcommand{\aap}{A\&A}
123: \newcommand{\apj}{ApJ}
124: \newcommand{\apjl}{ApJL}
125: \newcommand{\apjs}{ApJ Supp}
126: \newcommand{\aj}{AJ}
127: \newcommand{\mnras}{MNRAS}
128: \newcommand{\pasp}{PASP}
129: \newcommand{\prd}{Phys Rev D}
130: \newcommand{\nat}{Nature}
131: 
132: \newcommand{\Om}{\mamo{\Omega\sbr{m}}}
133: 
134: %\input{journalabbrev}
135: 
136: \begin{document}
137: 
138: \title[Large Cosmic Flows on Scales of 100\hmpc]
139: {Consistently Large Cosmic Flows on Scales of 100\hmpc: a Challenge for the Standard $\Lambda$CDM Cosmology}
140: \vskip 0.5cm
141: \author[Watkins, Feldman \& Hudson]{Richard Watkins$^{\dagger,1}$, Hume A. Feldman$^{\star,2}$ \& Michael J. Hudson$^{\ddagger,3}$\\
142: $^\dagger$Department of Physics, Willamette University, Salem, OR 97301, USA.\\
143: $^\star$Department of Physics \& Astronomy, University of Kansas, Lawrence, KS 66045, USA.\\
144: $^\ddagger$Department of Physics and Astronomy, University of Waterloo, Waterloo, ON N2L 3G1, Canada.\\
145: emails: $^1$rwatkins@willamette.edu;\, $^2$feldman@ku.edu;\, $^3$mjhudson@uwaterloo.ca}
146: 
147: \maketitle
148: 
149: \begin{abstract}
150: 
151: The bulk flow, \ie the dipole moment of the peculiar velocity field, is a sensitive probe of matter density fluctuations on very large scales.   However, the peculiar velocity surveys for which the bulk flow has been calculated have non-uniform spatial distributions of tracers, so that the bulk flow estimated does not correspond to that of a simple volume such as a sphere.  Thus bulk flow estimates are generally not strictly comparable between surveys, even those whose effective depths are similar.   In addition, the sparseness of typical surveys can lead to aliasing of small scale power into what is meant to be a probe of the largest scales.   Here we introduce a new method of calculating bulk flow moments where velocities are weighted to give an optimal estimate of the bulk flow of an idealized survey, with the variance of the difference between the estimate and the actual flow being minimized.    These ``minimum variance'' estimates can be designed to estimate the bulk flow on a particular scale with minimal sensitivity to small scale power, and are comparable between surveys.   
152: We compile all major peculiar velocity surveys and apply this new method to them.  We find that most surveys we studied are highly consistent with each other. Taken together the data suggest that the bulk flow within a Gaussian window of radius 50 \hmpc\ is $407\pm81$ \kms\ toward  \lb{287\arcdeg\pm9}{8\arcdeg\pm6}.  The large-scale bulk motion is consistent with predictions from the local density field. This indicates that there are significant density fluctuations on very large scales.  A flow of this amplitude on such a large scale is not expected in the WMAP5-normalized $\Lambda$CDM cosmology, for which the predicted one-dimensional r.m.s.\ velocity is $\sim 110$ \kms. The large amplitude of the observed bulk flow favors the upper values of the WMAP5 $\Om h^2$-$\sigma_8$ error-ellipse, but even the point at the top of the WMAP5 95\% confidence ellipse predicts a bulk flow which is too low compared to that observed at $>98$\% confidence level.
153: \end{abstract}
154: 
155: \noindent{\it Subject headings}: cosmology: distance scales -- cosmology: large scale structure of the universe -- cosmology: observation -- cosmology: theory -- galaxies: kinematics and dynamics -- galaxies: statistics
156: 
157: \section{Introduction}
158: \label{sec:intro}
159: 
160: A long-standing question in cosmography is the origin of the $\sim 600$ km/s peculiar velocity of the Local Group (LG) with respect to the Cosmic Microwave Background (CMB).  The motion of the LG with respect to the ``Local Sheet'' in which it is embedded is only $\sim 60$ km/s \citep{TulShaKar08}, thus most of the LG's motion is due to structures on scales larger than the Local Sheet, i.e.\ beyond  5 \hmpc\ (where $h$ is the Hubble constant in units of 100 km s$^{-1}$ Mpc$^{-1}$). In the gravitational instability paradigm \citep{FelFriFry01,ScoFelFri01,VerHeaPer02},
161: this motion is due to the gravity of structures on larger scales. For a galaxy at position {\bf{r}}, the peculiar velocity {\bf{v}} is given by \citep{PPC}
162: \begin{equation}
163: {\bf{v}}\left( {\bf{r}} \right) =
164: \frac{\Omega\sbr{m}^{0.55}}{4\pi }\int d^3 {\bf{r}}^{\prime
165: } \delta\sbr{m}\left( \mathbf{r}^{\prime }\right) \frac{\left( \mathbf{r}^{\prime
166: }-\mathbf{r}\right) }{\left| \mathbf{r}^{\prime }-\mathbf{r}\right| ^3}.
167: \label{eq:peculiar}
168: \end{equation}
169: where $\delta\sbr{m} \left( \mathbf{r}\right) = ({\rho
170:   -\overline{\rho}})/{\overline{\rho}}$, and $\overline{\rho}$ is the average density of the Universe,  $\Om$ is the matter density parameter, and we have used 0.55 instead of 0.6 for the power of $\Omega_m$ in the pre-factor to improve accuracy for models with dark energy \citep{Lin05}. 
171: 
172: The issue of the LG's motion and that of other nearby galaxies has important cosmological and cosmographical implications. Specifically, as shown by Eq. \ref{eq:peculiar}, the peculiar velocities of individual galaxies are sensitive to the matter power spectrum over a wide range of scales. Indeed, apart from the Integrated Sachs-Wolfe (ISW) effect \citep{SacWol67}, peculiar velocities are the only probe of the matter density fluctuations on scales of $\sim 100 \hmpc$ and clearly the only dynamical probe in the low-redshift universe. A given power spectrum predicts the r.m.s.\ of the components of a galaxy's peculiar motion. For models with more power, i.e. a higher normalization, one predicts a larger r.m.s.\ velocity. 
173: 
174: For a single galaxy, the contributions to its motion arise from a range of scales: from the local ($\sim$ 5 \hmpc) to the very large ($\ga 100 \hmpc$) scales. One may reduce the effects of small scale density fluctuations by studying the peculiar velocity of a larger volume using a sample of peculiar velocity tracers such as galaxies, clusters, or Type Ia supernovae. Beginning with the work of \cite{RubRobTho76}, a number of such surveys have been undertaken over the last couple of decades 
175: \citep{
176: DreFabBur87,
177: LynFabBur88,
178: AarBotCor89,
179: Wil90,
180: Cou92,
181: HanMou92,
182: MatForBuc92b,
183: LauPos94,
184: HudLucSmi97,
185: WilCouFab97,
186: GioHayFre98,
187: HudSmiLuc99,
188: DalGioHay99,
189: DalGioHay99b,
190: Wil99b,
191: CouWilStr00,
192: ColSagBur01,
193: HudSmiLuc04,
194: HauHanTho06,
195: SprMasHay08}.  
196: 
197: The simplest statistic that can be derived from a sample of peculiar velocities is the dipole moment of the sample, also known as its bulk flow. It was quickly realized that the bulk flow was closely related to the amplitude of fluctuations on large scales, and could be used to test cosmological models \citep{CluPee81, VitJusDav86}. At face value, however, the surveys cited above yield apparently conflicting results: the measured bulk flow ranges from 0 to $\sim 1000$ km/s.  Note, however, that many of the above-mentioned surveys are sparsely-sampled, and that while authors quote the bulk flow of the sample, this sample bulk flow is often mis-interpreted as the coherent bulk flow of the whole volume occupied by the survey. 
198: 
199: The issue of sparse sampling, small-scale aliasing and their effects on statistics such as the bulk flow were first analyzed by \cite{Kai88}, and later \citet{WatFel95} and others \citep{pairwise00,Hud03,pairwise03,SarFelWat07,WatFel07,FelWat08}. These studies addressed the issue of comparing sparse surveys both to each other (to check for consistency between different sparse surveys) and the comparison of sparse peculiar velocity samples with expectations from cosmological models. One lesson from this work is that both sparse sampling and aliasing present an important effect that must be accounted for in interpreting the results, particularly those from sparse surveys such as clusters or SNe. 
200: 
201: Bulk flow estimates are essentially weighted averages of the individual velocities in a survey.   Previous work has focused on a weighting scheme that produces a maximum likelihood estimate (MLE) of the bulk flow of a survey, an estimate that minimizes the uncertainties due to measurement noise but does not make any correction for the survey geometry .  Thus the MLE bulk flow is obviously dependent on a given survey's particular geometry and statistical properties.  In this paper, we instead address the question of how peculiar velocity data can be used to estimate a more general statistic: the bulk flow of an ideal, densely-sampled survey with a given depth.   Our approach will be to calculate \emph{optimal} weights which produce the best possible estimate of this statistic.  An approach related to this question is that of Zaroubi and collaborators, who used Wiener filtering \citep{ZarHofDek99} and variants \citep{Zar02} to reconstruct the matter density field directly from peculiar velocities.  That work, however, was focussed more on the mapping of the density field and the measurement of $\beta = f(\Om)/b$,  where $b$ is the bias parameter, than on the bulk flow \cite[but see][]{HofEldZar01}. In this paper, our aim is somewhat different: to construct dipole moments that probe the largest scales.
202: 
203: The goal of this paper is to make the cleanest measurement of the large-scale bulk flow using the best peculiar velocity data available. We discuss the peculiar velocity surveys used in this analysis in Section~\ref{sec:surveys}.  In Section~\ref{sec:mom},  we describe the construction of the velocity moments,  the power spectrum model,  and the optimal weighting scheme used to estimate bulk flow components free of small scale noise. In  Section~\ref{sec:res} we apply these optimal weights to the data. In Section~\ref{sec:consist}, we assess whether the optimally-weighted bulk flow results from different surveys are mutually consistent. In Section~\ref{sec:implic}, we discuss the cosmographic implications of our results. In Section~\ref{sec:compare}, we compare the measured bulk flow with expectations from cosmological models. We discuss our resuts in Section~\ref{sec:discuss} and conclude in Section~\ref{sec:conc}. 
204: 
205: \section{Data}
206: \label{sec:surveys}
207: 
208: Here we analyze all of the recent peculiar velocity surveys. The datasets occasionally have outliers, and so it is necessary to remove them. Simply removing outliers with large CMB velocities might bias the resulting flow. Instead, we use predictions from the IRAS-PSCz density field to identify outliers, according to the following procedure. First, we compare the observed peculiar velocity with the predicted peculiar velocity from \cite{HudSmiLuc04}, adopting the parameters of the B05 ($\beta = 0.5$) flow model used by \cite{NeiHudCon07}. This model allows for a small external bulk flow arising from large scales, but provides a better predicted peculiar velocity within the PSCz volume, \ie within a distance of 200 \hmpc. Peculiar velocities that deviate by more than 3.5 $\sigma$ are rejected, where the uncertainty includes the distance error and a thermal component of 150 \kms.   For each sample, we also quote a characteristic depth defined as the mean weighted distance, where the weight is the inverse square of the peculiar velocity error. 
209: 
210: The final samples are as follows, listed in order of characteristic depth from nearest to most distant.
211: 
212: \begin{itemize}
213: 
214: \item SBF: the surface brightness fluctuation survey of \cite{TonDreBla01}. We use the distances from their Table 1, except where SBF galaxies are identified as group members, in which case we use the group peculiar velocities (their Table 4).  After rejection of the outliers N4616, N4709 and ESO 323-034, there are 69 field and 23 groups, with a characteristic depth of  17 \hmpc.
215: 
216: \item ENEAR: a survey of Fundamental Plane (FP) distances to nearby early-type galaxies \citep{daCBerAlo00, BerAlodaC02b, WegBerWil03} . After the exclusion of 4 outliers, there are distances to 698 field galaxies or groups (Bernardi, priv. comm). For single galaxies, the typical distance error is $\sim 20\%$. The characteristic depth of the sample is 29 \hmpc. Note that unlike other samples considered here, these data are not corrected for inhomogeneous Malmquist bias \citep{Hud94}.
217: 
218: \item SN are 103 Type Ia supernovae distances from the compilation of \cite{TonSchBar03}, limited to a distance of 150 \hmpc. SN distances are typically precise to 8\%. The characteristic depth of the survey is 32 \hmpc.
219: 
220: \item SFI++  \citep{SprMasHay08}, based on the Tully-Fisher (TF) relation, is the largest and densest peculiar velocity survey considered here. After rejection of 38 (1.4\%) field and 10 (1.3\%) group outliers, our sample consist of 2675 field galaxies and 726 groups. For some analyses, we split this large sample into a field (SFI++$_F$) and group (SFI++$_G$) subsamples. The characteristic depth of SFI++ is 34 \hmpc.
221: 
222: \item SC \citep{GioHaySal98, DalGioHay99} is a TF-based survey of spiral galaxies in 70 clusters within 200 \hmpc. The characteristic depth of the combined sample is 57 \hmpc. 
223: 
224: \item SMAC \citep{HudSmiLuc99, HudSmiLuc04} is an all-sky  Fundamental Plane (FP) survey of 56 clusters. The characteristic depth of the survey is 65 \hmpc.
225: 
226: \item LP \citep{LauPos94,PosLau95} is a survey based on using brightest cluster galaxies as distance indicators. The survey consists of BCGs in 119 Abell clusters across the whole sky within a distance of 150 \hmpc. Here we obtain peculiar velocities using the methodology, but not the X-ray correction, of \cite{HudEbe97}, which makes a small correction to the error estimates of LP. The typical error per measurement is 19\% and the characteristic depth of the survey is 84 \hmpc.
227: 
228: \item EFAR \citep{ColSagBur01} is a survey of 85 clusters and groups, based on the FP distance indicator. The EFAR survey was not intended to measure the dipole moment, but rather to examine peculiar velocities in two superclusters:  Hercules-Corona Borealis and Perseus-Pisces-Cetus at a distance of $\sim 120$ \hmpc. As a result of this strategy, the coverage is far from all-sky.  The characteristic depth is 93 \hmpc.
229: 
230: \item \cite{Wil99b} is a Tully-Fisher based survey of 15 clusters with a characteristic depth of 111 \hmpc.
231: 
232: \end{itemize}
233: 
234: In addition to treating each of the above surveys independently, it is also interesting to combine them into supersets. The distance range spanned by the surveys is rather heterogeneous, however. Essentially the surveys fall into two categories: dense, relatively shallow surveys of nearby field galaxies or small groups (SBF, ENEAR, SFI++) and sparser but deeper surveys of clusters (EFAR, SC, SMAC, Willick).   The SN sample straddles a range of depths, but is rather sparse, so we associate it with the latter category. However, the large numbers of objects in SFI++ dominate all samples, hence our superset labelled SHALLOW consists of SBF and ENEAR only, and we combine SFI field and group samples separately into a second shallow set labelled SFI++. The DEEP sample includes all other surveys, except for LP (see Section~\ref{sec:consist}). 
235: 
236: Finally, we also combine all surveys (except for LP) into a master catalogue labelled ``COMPOSITE''. The COMPOSITE catalogue has a characteristic depth of 33 \hmpc\ and is based on 4481 peculiar velocity measurements, making it the largest peculiar velocity catalogue studied to date.
237: 
238: \section{Velocity Moments}
239: \label{sec:mom}
240: 
241: The statistics of individually measured galaxy or cluster peculiar velocities $S_n$ are not described well by linear theory due to the existence of nonlinear flows on small scales.     This problem is typically solved by forming moments as linear combinations of peculiar velocities,  $u_a = \sum_n w_{a,n}S_n$, where $w_{a,n}$ are a set of weights that specify the composition of the $a$th moment.  For a proper choice of weights,  and for a peculiar velocity survey that densely occupies a large volume of space, moments can be formed that are relatively insensitive to small scale motions and thus can be treated by linear theory;  small scale motions are essentially averaged out in the summation.
242: 
243: By far the most common moments used in the analysis of peculiar velocity surveys are the three components of the bulk flow vector.    The bulk flow represents the net motion of the survey volume as a whole as traced by the galaxies occupying it.    For an idealized survey, consisting of positions ${\bf r}_n$ and exact line-of-sight velocities $v_n$ for a set of $N$ galaxies or clusters, the bulk flow vector components $U_i$ are just averages over the projections of the radial velocities onto the three coordinate axis directions, so that the weights for $U_i$ are 
244: \begin{equation}
245: w_{i,n} =  {\bf \hat x}_i\cdot{\bf \hat r}_n/N.   
246: \label{eq:idw}
247: \end{equation}
248: 
249: For a more realistic survey, the measured line-of-sight velocity is assumed to have the form $S_n = v_n + \delta_n$, where $\delta_n$ is a drawn from a Gaussian distribution with variance $\sigma_n^2 + \sigma_*^2$.   Here $\sigma_n$ is the measurement error of the $n$th galaxy in the survey and $\sigma_*$ is the velocity noise, which accounts for smaller-scale flows not included in our model.    \cite{Kai88} has shown that the weights for the maximum likelihood estimate for the bulk flow components, which we will refer to as the MLE weights,  are
250: \begin{equation}
251: w_{i,n} = A_{ij}^{-1} \sum_m{{\bf \hat x}_j\cdot{\bf \hat r}_n\over  \sigma_n^2+\sigma_*^2},
252: \end{equation}
253: where
254: \begin{equation}
255: A_{ij} = \sum_m {({\bf \hat x}_i\cdot{\bf \hat r}_m)({\bf \hat x}_j\cdot{\bf \hat r}_m)   \over  \sigma_m^2+\sigma_*^2}.
256: \end{equation}
257: 
258: The statistics for velocity moments can be obtained directly from the formulae for individual velocities obtained from linear theory.  For example, the covariance matrix for a set of moments $u_a$ formed from the velocities $S_n$ of a survey is given by
259: \begin{eqnarray}
260: \langle u_au_b\rangle &=& \langle \left(\sum_n w_{a,n}S_n\right)\left(\sum_m w_{b,m}S_m\right)\rangle \nonumber\\
261: &=& \sum_{n,m} w_{a,n} w_{b,m}\langle S_nS_m\rangle\nonumber\\
262: &=& \sum_{n,m}w_{a,n} w_{b,m} G_{nm}.
263: \label{eq:cov}
264: \end{eqnarray}
265: 
266: The covariance matrix for the individual measured velocities $G_{nm}=\langle S_nS_m\rangle$ can be written in terms of the velocity field ${\bf v}(\bf{r})$ as
267: \begin{eqnarray}
268: G_{nm} &=& \langle v_n v_m\rangle
269: + \delta_{nm}(\sigma_*^2 + \sigma_n^2)\nonumber\\
270: &=&\langle {\bf \hat r}_n\cdot {\bf v}({\bf r}_n)\ \   {\bf\hat r}_m\cdot {\bf v}({\bf r}_m)\rangle
271: + \delta_{nm}(\sigma_*^2 + \sigma_n^2).
272: \label{eq:galv}
273: \end{eqnarray}
274: In linear theory the first term can be expressed as an integral over the density power spectrum $P(k)$, 
275: \begin{equation}
276: \langle {\bf \hat r}_n\cdot {\bf v}({\bf r}_n)\ \   {\bf\hat r}_m\cdot {\bf v}({\bf r}_m)\rangle
277: =  {\Omega_{m}^{1.1}\over 2\pi^2}\int   dk\  P(k)f_{mn}(k),
278: \label{eq:vcov}
279: \end{equation}
280: where the function $f_{mn}(k)$ is the angle averaged window function 
281:  \begin{eqnarray}
282:  f_{mn}(k) = \int &&{d^2{\hat k}\over 4\pi} \left( {\bf \hat r}_n\cdot {\bf \hat k} \right)\left( {\bf \hat r}_m\cdot {\bf \hat k} \right) \nonumber\\
283:  &&\times  \exp \left(ik{\bf \hat k}\cdot ({\bf r}_n - {\bf r}_m)\right).
284: \end{eqnarray}
285: 
286: Plugging Eq. (\ref{eq:galv}) into Eq. (\ref{eq:cov}) and using equation (\ref{eq:vcov}),  the covariance matrix of the moments reduces to two terms,
287:  \begin{equation}
288:  R_{ab} = R^{(v)}_{ab} +  R^{(\epsilon)}_{ab} .
289: \label{eq:rab}
290:  \end{equation}
291:  The second term, called the ``noise" term, is given by
292:  \begin{equation}
293:  R^{(\epsilon)}_{ab}  = \sum_{n} w_{a,n}w_{b,n}\left( \sigma_n^2 + \sigma_*^2\right).
294:   \end{equation}
295:  The  first term is given as an integral over the matter fluctuation power spectrum, $P(k)$, 
296:  \begin{equation} 
297:  R^{(v)}_{ab}  = {\Omega_{m}^{1.1}\over 2\pi^2}\int_0^\infty
298:  dk \ \  {\cal W}^2_{ab}(k)P(k),
299:  \label{eq:covv}
300:  \end{equation}
301:  where the angle-averaged tensor window function is 
302:  \begin{eqnarray}
303:  {\cal W}^2_{ab} (k)= \sum_{n,m} w_{a,n} w_{b,m}&\int& {d^2{\hat k}\over 4\pi}\ \left({\bf \hat r}_n\cdot {\bf \hat k}\ \ {\bf \hat r}_m\cdot {\bf \hat k}\right)\nonumber\\
304:  &&\times \exp\left(i{\bf k}\cdot ({\bf r}_n- {\bf r}_m)\right).\nonumber\\
305: \label{eq:win}
306: \end{eqnarray}
307: 
308: For the case $a=b$, Eq. (\ref{eq:win}) gives the angle-averaged window function for the moment $u_a$.    This window function tells us which scales contribute to the value of the moment.   For moments that are measures of a component of the bulk flow,  the window function should have the value of $1/3$ at $k=0$.   This ensures that if the flow in the survey volume were uniform, \ie all the power was at $k\sim 0$, the variance of the moment would correctly be $1/3$ of the flow variance.  Ideally, the window function for any useful moment should have a small amplitude at values of $k$ corresponding to nonlinear scales; thus moments that measure the bulk flow components tend to have a peak at $k=0$ with the amplitude falling toward a plateau as $k$ increases.
309: 
310: For the MLE weights, the bulk flow moment window functions are determined by the spatial distribution of objects as well as their associated velocity uncertainties.   Given the fact that most surveys have relatively more objects at smaller distance, and that the measurement uncertainty increases rapidly with distance,  the window functions found using the MLE weights tend to have broader peaks then one might naively expect given the depth of the survey, leading to bulk flow moments that are sensitive to motions on somewhat smaller scales than the diameter of the survey.   
311: 
312: Since our goal here is to study motions on the largest scales possible, we require bulk flow moments whose window functions have as narrow a peak as possible, also being small in amplitude outside the peak.     Given that the moments found using the MLE weights for a typical survey do not generally meet these criteria, we have formulated a new method for calculating weights for moments that essentially allow us to ``design" the moment's window function, subject, of course, to the distribution and uncertainties of the data that is available.    
313: 
314: We begin by considering an idealized survey whose bulk flow components  $U_i$ have the desired window function.   Here we will use an ideal survey which consists of a very large number of objects isotropically  distributed with a Gaussian falloff in density,  $n(r) \propto \exp(-r^2/2R_I^2)$, where $R_I$ specifies the depth of the survey whose velocity is measured exactly.    For this survey, Eq.  (\ref{eq:idw}) gives the weights for the bulk flow components, which will all have the same window function due to isotropy.     
315: Now, suppose that we have a galaxy or cluster survey consisting of positions ${\bf r}_n$ and measured line-of-sight velocities $S_i$ with associated measurement errors $\sigma_n$.   We would like to find the weights $w_{i,n}$ that specify the three moments $u_i = \sum_n w_{i,n}S_n$ that minimize the average variance, $\langle (u_i-U_i)^2\rangle$.    We will call these the minimum variance, or MV weights.  The MV moments $u_i$ calculated from these weights will then be the best estimate of the bulk flow of the ideal survey, if it were to exist, that can be obtained from the available data.     We also expect that, within limits that will be described more fully below, the window functions of the $u_i$ will match those of the ideal survey.
316: 
317: In order to calculate the weights $w_{i,n}$, we first expand out the variance in terms of the weights,
318: \begin{eqnarray}
319: \langle (u_i-U_i)^2\rangle &=& \sum_{n,m} w_{i,n}w_{i,m}\langle S_nS_m\rangle + \langle U_i^2\rangle \nonumber\\
320: &&- 2\sum_n w_{i,n}\langle  U_iv_n\rangle ,
321: \label{eq:variance}
322: \end{eqnarray}
323: where we have used the fact that the measurement error included in $S_n$ is uncorrelated with the bulk flow $U_i$.   
324: 
325: The next step would be to minimize this expression with respect to $w_{i,n}$; however, as discussed above in order to be a proper measure of the bulk flow, the window function of a moment must go to $1/3$ as $k\rightarrow 0$.     From Eq. (\ref{eq:win}), we see that this requires the constraint 
326: \begin{equation}
327:  \lim_{k\to 0} {\cal W}^2_{ii} (k)=   \sum_{n,m} w_{i,n} w_{i,m} P_{nm}=1/3,
328: \label{eq:con}
329: \end{equation}
330: where 
331: \begin{equation}
332: P_{nm} = \int {d^2{\hat k}\over 4\pi}\ \left({\bf \hat r}_n\cdot {\bf \hat k}\ \ {\bf \hat r}_m\cdot {\bf \hat k}\right).
333: \label{eq:pdef}
334: \end{equation}
335: We enforce this constraint using the Lagrange multiplier method; thus the quantity to be minimized with respect to $w_{i,n}$ becomes
336: \begin{eqnarray}
337: &\sum_{n,m}& w_{i,n}w_{i,m}\langle S_nS_m\rangle + \langle U_i^2\rangle - 2\sum_n w_{i,n}\langle u_i U_i\rangle \nonumber\\
338: && + \lambda \left(\sum_{n,m} P_{nm}w_{i,n}w_{i,m} - 1/3\right).
339: \end{eqnarray}
340: 
341: Taking the derivative with respect to $w_{i,n}$ and setting it equal to zero gives
342: \begin{equation}
343: \sum_m \left(\langle S_nS_m\rangle+\lambda P_{nm}\right)w_{i,m}  = \langle S_nU_i\rangle,
344: \end{equation}
345: which can be written in matrix form as 
346: \begin{equation}
347:  \left({\bf G}+\lambda {\bf P}\right){\bf w_i} = {\bf Q_i},
348: \end{equation}
349: where ${\bf G}_{nm} = \langle S_nS_m\rangle$ is the individual velocity covariance matrix, the components of ${\bf Q}_i$ are ${\bf Q}_{i,n} = \langle U_iv_n\rangle$, and ${\bf w_i}$ is the $N$-dimensional vector of weights specifying the $i$th moment.   This is easily solved to give
350: \begin{equation}
351: {\bf w_i} =  ({\bf G}+\lambda {\bf P})^{-1}{\bf Q_i}.
352: \end{equation}
353: This equation, together with the constraint given in Eq. (\ref{eq:con}), allows us to solve for the weights in terms of the covariance matrix ${\bf G}$, the matrix ${\bf P}$ given in Eq. (\ref{eq:pdef}), and the $n$-dimensional vector ${\bf Q_i}$.   Note that the MV weights can be positive or negative.  If the ideal survey consists of $N^\prime$ exact velocities $v_{n^\prime}$ measured at positions ${\bf r}^\prime_{n^\prime}$, then the elements of ${\bf Q_i}$ can be written as
354: \begin{equation}
355: {\bf Q}_{i,n} = \langle U_iv_n\rangle 
356: = \sum_{n^\prime=1}^{N^\prime}  w^\prime_{i,n^\prime}\langle v_{n^\prime} v_n\rangle ,
357: \end{equation}
358: where $w^\prime_{i,n^\prime} = {\bf \hat x}_i\cdot{\bf r}_{n^\prime}^\prime/N^\prime$ as discussed above.  The quantity $\langle v_{n^\prime} v_n\rangle$ can be calculated from Eq. (\ref{eq:vcov}) in terms of the positions ${\bf r}^\prime_{n^\prime}$ and ${\bf r}_n$.    In practice, we calculate 
359: ${\bf Q}_{i,n}$ by constructing a simulated ideal survey where positions ${\bf r}^\prime_{n^\prime}$ are selected at random to be isotropic and to have the density $n(r) \propto \exp(-r^2/2R_I^2)$.   For the purposes of this study we have found that $N^\prime = 10^4$ points are sufficient 
360: for convergence of all relevant quantities.
361: 
362: Note that the weights depend on the spectrum of matter fluctuations, (see Eq.~(\ref{eq:vcov})).   Here we use the power spectrum model given by  \cite{EisHu98}, which explicitly includes the effect of baryons.   In this parametrization, $P(k)\propto k^{n_s}T^2(k)$, where $n_s$ is the spectral index and the transfer function $T(k)$ depends on the parameters $h$, $\Omega_m$, $\Omega_b$, the baryon density parameter, and $\sigma_8$, the amplitude of matter density perturbations on the scale of $8\ h^{-1}$Mpc. 
363: 
364: \section{Results: The MV weights, window functions and moments}
365: \label{sec:res}
366: The minimum variance (MV) weights were calculated for the bulk flow component moments using the method described above for each of our catalogues.  Here we will show results for two different ideal survey radii, a relatively shallow survey, $R_I= 20\ h^{-1}$Mpc, and a deep survey, $R_I= 50\ h^{-1}$Mpc. For calculating the weights, we assume the WMAP5 \cite{DunKomNol08} central parameters $\Omega_m=0.258$, $\Omega_b = 0.0441$, $\sigma_8 = 0.796$, $h = 0.719$, and the spectral index $n_s = 0.963$, together with $\sigma_*=150.0$ km/s.   We note that, for all but the sparsest surveys we consider, the values of the weights are insensitive to the specific power spectrum parameters used.
367: 
368: One qualitative way to gauge how a moment constructed in this way matches its ideal counterpart is to compare the window functions as calculated using Eq.~(\ref{eq:win}).    Generally, the larger and more geometrically similar a survey is to the ideal distribution, the better the match will be.   For small surveys and/or those that have a very different spatial distribution than the ideal distribution the match can be quite poor.   Measurement errors also play a large role in determining how good a match is obtained.   Since the quantity $\langle (u_i-U_i)^2\rangle$ that is being minimized includes the noise term $\langle u_i^2\rangle$, the optimal weighting scheme is a compromise between the need to have the moment's window function match the ideal window function and the need to keep the noise small by giving small weights to objects with large measurement errors.
369:    
370: In Figures~\ref{fig:win20-1} -- \ref{fig:win50-2} we show the window functions of the MV bulk flow component moments.   For comparison, we also include the ideal window functions as well as those for the MLE moments for each survey.     As expected, the match between the window functions for the MV moments and the ideal is best for the large surveys and those with small measurement error and similar distribution to the ideal survey.   For the sparse, noisy surveys, the window functions for the MV moments are not very different than those of the MLE moments, differing mostly in the amplitude of the tail of the window function for large $k$.    There are some exceptions: for example, for the $R_I = 50 \hmpc$ case, the SFI++$_G$ and SHALLOW catalogue MV weights approximate a $R \sim20 \hmpc$ Gaussian rather than the desired $R_I = 50 \hmpc$ Gaussian. The COMPOSITE catalogue window function is an excellent match on both 20 and 50 \hmpc\ scales.
371: 
372: There are several ways to quantify how well the moments constructed in this way should agree with their ideal counterparts.   First, from Eq.~(\ref{eq:variance}) we can calculate $\sqrt{ \langle (u_i-U_i)^2\rangle}$.   An alternative measure is to define the correlation coefficient $ {\langle u_i\cdot U_i\rangle/ |u_i||U_i|}$.   A value close to 1 indicates that the moment is an accurate measurement of the bulk flow of the idealized volume.   While both of these measures depend on an assumed power spectrum model, the correlation has the advantage of being dependent only on the shape of the power spectrum and not on its amplitude.   The correlations between the MV moments and the ideal moments given in Table~\ref{tab:bfm} quantify how well they are expected to agree, accounting for both agreement between their window functions and measurement error.    From this table it is clear that while our method works well for surveys which are large or have small errors, the moments it calculates for sparse, deep surveys that have large errors are not strongly correlated with the ideal moments that they are designed to measure.   However, including these surveys in the composite catalogues does improve their correlations, particularly for the case of $R_I=50\ h^{-1}$Mpc.   In particular, the DEEP catalogue does have a strong expected correlation (0.80) with the ideal survey with $R_I=50\ h^{-1}$Mpc, even though each of its component surveys does not. As noted above, the correlation (0.91) of the COMPOSITE survey with the ideal survey $R_I = 50 \hmpc$ is excellent, and the uncertainty due to the mismatch between ideal survey and actual weighted sampling is very small ($\sim 20-30 \kms$).
373: 
374: \begin{figure*}
375:      \includegraphics[width= \textwidth]{winallb-20-1-4.eps}
376:         \caption{The window functions of the bulk flow component for $R_I=20$\hmpc\  for all of the catalogues we considered. The thick (thin) lines are the window functions for the MV (MLE) bulk flow components. The x,y,z--component are dash-dot, short dash, long dash lines respectively. The thick solid line is the ideal window function (since the ideal survey is isotropic, all component are the same).}
377:     \label{fig:win20-1}
378: \end{figure*}
379: 
380: \begin{figure*}
381:      \includegraphics[width= \textwidth]{winallb-20-2-4.eps}
382:         \caption{The same as Fig.~\ref{fig:win20-1} for composite surveys}
383:     \label{fig:win20-2}
384: \end{figure*}
385: 
386: \begin{figure*}
387:      \includegraphics[width= \textwidth]{winallb-50-1-4.eps}
388:         \caption{The same as Fig.~\ref{fig:win20-1} for $R_I=50$\hmpc.}
389:     \label{fig:win50-1}
390: \end{figure*}
391: 
392: \begin{figure*}
393:      \includegraphics[width= \textwidth]{winallb-50-2-4.eps}
394:         \caption{The same as Fig.~\ref{fig:win20-2} for $R_I=50$\hmpc.}
395:     \label{fig:win50-2}
396: \end{figure*}
397: 
398: In Table~\ref{tab:bfm} we also show the magnitude of the MV moments, the expected deviation from the ideal moment, $\sqrt{\langle (u_i-U_i)^2\rangle}$, given our power spectrum model.   We also include the measurement noise in parenthesis to show how much of the deviation from the ideal moment is due to measurement noise and how much is due to differences in how the moments probe the window function.    In Table~\ref{tab:bfv} we show the Cartesian components of the MLE moments together with the MV moments for both $R_I=20h^{-1}$Mpc and $R_I=50h^{-1}$Mpc.  The Cartesian components as a function of the Gaussian window $R_I$ for the composite surveys are also shown in Figure \ref{fig:surveybulk}.   The first thing to note from Tables~\ref{tab:bfm} and \ref{tab:bfv} and Figure \ref{fig:surveybulk} is the remarkable consistency between the catalogues as to the value for the bulk flow components.    This consistency will be explored in more detail below.   
399: 
400: \begin{table*}
401: \caption{Bulk flow amplitudes $|u|$ for the MLE-weighted case and for two choices of $R_I$ for the MV weights.  For the MV moments, the error in parenthesis is the noise error only. The quoted error includes both noise and the difference from the idealized survey geometry.  Also shown are the correlation coefficients $\langle\frac{{\bf u}\cdot {\bf U}}{|{\bf u}||{\bf U}|}\rangle$ between ideal moments and their MLE estimates, where 1 indicates a perfect correlation.}
402: \begin{tabular}{lccccc}  
403: \hline \hline
404:           & MLE weighted bulk flow &  \multicolumn{4}{c}{MV weighted bulk flow}     \\
405:           &    &  \multicolumn{2}{c}{$R_I=20$\hmpc} & \multicolumn{2}{c}{$R_I=50$\hmpc}     \\
406: Survey    &  $ |u|$      &$\langle\frac{{\bf u}\cdot {\bf U}}{|{\bf u}||{\bf U}|}\rangle$   &   $|u|$   &$  \langle \frac{{\bf u}\cdot {\bf U}}{|{\bf u}||{\bf U}|}\rangle$   &   $|u|$ \\
407:           &  km/s        &  & km/s & & km/s \\ \hline \hline
408:          SBF &   382 $\pm$   82&    0.859 &   360 $\pm$   177 (  103)  &    0.377 &   419 $\pm$   316 (  111)  \\ \hline
409:            ENEAR &   336 $\pm$   55&    0.946 &   207 $\pm$    89 (   73)  &    0.735 &   205 $\pm$   169 (  112)  \\ \hline
410:          SHALLOW &   340 $\pm$   48&    0.953 &   180 $\pm$    83 (   66)  &    0.735 &   195 $\pm$   169 (  111)  \\ \hline
411: \multicolumn{6}{c}{ }  \\ 
412:               LP &   833 $\pm$  408&    0.188 &  1287 $\pm$   438 (  353)  &    0.259 &  1299 $\pm$   392 (  355)  \\ \hline
413:  \multicolumn{6}{c}{ }  \\ 
414:         Willick &  1019 $\pm$  542&    0.013 &    41 $\pm$   609 (  505)  &    0.125 &    76 $\pm$   557 (  505)  \\ \hline
415:             EFAR &   736 $\pm$  441&    0.099 &   361 $\pm$   410 (  269)  &    0.264 &   375 $\pm$   337 (  268)  \\ \hline
416:             SMAC &   657 $\pm$  189&    0.447 &   569 $\pm$   290 (  172)  &    0.535 &   578 $\pm$   234 (  179)  \\ \hline
417:               SC &   132 $\pm$  138&    0.694 &   182 $\pm$   217 (  154)  &    0.579 &   151 $\pm$   204 (  153)  \\ \hline
418:               SN &   471 $\pm$   76&    0.878 &   426 $\pm$   136 (  106)  &    0.664 &   477 $\pm$   189 (  137)  \\ \hline
419:             DEEP &   338 $\pm$   60&    0.906 &   326 $\pm$   115 (   86)  &    0.796 &   386 $\pm$   126 (  101)  \\ \hline
420: \multicolumn{6}{c}{ }  \\ 
421:        SFI++$_G$ &   370 $\pm$   58&    0.940 &   357 $\pm$    94 (   76)  &    0.719 &   471 $\pm$   172 (  116)  \\ \hline
422:       SFI++$_F$ &   357 $\pm$   54&    0.949 &   322 $\pm$    85 (   71)  &    0.855 &   375 $\pm$   109 (   88)  \\ \hline
423:            SFI++ &   364 $\pm$   40&    0.966 &   331 $\pm$    69 (   53)  &    0.870 &   431 $\pm$   102 (   81)  \\ \hline
424: \multicolumn{6}{c}{ }  \\
425:        COMPOSITE &   341 $\pm$   27&    0.977 &   249 $\pm$    57 (   40)  &    0.908 &   407 $\pm$    81 (   65)  \\ \hline
426: \label{tab:bfm}
427: \end{tabular}
428: \end{table*} 
429: 
430: \begin{table*}
431: \caption{Bulk flow vectors for the surveys (in Galactic Cartesian coordinates), for MLE- and MV weights . For the MV moments, the error in parenthesis is the noise error only. The quoted error includes both noise and the difference from the idealized survey geometry. Note that the MV $R_I = 20 \hmpc$ and $R_I = 50 \hmpc$ results for a given survey are not independent.} 
432: \begin{tabular}{lccccccc}
433:  \hline \hline
434: Survey      &  \multicolumn{3}{c}{MLE} &&\multicolumn{3}{c}{MV}\\
435: & $v_x$ & $v_y$ & $v_z$ &  $R_I$ & $v_x$ & $v_y$ & $v_z$  \\
436: & (km/sec) & (km/sec) & (km/sec) &  ($h^{-1}$Mpc) & (km/sec) & (km/sec) &  (km/sec) \\ \hline \hline
437:          SBF &  248 $\pm$   56 & -212 $\pm$   50 &  198 $\pm$   35  &   20     &  209 $\pm$  107 (  64) & -242 $\pm$  110 (  63) &  165 $\pm$   88 (  51)   \\ \cline{5-8}
438:                         &   &   &  &   50             &  244 $\pm$  188 (  65) & -277 $\pm$  183 (  68) &  198 $\pm$  177 (  59)   \\ \hline
439:            ENEAR &  179 $\pm$   41 & -281 $\pm$   35 &   41 $\pm$   31  &   20     &  118 $\pm$   51 (  46) & -170 $\pm$   59 (  44) &   -0 $\pm$   42 (  36)   \\ \cline{5-8}
440:                         &   &   &  &   50             &   56 $\pm$  102 (  67) & -196 $\pm$  105 (  68) &  -20 $\pm$   84 (  59)   \\ \hline
441:          SHALLOW &  190 $\pm$   33 & -259 $\pm$   29 &  110 $\pm$   23  &   20     &   98 $\pm$   47 (  41) & -148 $\pm$   57 (  41) &   32 $\pm$   39 (  32)   \\ \cline{5-8}
442:                         &   &   &  &   50             &   49 $\pm$  102 (  66) & -189 $\pm$  105 (  67) &   -6 $\pm$   84 (  58)   \\ \hline
443: \multicolumn{8}{c} {} \\
444:               LP &  512 $\pm$  295 &  -99 $\pm$  331 &  649 $\pm$  241  &   20     &  757 $\pm$  257 ( 205) & -735 $\pm$  252 ( 203) &  738 $\pm$  251 ( 204)   \\ \cline{5-8}
445:                         &   &   &  &   50             &  777 $\pm$  232 ( 206) & -738 $\pm$  229 ( 203) &  735 $\pm$  217 ( 205)   \\ \hline
446: \multicolumn{8}{c} {} \\
447:          Willick &   97 $\pm$  392 & -904 $\pm$  406 &  461 $\pm$  321  &   20     &   23 $\pm$  353 ( 292) &   19 $\pm$  352 ( 292) &   29 $\pm$  351 ( 291)   \\ \cline{5-8}
448:                         &   &   &  &   50             &   43 $\pm$  332 ( 293) &  -34 $\pm$  321 ( 291) &   54 $\pm$  311 ( 291)   \\ \hline
449:             EFAR &  518 $\pm$  344 &  519 $\pm$  258 &   57 $\pm$  223  &   20     &  250 $\pm$  237 ( 156) & -177 $\pm$  243 ( 155) &  191 $\pm$  231 ( 154)   \\ \cline{5-8}
450:                         &   &   &  &   50             &  273 $\pm$  195 ( 155) & -148 $\pm$  211 ( 157) &  211 $\pm$  176 ( 153)   \\ \hline
451:             SMAC & -116 $\pm$  157 & -647 $\pm$  161 &  -20 $\pm$  118  &   20     &  323 $\pm$  169 ( 103) & -414 $\pm$  165 (  95) &  217 $\pm$  169 ( 100)   \\ \cline{5-8}
452:                         &   &   &  &   50             &  285 $\pm$  140 ( 106) & -460 $\pm$  143 ( 100) &  202 $\pm$  121 ( 104)   \\ \hline
453:               SC &  120 $\pm$  102 &  -35 $\pm$   91 &   42 $\pm$   68  &   20     &  105 $\pm$  140 ( 105) & -132 $\pm$  134 (  87) &   67 $\pm$   98 (  72)   \\ \cline{5-8}
454:                         &   &   &  &   50             &  106 $\pm$  125 ( 101) &  -93 $\pm$  131 (  85) &   53 $\pm$   92 (  76)   \\ \hline
455:               SN &   77 $\pm$   62 & -462 $\pm$   63 &  -52 $\pm$   42  &   20     &   85 $\pm$   81 (  66) & -407 $\pm$   90 (  67) &  -88 $\pm$   62 (  47)   \\ \cline{5-8}
456:                         &   &   &  &   50             &  160 $\pm$  113 (  80) & -449 $\pm$  121 (  86) &   16 $\pm$   92 (  70)   \\ \hline
457:             DEEP &  105 $\pm$   49 & -322 $\pm$   48 &   -0 $\pm$   33  &   20     &   98 $\pm$   69 (  55) & -310 $\pm$   75 (  52) &  -24 $\pm$   54 (  41)   \\ \cline{5-8}
458:                         &   &   &  &   50             &  160 $\pm$   75 (  61) & -345 $\pm$   84 (  65) &   69 $\pm$   56 (  48)   \\ \hline
459: \multicolumn{8}{c} {} \\
460:        SFI++$_G$ &  109 $\pm$   41 & -336 $\pm$   42 &  109 $\pm$   27  &   20     &   80 $\pm$   53 (  46) & -334 $\pm$   66 (  49) &  101 $\pm$   42 (  36)   \\ \cline{5-8}
461:                         &   &   &  &   50             &  109 $\pm$  103 (  69) & -448 $\pm$  107 (  70) &   96 $\pm$   87 (  61)   \\ \hline
462:       SFI++$_F$ &  123 $\pm$   38 & -327 $\pm$   38 &   78 $\pm$   31  &   20     &   91 $\pm$   46 (  42) & -297 $\pm$   56 (  42) &   84 $\pm$   44 (  38)   \\ \cline{5-8}
463:                         &   &   &  &   50             &   80 $\pm$   65 (  54) & -351 $\pm$   68 (  53) &  106 $\pm$   54 (  46)   \\ \hline
464:            SFI++ &  117 $\pm$   28 & -331 $\pm$   28 &   96 $\pm$   20  &   20     &   83 $\pm$   36 (  32) & -308 $\pm$   49 (  33) &   89 $\pm$   32 (  26)   \\ \cline{5-8}
465:                         &   &   &  &   50             &  100 $\pm$   61 (  49) & -409 $\pm$   65 (  49) &   89 $\pm$   50 (  42)   \\ \hline
466: \multicolumn{8}{c} {} \\
467:        COMPOSITE &  137 $\pm$   19 & -301 $\pm$   18 &   83 $\pm$   14  &   20     &   85 $\pm$   27 (  24) & -228 $\pm$   43 (  25) &   53 $\pm$   26 (  19)   \\ \cline{5-8}
468:                         &   &   &  &   50             &  114 $\pm$   49 (  40) & -387 $\pm$   53 (  41) &   57 $\pm$   37 (  32)   \\ \hline
469: \label{tab:bfv}
470: \end{tabular}
471: \end{table*}
472: 
473: \begin{figure*}
474:      \includegraphics[width=\textwidth]{bfr.eps}
475:         \caption{The bulk flow of the composite catalogues as a function of $R_I$. Note that the data points are not independent, but rather are highly correlated. In the Galactic y direction (upper right panel), there is a consistent and robust flow exhibited by all catalogues that probe large scales,  and this is reflected in the BF magnitude (lower right panel).}
476:     \label{fig:surveybulk}
477: \end{figure*}
478: 
479: It is important to note that for a given catalogue, the bulk flow moments calculated for different values of $R_I$ do not have independent errors, and thus cannot be strictly compared.   However, surprisingly, nearly all of the surveys we studied have a larger amplitude flow for $R_I=50\ h^{-1}$Mpc than for $R_I=20\ h^{-1}$Mpc (see Tables~\ref{tab:bfm} and \ref{tab:bfv} and Figure~\ref{fig:surveybulk}).   It is particularly compelling that this is the case for both the SFI++ and the DEEP catalogues,  which are completely independent and both of which have relatively small measurement errors on their bulk flow moments.   A notable exception to this trend is the SC survey. This leads to the question of whether different surveys are mutually compatible, a topic addressed in the following section.
480: 
481: \section{Consistency of survey bulk flows}
482: \label{sec:consist}
483: 
484: \subsection{Method}
485: 
486: We now consider the consistency of the bulk flows measured by different surveys.    While this has been done previously using the MLE moments, our MV moments have advantages.   In particular, while MLE bulk flow moments depend on the details of a survey and are not necessarily comparable between different surveys,  the MV moments have been designed to approximate the same window function regardless of the survey particulars.  This means that the theoretical difference of the two moments will be as small as possible, making the comparison more rigorous.   
487: 
488: Following \citet{WatFel95}, we quantify the agreement between two surveys, say survey $A$ and $B$, by calculating the covariance matrix for the difference in value of the bulk flow moments $u_i^A$ and $u_i^B$ of the two surveys,
489: \begin{eqnarray}
490: R^{A-B}_{ij}&=&  \langle (u_i^A - u_i^B)(u_j^A - u_j^B)\rangle\nonumber\\
491: &=& R^A_{ij} + R^B_{ij}-R^{AB}_{ij}-R^{AB}_{ji},
492:  \end{eqnarray}
493: where the cross-terms are given by
494: \begin{equation} 
495:  R^{AB}_{ij}  = {\Omega_{m}^{1.1}\over 2\pi^2}\int_0^\infty
496:  dk \ \ ({\cal W}^{AB})^2_{ij}(k)P(k),
497: \label{eq:covv-diff}
498: \end{equation}
499: and
500:  \begin{eqnarray}
501: ({\cal W}^{AB})^2_{ij} (k)&=&
502:   \sum_{n,m} w_{i,n}^A\  w_{j,m}^B \int {d^2{\hat k}\over 4\pi}\ \left({\bf \hat r}^A_n\cdot {\bf \hat k}\ \ {\bf \hat r}^B_m\cdot {\bf \hat k}\right)\nonumber\\
503: && \times\exp\left(i{\bf k}\cdot ({\bf r}^A_n- {\bf r}^B_m)\right). 
504: \end{eqnarray}
505: Agreement of the moments from $A$ and $B$ can then be quantified by a $\chi^2$ for 3 degrees of freedom given by
506: \begin{equation}
507: \chi^2 = \sum_{i,j} (u^A_i-u^B_i)(R^{A-B}_{ij})^{-1}(u^A_j-u^B_j).
508: \label{eq:chisq}
509: \end{equation}
510: 
511: \subsection{Results}
512: In order to quantify the agreement between the catalogues, we calculated the $\chi^2$ for three degrees of freedom, as defined in Eq.~\ref{eq:chisq}, for the difference in bulk flow of a given catalogue and that of the composite catalogue \emph{with the given catalogue removed}. Note also that since the covariance is model dependent, the results are given for the WMAP5 central parameters.  The results are given in Table~\ref{tab:consist}.
513: 
514: \begin{table*}
515: \caption{$\chi^2$ for 3 DoF for composite-surveys for $\Omega_m=0.258$. If the $\chi^2$ value is greater than 7.8, the two surveys disagree at the 95{\%} confidence level.} 
516: \begin{tabular}{lccccc}
517: \hline \hline
518: &   $R_I=$ & \multicolumn{2}{c}{20\hmpc}& \multicolumn{2}{c}{50\hmpc} \\
519: Survey &  $\sigma_8=$ &   0.796  &  1.0 &   0.796  &  1.0 \\  \hline \hline 
520: SBF-ENEAR & &  4.036  &  3.026  & 2.828  &  2.008  \\ \hline
521: \multicolumn{6}{c}{ }  \\
522: DEEP-SMAC & &  3.288  &  2.558  & 2.493  &  2.135  \\ \hline
523: DEEP-SC & &  6.351  &  5.071  & 5.980  &  4.817  \\ \hline
524: DEEP-SN & &  4.963  &  3.929  & 2.615  &  2.137  \\ \hline
525: DEEP-Willick & &  2.776  &  1.831  & 4.242  &  2.963  \\ \hline
526: DEEP-EFAR & &  3.230  &  2.182  & 8.387  &  6.241  \\ \hline
527: \multicolumn{6}{c}{ }  \\
528: SFI++$_F$-SFI++$_G$ & &  0.430  &  0.401  & 0.981  &  0.843  \\ \hline
529: \multicolumn{6}{c}{ }  \\
530: DEEP-SHALLOW & &  4.466  &  3.774  & 3.595  &  2.993  \\ \hline
531: DEEP-SFI++ & &  3.864  &  3.278  & 1.030  &  0.907  \\ \hline
532: SFI++-SHALLOW & & 11.300  & 10.446  & 6.090  &  5.000  \\ \hline
533: \multicolumn{6}{c}{ }  \\
534: COMPOSITE-ENEAR & &  6.754  &  6.339  & 5.714  &  4.490  \\ \hline
535: COMPOSITE-SBF & &  2.929  &  2.144  & 2.474  &  1.682  \\ \hline
536: COMPOSITE-SHALLOW & &  7.400  &  6.843  & 5.999  &  4.712  \\ \hline
537: \multicolumn{6}{c}{ }  \\
538: COMPOSITE-SMAC & &  2.739  &  2.120  & 1.939  &  1.607  \\ \hline
539: COMPOSITE-SC & &  0.605  &  0.447  & 5.293  &  3.922  \\ \hline
540: COMPOSITE-SN & &  8.104  &  6.664  & 0.975  &  0.808  \\ \hline
541: COMPOSITE-Willick & &  2.012  &  1.289  & 6.399  &  4.342  \\ \hline
542: COMPOSITE-EFAR & &  1.235  &  0.827  & 9.604  &  6.782  \\ \hline
543: COMPOSITE-DEEP & &  2.789  &  2.270  & 1.061  &  0.964  \\ \hline
544: \multicolumn{6}{c}{ }  \\
545: COMPOSITE-SFI++$_F$ & &  4.558  &  4.297  & 0.553  &  0.514  \\ \hline
546: COMPOSITE-SFI++$_G$ & &  6.982  &  6.443  & 0.929  &  0.749  \\ \hline
547: COMPOSITE-SFI++ & & 12.141  & 11.283  & 2.641  &  2.412  \\ \hline
548: \multicolumn{6}{c}{ }  \\
549: SHALLOW-LP & &  8.756  &  7.833  & 10.796  &  9.847  \\ \hline
550: DEEP-LP & &  9.818  &  8.351  & 10.135  &  8.964  \\ \hline
551: SFI++-LP & &  8.025  &  6.885  & 11.541  &  9.714  \\ \hline
552: COMPOSITE-LP & &  8.405  &  7.388  & 12.344  & 10.412  \\ \hline
553: \hline
554: \label{tab:consist}
555: \end{tabular} 
556: \end{table*}
557: 
558: From Table~\ref{tab:consist}, we see that the MV-weighted bulk flow of LP disagrees with that of the COMPOSITE catalogue on both 20\hmpc\ and 50\hmpc\ scales. The level of disagreement on the latter scale, for $\sigma_8= 0.796$ corresponds to 99\% CL, although this would drop to 98\% if $\sigma_8$ were as high as 1.   This is in agreement with previous analyses based on MLE-weighted moments \citep{Hud03}. There are independent reasons to question the LP results: \cite{HudSmiLuc04} compared, cluster by cluster, the distance to the brightest cluster galaxy derived by LP to that derived from the FP for other cluster members, and found that in a few cases, these distances differed significantly, in the sense that the LP BCG distance was too large (i.e. the BCG was fainter than expected). They found that all of the discrepant BCGs for which HST images were available showed strong evidence for dust. For these reasons, we have chosen to reject LP from the Composite catalogues.
559: 
560: On the 50 \hmpc\ scale, the next most discrepant dataset is EFAR, which disagrees with the COMPOSITE catalogue at the 98\% level, if $\sigma_8= 0.796$. The disagreement is more model-dependent, however, than is the case with LP. If, for example, $\sigma_8$ were as high as 1, the disagreement would drop to only 92\% C.L. Thus we choose to retain EFAR, as well as all of the other catalogues except LP, as part of the COMPOSITE catalogue. On the 20 \hmpc\ scale, we note there is some tension between the SHALLOW catalogue (dominated by ENEAR) and the SFI++ catalogue.  As noted above, on the largest scales, the DEEP catalogue and the SFI++ catalogue are in excellent agreement and both independently show a significant, large-scale flow.
561: 
562: \subsection{Comparison with kinetic Sunyaev-Zel'dovich bulk flow}
563: \label{sec:ksz}
564: 
565: Recently\footnote{After this paper was submitted},
566: \cite{KasAtrKoc08b,KasAtrKoc08a}, have claimed a detection of the bulk
567: flow from the dipole of the CMB observed behind clusters of galaxies,
568: with amplitude ($2.8 \pm 0.7 \mu$K) and direction towards
569: \lberr{283}{14}{12}{14}.   They interpret this as a dipole in the kinetic
570: Sunyaev-Zel'dovich effect. The conversion from $\mu$K to km/s has some systematic uncertainty, but the authors interpret the bulk flow to be between $600 \kms$ and $1000 \kms$. 
571: 
572: Our bulk flow result is in excellent directional agreement
573: (6$^{\circ}$) with that found by \cite{KasAtrKoc08a}. The amplitude of
574: their flow ($1000 \kms$) is considerably higher, but would be compatible if systematic and random errors reduced the Kashlinksy et al.\ result to $\sim 400-500 \kms$.  However, we note that their sample is very much deeper than ours. Whereas our signal arises from within a volume of radius $\sim 100 \hmpc$ ($z < 0.03$), their signal is detected on much larger physical scales, with most of the signal arising from the shell in the range $0.04 < z < 0.2$ ($120 \hmpc < r < 600 \hmpc$) .
575: 
576: \section{Implications for Cosmography}
577: \label{sec:implic}
578: 
579: Our robust measurement of a bulk flow of $407\pm81$ km/s toward \lb{287\arcdeg\pm9}{8\arcdeg\pm6} for a Gaussian window with $R_I = 50 \hmpc$ suggests that roughly 50\% of the Local Group's motion is generated by structures beyond this depth.  This is in good agreement with the value of $366\pm125$ \kms\ toward \lb{300}{13} within a 60 \hmpc\ top-hat sphere, found by \cite{HofEldZar01} based on the Mark III peculiar velocity catalogue.
580: 
581: One way to locate the physical sources of peculiar velocities is through all-sky maps of densities of galaxies, with the assumption that one can use this map as a proxy for that of the dark matter mass, allowing for a bias factor, $b$, between galaxies and dark matter. The degenerate combination of prefactors that scale Eq. \ref{eq:peculiar} is then $\beta = f(\Om)/b$. Having mapped the density field, one can then predict the peculiar motion of the LG and other galaxies.  By comparing these predictions with observed peculiar velocities, one can solve for both $\beta$ and for the bulk motion arising from sources at depths larger than the galaxy survey.  For example, \cite{Hud94b} mapped the density field of optically-selected galaxies within 80 \hmpc, a top-hat radius that is a close match to our 50 \hmpc\ Gaussian. By comparing the predicted peculiar velocities to the old Mark II peculiar velocity data set, he found $\beta = 0.5\pm0.06$ and, more importantly, that the residual motion, arising from sources outside 80 \hmpc, was $405\pm45$ \kms\ toward \lb{292}{7}. This residual motion is remarkably consistent with the result found in this paper in scale, amplitude and direction (within $5\deg$), although it was derived from a completely different data set with different methodology and assumptions. Similarly, \cite{PikHud05}, using a different galaxy density field based on 2MASS photometry and published redshifts, found a slightly lower residual motion of $271\pm104$ \kms toward \lb{300}{15}. This result is also consistent with the $R_I = 50\hmpc$ bulk flow found here.  Redshift surveys of IRAS-selected galaxies \citep{StrYahDav92, RowShaOli00} give very similar results for the residual flow beyond 60 \hmpc, provided $\beta_{IRAS}$ is $\sim 0.5$, as found in direct density-velocity comparisons \citep[see][for a summary table]{PikHud05}.  These independent checks suggest that the large bulk flow motion is consistent with the \emph{absence of} sufficiently massive attractors in the nearby ($r < 80$ \hmpc) Universe.
582: 
583: Neither of the above mentioned galaxy surveys is deep enough to detect the physical source(s) of the 407 \kms\ motion, which must lie beyond $\sim 50 \hmpc$.  The only all-sky \emph{galaxy} survey that reaches much greater depths is the IRAS PSCz survey \citep{BraTeoFre99}. This shows little evidence of important attractors between 60 \hmpc\ and 180 \hmpc, with the exception of the Shapley Concentration, which is relatively weak in IRAS. This issue was studied in more detail by \cite{HudSmiLuc04}, who argued that, to explain the SMAC survey bulk motion, sources generating $\sim 200$ \kms motion must be added to the IRAS-PSCz density field. They attributed this to a combination of (i) sources in the Galactic Plane, (ii) sources beyond the 200 \hmpc\ depth of the PSCz, and (iii) to the undercounting of densest regions of the Shapley Concentration and the Horologium-Reticulum supercluster. The interested reader is referred to Sec 5.4 of \cite{HudSmiLuc04} for further details.
584: 
585: On the other hand, if we assume that clusters of galaxies trace the large-scale density field (perhaps with a higher biasing factor) then one can use an all-sky survey of clusters \citep{KocEbeMul04} as a predictor of the velocity field. This survey suggests that, if clusters trace the mass, the Shapley Concentration and related very large-scale structures may play an important role, with as much as $\sim 300 \kms$ arising from large scales, in approximate agreement with the large flow found here.
586: 
587: Finally, it is worth noting that the large value of the residual motion implies that there are significant velocities generated by very-large scale structures and that this in turn has implications for the impact of such structures as a ``foreground'' for calibrating SNe \citep{CooCal06, HuiGre06, NeiHudCon07, AbaLah08} and for its effects on the CMB such as the Integrated Sachs-Wolfe Effect \citep{FosDor07}.
588: 
589: \section{Comparison with Cosmological Models}
590: \label{sec:compare}
591: 
592: As discussed above, the large-scale flow is directly sensitive to the large scales of the matter power spectrum, and so one can compare the observed value of the flow to that expected for a given cosmological model. Assuming that the Local Group does not occupy a special location in the Universe,  one can calculate the expected mean flow and variance of bulk flow measurements taken at different locations.  The former quantity is zero and the latter is the quantity of interest: it depends on the weights and sample geometry and is given by the covariance matrix $R_{ij}$ (Eq. \ref{eq:rab}), which depends on the measurement noise and the power spectrum.  This allows us to compare, in a frequentist sense, the observed bulk flow moments with the cosmological expectation. In particular, we can calculate the $\chi^2$ for three degrees of freedom corresponding to the 3 moments, as given by
593: \begin{equation}
594: \chi^2 = \sum_{i,j} u_i R_{ij}^{-1}u_j,
595: \label{eq:chi}
596: \end{equation}
597: where $i$ and $j$ both go from 1 to 3 to specify the bulk flow components and the covariance matrix $R_{ij}$ is calculated as described above for a specific set of values for the cosmological parameters.   Here we use the $\Lambda$CDM power spectrum model of \cite{EisHu98} 
598: and the WMAP5  central parameters as described above.
599: While this statistic has been calculated previously for MLE bulk flow moments, the advantage of the new MV moments is that, for the case of $R_I= 50h^{-1}$Mpc, they have been designed to be sensitive {\it only} to scales of order 100$h^{-1}$Mpc and larger.    Thus we will be able to probe these scales without having to worry about the influence of smaller scales.    Further, by isolating the very large scale motions, we will see that we will be able to put stronger constraints on  power spectrum parameters.
600: 
601: \begin{table*}
602: \caption {Expected bulk flows and observed $\chi2$ for 3 bulk flow moments ($R_I = 50h^{-1}$Mpc), as a function of cosmological parameters} 
603: \begin{tabular}{lcccccc}
604: \hline \hline
605: & \multicolumn{2}{c}{ML} &   \multicolumn{2}{c}{BC} \\
606: & $\Omega_m=0.258$ &$\sigma_8=0.796 $ & 
607: $\Omega_m=0.262$ &$\sigma_8=0.863 $ \\ 
608: Expected 1D r.m.s.\ & \multicolumn{2}{c}{112 km/s}   &   \multicolumn{2}{c}{121 km/s}\\ \hline \hline
609: Survey & $\chi2$ &$P(>\chi2) $ & $\chi2$ & $P(>\chi2)$  \\ \hline
610: SHALLOW        &  1.54 & 0.6731     &  1.37 & 0.7126  \\
611: DEEP                &  7.54 & 0.0565      &  6.76 & 0.0800 \\
612: SFI++                & 11.23 & 0.0105     &  9.92 & 0.0193  \\
613: COMPOSITE   & 11.52 & 0.0092     & 10.15 & 0.0173 \\
614: \hline
615: \label{tab:chisq}
616: \end{tabular}
617: \end{table*} 
618: 
619: In Table~\ref{tab:chisq} we show the expected r.m.s. bulk flow for the WMAP5 ($\Omega_m,\sigma_8$) parameters for the COMPOSITE catalogue at a scale of $R_I = 50 \hmpc$. As can be seen by comparing Table~\ref{tab:chisq} with the values in Table~\ref{tab:bfm}, the measured and expected values differ significantly. Quantifying the disagreement, we find, for the WMAP5 central parameters, find that $\chi^2 = 11.52$. The probability of observing a bulk of flow this high an amplitude, in a Universe described by a WMAP5-normalized $\Lambda$CDM model, is only 0.9\%. 
620: 
621: \begin{figure}
622: \includegraphics[width= \columnwidth]{omegamh2sig8cont.eps}
623: \caption{
624: The $\chi^2$-based confidence levels for the MV COMPOSITE survey ($R_I = 50 \hmpc$), given the observed flow, are shown by the black dashed lines at the 95\%, 99\% and 99.73\% levels from top to bottom. Also shown are the WMAP 68\% and 95\% confidence limits from \protect\cite{DunKomNol08}  (blue solid)  well as for WMAP5+BAO+SN \protect\citep{KomDunNol08}  (red dashed). The stars indicate the regions of the WMAP5 parameter space that maximize the bulk flow variance, and hence minimize the $\chi^2$.}
625: \label{fig:omegamhhsig}
626: \end{figure}
627: 
628: In order to assess the effect of  the uncertainties in the WMAP5 parameters, we have explored further the multi-dimensional cosmological  parameter space. Our covariance matrix $R_{ij}$ is dominated by the cosmic variance term (typically $\sim 100 \kms$) and not by the noise term  (typically $\sim 40 \kms$) which has a small effect when added in quadrature.  Thus, to a good approximation, $R_{ij}$ should scale with the amplitude of the power spectrum, parametrized by $\sigma_8$. The cosmic variance term also depends on the $f(\Om)$ prefactor and the power spectrum shape parameter, $\Gamma$, which on the large scales probed here is well approximated by $\Gamma = \Om h$. Lower values of $\Gamma$ lead to larger flows at fixed $\sigma_8$ and $f(\Om)$. There is some cancellation of the $\Om$-dependent terms, and so we have found that the flows depend on the combination $\Om h^2$.  Fig. \ref{fig:omegamhhsig} shows the 2D parameter space of $\Om h^2$ and $\sigma_8$ with $h$, $\Omega_b$ and $n_s$ are held fixed at their WMAP5 central values for this calculation.  The large scale flow found here favours the corner with low $\Om h^2$  and high $\sigma_8$. Also plotted are the WMAP5 68\% and 95\% confidence regions from \cite{DunKomNol08}, as well as the WMAP5+BAO+SN combination from \cite{KomDunNol08}. One can see that the entire WMAP5 95\% CL parameter space is excluded at better than 95\% CL ($2\sigma$).   The WMAP5 ``best case'' (BC) parameters, i.e. those that lie within the \cite{DunKomNol08} 95\% CL regions, have  $\Om h^2 = 0.136$ and $\sigma_8=0.863$ but the r.m.s. flow differs only slightly from the central WMAP5 value, and hence the $\chi^2$ value is very similar (see Table \ref{tab:chisq}).  Essentially both WMAP5 and flows are sensitive to the same large scales, and so they have the same parameter degeneracies.
629: 
630: Another approach we took is maximum-likelihood analysis. The cosmic variance in the bulk flow is a function of the cosmological parameters, and so one can ask which parameters maximize the probability of generating a flow equal to that observed. Basically, given a set of power spectrum parameters ${\bf\Theta}$, the likelihood is given by
631: \begin{equation}
632: {\cal L}({\bf\Theta}) =  {1\over |R|^{1/2}}\exp\left(\sum_{ij}-{1\over 2}u_iR^{-1}_{ij}u_j\right).
633: \label{eq:likelihood}
634: \end{equation}
635: where $i$ and $j$ both go from 1 to 3 to specify the bulk flow components.    Taking the natural logarithm of the above, and multiplying by $-2$, we see that this is very similar to the ``frequentist'' $\chi^2$ statistic (Eq. \ref{eq:chi}) except for a term $\ln |R|$ that penalizes models with high cosmic variance.
636: 
637: \begin{figure}
638: \includegraphics[width=\columnwidth]{sig8like.eps}
639: \caption{Likelihood of the value of $\sigma_8$ when the power spectrum shape is fixed at the WMAP5 central parameters. The dashed lines indicate the 99\% and 95\% lower limits.
640: }
641: \label{fig:siglike}
642: \end{figure}
643: 
644: From Figure \ref{fig:omegamhhsig} we see that the bulk flow is more weakly dependent on $\Om h^2$ than $\sigma_8$.   This can be understood by considering the fact that increasing $\Om$ increases the $f(\Om)$,  but also increases $\Gamma$; these two changes act on the bulk flow in opposite directions and tend to cancel out.  Given the stronger dependence on $\sigma_8$, we have chosen to plot the likelihood of $\sigma_8$ with other cosmological parameters fixed at the central WMAP5 values.   The results are show in Fig. \ref{fig:siglike}. The peak of the likelihood is at $\sigma_8 \sim 1.7$, but the likelihood is very non-Gaussian: it has a sharp edge at low $\sigma_8$ and has a tail extending to very large values. The 1-sided 95\% and 99\% lower limits are 1.109 and 0.878, respectively. Of course these limits would be reduced if one placed priors on $\sigma_8$ that excluded very large values.
645: 
646: \section{Discussion}
647: \label{sec:discuss}
648: 
649: There are several possible explanations for the discrepancy between observations and model that we have observed. 
650: 
651: First, it is possible that the large observed flow is the result of a systematic error in the data. However, the independence of the distance indicators (TF, FP and SN Ia) and methodology of the various surveys, as well as the agreement between different surveys makes this quite unlikely.  Indeed, examination of Table~\ref{tab:bfv} shows that no one survey is ``pulling'' the COMPOSITE bulk flow.  Furthermore, we have shown that, on the $R_I = 50 \hmpc$ scale, the surveys are mutually consistent within their random errors. Thus systematic errors affecting individual surveys must be small, and, since most systematic errors are expected to be independent, their net effect is smaller still. The only systematic that is likely to affect all of these surveys in the same way is a coherent (dipole-like) error in the foreground Galactic extinctions \citep{SchFinDav98} used to correct magnitudes, and hence distances and peculiar velocities.  This possibility, however, has been tightly constrained via extragalactic ``colour'' standards \citep{Hud99}. 
652: 
653: Second, there is the rather un-Copernican possibility that we happen to live in a rare local volume that has a statistically unlikely large bulk flow magnitude.  The rareness would then be at the 1-in-100 level.
654: 
655: Finally, there is the possibility that the WMAP5-calibrated cosmological model underestimates the amplitude of large-scale fluctuations in the low-$z$ Universe.  In this context, it is interesting to compare our result to those of other independent low-redshift probes, which we consider from small to large scales.
656: 
657: There are a number of small-scale measurements of $\sigma_8$ (or $\Om^{0.5}\sigma_8$) from a variety of techniques, some of which are summarized in \cite{BonConPen05}. The most recent weak-lensing result from the CFHTLS \citep{FuSemHoe08} find  $\sigma_8(\Om / 0.25)^{0.64} = 0.785 \pm 0.043$ when all angular scales are analyzed, but $\sigma_8(\Om / 0.25)^{0.53} = 0.837 \pm 0.084$ when only scales in the linear regime are studied. Some recent results that suggest higher values of $\sigma_8$ include the Lyman-$\alpha$ forest study of \cite{SelSloMcD06}, who find that that the power is enhanced over the expectation of WMAP3, and the study of \cite{ReiAdeBoc08} which finds $\sigma_8 = 0.94^{+0.03}_{-0.04}$ from secondary cluster SZ anisotropies in the CMB. Using pairwise velocity statistics \cite{pairwise03} found $\sigma_8=1.13^{+0.22}_{-0.23}$. 
658: 
659: It is possible to use peculiar velocities to probe matter density fluctuations on scales smaller than those probed by the bulk flow by comparing density-field predictions with observed peculiar velocities point-by-point. As discussed above, this yields an estimate of $\beta \equiv f(\Om)/b$, which, when combined with an independent estimate of $\sigma_{8, gal}$, can be used to determine $f(\Om)\sigma_8$. \cite{PikHud05} combined their analysis of the 2MASS density field with previous comparisons based on IRAS density fields.  They found the degenerate combination $\sigma_8\,(\Om/0.25)^{0.55} = 0.88\pm0.05$.  The quoted error is likely a slight underestimate, since not all studies are independent. Nevertheless, we note that the central value is somewhat higher than the WMAP5 value, although still lower than our 95\% lower limit.  Although the \cite{PikHud05} measurement is based on peculiar velocities, the scale probed is quite different --- in such studies, the large-scale bulk flow is essentially subtracted out, and so the scale is typically that of superclusters: $\sim 20 \hmpc$. Similar statistical results based on peculiar velocities can be obtained from redshift-space distortions; for example, from SDSS LRGs, for $\Om = 0.245$, \cite{CabGaz08} quote $\sigma_8 = 0.85\pm0.06$, in good agreement with \cite{PikHud05}, but still in conflict with our formal 95\% lower limit on $\sigma_8$.  In summary, from data on small to intermediate scales, there are hints that $\sigma_8$ may be higher than the WMAP5 best-fit value, but only by a modest amount which is not sufficient to comfortably explain the large-scale bulk flow.
660: 
661: The bulk flow result result found here suggests significant power on scales of  $k < 0.02$ h/Mpc. While the CMB probes such scales at very high redshift, there is only one other probe of the \emph{matter} power spectrum at low redshift: the ISW effect. This probe shows a signal that is  \emph{stronger} \citep{GazManMul06}, by a factor of $2.2\pm0.6$ \citep{HoHirPad08} than expected from the clustering of galaxies and quasars. It is interesting that our most-likely normalization $\sigma_8$ is also a factor $\sim 2$ larger than the standard model. 
662: 
663: Finally, we consider the result of \cite{KasAtrKoc08b,KasAtrKoc08a}. As noted by those authors, taken at face value, their flow amplitude and, more importantly, the scale over which this flow is observed ($\sim 600 \hmpc$) is greatly in excess of that expected in $\Lambda$CDM models. In this case, it seems impossible to generate cosmologically-consisent results simply by tinkering with the parameters of $\Lambda$CDM; instead a wholesale revision of the model would be called for.
664: 
665: \section{Conclusions}
666: \label{sec:conc}
667: 
668: We have calculated optimal ``minimum variance'' weights designed to measure bulk flows with minimal sensitivity to small scale power, and have applied these weights to a number of recent peculiar velocity surveys.  We find that all of the surveys we studied are consistent with each other, with the possible exception of the \cite{LauPos94} BCG survey. Taken together the data suggest that the bulk flow within a Gaussian window of radius 50 \hmpc\ is $407\pm81$ \kms\ toward  \lb{287\arcdeg\pm9}{8\arcdeg\pm6}.  This motion is not due to nearby sources, such as the Great Attractor (at a distance of $\sim40$\hmpc), but rather to sources at greater depths that have yet to be fully identified. 
669: 
670: A flow of this amplitude on such a large scale is not expected in the WMAP5-normalized $\Lambda$CDM cosmology. The observed bulk flow favors the upper values of the WMAP5 $\Om h^2$-$\sigma_8$ error-ellipse, but even the point at the top of the WMAP5 95\% confidence ellipse predicts a bulk flow which is too small compared to that observed at a confidence level $> 98$\%.
671: 
672: There are several possible explanations for the discrepancy we have observed.   There is the possibility that we happen to live in a volume with a statistically unlikely ($\lesssim 2$\%) bulk flow magnitude.   If this is the case, then the structures that cause this flow should be eventually identified as the depth and sky coverage of redshift surveys increase.    Alternatively, it is possible that the large observed flow is the result of a systematic error in the data, although the independence of the distance indicators (TF, FP and SN Ia) and methodology of the various surveys, as well as the agreement between different surveys makes this unlikely. 
673: 
674: The bulk flow in the nearby ($d \lesssim 60 \hmpc$) Universe is no longer noise-limited but rather cosmic variance limited, so that increasing the quantity of nearby peculiar velocity data will not alter the significance of this result. At very large depths ($d > 100 \hmpc$), however, the bulk flow measurement is still quite noisy.  Future peculiar velocity surveys, such as the NOAO Fundamental Plane Survey \citep{SmiHudNel04}, as well as nearby supernovae surveys \citep{FilLiTre01,WooAldLee04,KelSchBes07, FriBasBec08}, are expected to yield more precise measurements of the amplitude of the bulk motion on these very large scales, and thus have the potential to strengthen the cosmological constraints therefrom. In order to measure the bulk flow variance directly, one must measure the bulk flow in independent (i.e. distant) regions. For the standard distance estimators used in traditional peculiar velocity work, the errors grow proportional to distance and hence become infeasible at large distances. So other techniques, such as those based on the kinetic Sunyaev-Zel'dovich effect \citep{SunZel72,RepLah91,HaeTeg96, RuhAdeCar04, Kos06, ZhaFelJus08, KasAtrKoc08a} will be needed to access independent volumes.
675: 
676: To reiterate, the results presented in this paper pose a challenge to the standard $\Lambda$CDM model with the WMAP5 parameters. As this study shows, the implications to the standard scenario should be explored with as many independent cosmological observations as we can muster, with particular attention paid to clues from probes at low redshift and on the largest scales.
677: 
678: \vspace{0.2cm}
679: 
680: \noindent{\bf Acknowlegements:} 
681: We thank Niayesh Afshordi and Russell Smith for interesting discussions and helpful comments on earlier versions of this paper. HAF would like to thank Danny Marfatia for helpful comments and Brad Klee for programming help. HAF has been supported in part by a grant from the Research Corporation, by an NSF grant AST-0807326 and by the National Science Foundation through TeraGrid resources provided by the NCSA. MJH is supported by NSERC. 
682: 
683: \bibliographystyle{mn2e}
684: \bibliography{mjh}
685: 
686: \end{document}
687: 
688: 
689: