What is “Virtually Speaking Science“? It is an online radio program that presents, according to its website:
Informal conversations hosted by science writers Alan Boyle, Tom Levenson and Jennifer Ouellette, who explore the explore the often-volatile landscape of science, politics and policy, the history and economics of science, science deniers and its relationship to democracy, and the role of women in the sciences.
Sean Carroll is a Caltech physicist, astrophysicist, writer and speaker, one of the founders of the blog Cosmic Variance, who recently completed an excellent popular book (which I highly recommend) on the Higgs particle, entitled “The Particle at the End of the Universe“. Our interviewer Alan Boyle is a noted science writer, author of the book “The Case for Pluto“, winner of many awards, and currently NBC News Digital’s science editor [at the blog “Cosmic Log“].
My rather hasty, breathless and inconsistent summaries (#1, #2 and #3) of last week’s talks at the excellent Higgs Symposium (held at the University of Edinburgh, as part of the new Higgs Center for Theoretical Physics) clearly had their limitations. So I thought it might be useful to give a more organized overview, with more careful language appropriate for non-expert readers, of our current knowledge and ignorance concerning the recently discovered Higgs-like particle (which most of us do believe is a Higgs particle of some type, though not necessarily of the simplest, “Standard Model” type.)
By almost all measures, the Higgs Symposium at the University of Edinburgh, as part of the new Higgs Centre for Theoretical Physics, was a great success. The only negative was that Professor Peter Higgs himself had a bad cold this week, and had to cancel his talk, as well as missing the majority of the talks by others. Obviously all of us in attendance were very disappointed not to hear directly from him, and we wish him a speedy recovery.
Other than this big hole in the schedule, the talks given at the symposium seemed to me to form a coherent summary of where we are right now in our understanding of the Higgs field and particle. They were full of interesting material, and wonderfully complementary to one another. This motivates me to try to provide, for non-experts, some future articles on what the conference attendees had to say. But to write such articles well takes time. So for now, here’s the quick version summarizing the last few talks, along the lines of the summaries I wrote (here and here) of the earlier talks. The slides from all the talks are posted here.
Day 2 of the Higgs Symposium is flying by, with very interesting presentations… and with little time for me to finish the last details of my own talk for tomorrow. (Tomorrow’s program includes a talk by Professor Peter Higgs himself!) But here’s a quick summary.
In my last post I mentioned a couple of the early talks; here’s a bit more about the later talks from yesterday, and then a bit about the first part of today. Caveat: all descriptions below are brief and necessarily incomplete! (more…)
I’m enjoying my first visit to Edinburgh, Scotland, United Kingdom, as a visitor at the new Higgs CenterCentre (it is the UK after all) for Theoretical Physics, recently founded in honor of Professor Peter Higgs and of the discovery of a candidate Higgs particle at the Large Hadron Collider (LHC). Today is the first day of the Higgs Symposium, a three-day workshop organized by the centre (and co-sponsored by the IPPP) that is celebrating the history of and the science behind (and ahead) of the recent discovery. (I’ll be speaking on Friday.)
There was a quick introduction by Richard Ball, the centre’s director — who was the first one to show a photo of a blackboard containing the equations of Higgs’ work, along with an great old photo of Peter Higgs from the days when he was writing his famous papers, dug out of the records at the University of Edinburgh. (Experts: For a Higgs doppelganger, see here.) Then a set of hour-long talks began. The first of these was a wonderful historical talk, looking back over 50 years, by Chris Llewellyn Smith. Professor Llewellyn Smith played a significant role in the Higgs discovery, with his contributions ranging from showing in the 1970s why a Higgs particle is necessary if quantum field theory (the types of equations we use today to describe particles) is correct, to pushing for the LHC to be built while head of the CERN Council and then as Director General of CERN in the 1990s. If time permits, I’ll may describe later a few of the fascinating historical twists that he described — though I’m afraid that most of them would be of interest mainly to experts in the field. For the moment, those interested may want to read his article that appeared in the journal Nature in 2007, entitled “How the LHC came to be“, which covers some related issues.
Following this we have so far had talks by Joe Incandela (spokesman of the CMS experiment) and Eilam Gross (co-convener of the Higgs search group at ATLAS) summarizing the experimental situation. As expected, there wasn’t anything new announced here; the talks involved an overview (for the audience of mostly theorists, including quite a few students) of how the measurements are done, and a review of previously announced results. I’ll describe a few interesting details of their talks later today or tomorrow.
Fig. 1: Of the 20 plots shown in yesterday’s post, the five marked in red have no Higgs signal, and contain nothing but statistical fluctuations on a background that, with infinite statistics, would give a flat horizontal histogram.
Well, I hope some of you attempted yesterday’s exercise, which involved looking at a bunch of plots with simulated data, and trying to figure out in each plot
is there a signal of the “Higgs particle” in the plot?
what roughly is the mass of the “Higgs particle” (which I assured you lies, for each plot, in the range 122-127 GeV/c²?)
So now let’s see how well you did, and also what the implications are for the 3 GeV/c² discrepancy between the two measurements by the ATLAS experiment of the Higgs particle’s mass — a discrepancy which led to a big discussion (which ATLAS did not encourage or generate, mind you). Some speculated (and others chose to report this speculation in the news media) that there might be evidence in this data for two Higgs particles. (This is contradicted by CMS’s result from November, but hey, who’s counting?) But the substantive question you might ask is: Is this such a big discrepancy that eitherthere are two Higgs particlesorATLAS has made a big mistake?
With that in the back of our minds, let’s take a look at the exercise I proposed yesterday, and see how things go. Note, however, that this exercise does not have direct or precise implications for ATLAS’s discrepancy. First, these plots are made in crude fashion and without simulating real Higgs particles, though the signal and the background are about the right size to match ATLAS’s current data on a Higgs decaying to two lepton/anti-lepton pairs. Second, ATLAS uses very sophisticated methods to measure the Higgs mass, much more powerful than you could employ by eye, and much more than these graphs could convey. Rather, the point here is to convey limitations of human psychology, and illustrate that humans are not naturally skilled at evaluating the statistical properties of small amounts of data.
Which Plots Have a Higgs Signal and Which Do Not?
15 of the 20 plots shown yesterday(in a larger figure that will be easier for you to read) have a Higgs signal; the others, marked with a red line in Figure 1, do not. That probably wasn’t too hard, except for the uppermost plot in the right column, because the plots without a Higgs have close to 40 events while those with a Higgs have close to 60; and the discrepancy is especially big in the range 120-130 GeV/c2 where I told you that the Higgs is to be found. Some people would have been tripped up by the peak in the bottom left plot, were it not for the fact that I told you the Higgs particle couldn’t be there.
Now on to the next question: What, roughly, is the Higgs mass in each of the 15 plots that have a signal.
Estimate the Higgs’ Mass
This is generally what trips people up the most. The human brain is an absolutely terrible statistician. It takes years of practice to unlearn what your brain wants to tell you — graduate students, and even senior theoretical physicists who haven’t stared at enough data, do an awful job with a problem like this.
For example, take Figure 2, which is one of the plots I showed yesterday. [Recall that the bins are 1 GeV/c² wide, and the bin just to the right of the 2 in “125” is the bin running from 125 to 126 GeV/c².] Your eye wants to tell you there’s a big peak at 126-127 GeV/c² and so that’s where the Higgs mass should be. But you’ve been warned that the Higgs peak is 4 GeV/c² wide at half its maximum height — so it shouldn’t just be a one-bin wide spike! Still, your brain forgets this and your eye misleads you. If you look carefully, there are rather few events to the right of the highest bin, and more to the left. The real Higgs mass is quite a bit lower than 126-127 in this case.
Fig. 2: One of the 15 plots with a Higgs signal.
Now what about Figure 3? This looks like it has a double peak! It has one peak between 123 and 124, and another between 126 and 127! But I assure you this was generated by a signal that has a single peak. Your eye, yet again, is fooled. The real Higgs mass in this case lies between the two peaks.
Fig. 3: Another of the 15 plots with a Higgs signal.
And Figure 4? This case doesn’t look too hard; there are several events in the 125-126 bin and several in the 126-127 bin, just 2 in the 127-128 bin, and none in the 124-125 bin. So clearly the Higgs mass should be between 125 and 127, probably 126. But in fact the actual Higgs mass in this case lies in the empty bin!
Fig. 4: A third plot with a Higgs signal.
The Truth is Revealed
Well, as the experts who are looking closely will already have guessed, every single one of these 15 plots was generated with a Higgs mass of 124.7 GeV/c2. Every one.
If there were 400 times as many events as in each of the plots from yesterday, here’s what you would see; three of the plots in Figure 5 show what the data looks like with a Higgs peak, and the fourth shows what the random background looks like.
Fig. 5: All the plots that contained a Higgs signal had a Higgs at 124.7 GeV/c2, whose shape (with 400 times the amount of data) is shown in three of the above figures, above a flat background. The background alone is shown in the upper right plot.
I assure you there was no funny business in generating the plots from yesterday. No bias was introduced. Try it yourself if you don’t believe me! The computer program was designed to sample this flat background plus smooth peak at random. When you pick only 20 or so events from such a peak, and another 40 or so from the flat background, you’ll get something that looks quite squiggly. The peak in the resulting plot can easily lie one or even two GeV/c2 away from the true mass, as in Figure 2; there can appear to be two peaks, as in Figure 3; the bin with the true mass can actually be empty, as in Figure 4. And the probability of the plot looking weird in some way, given this small amount of data, should not be underestimated — it’s maybe one in four or five.
The Implications
What’s the point? The photon-based and lepton-based measurements of the Higgs mass at ATLAS differ by 3 GeV/c2, which is bigger than we’ve seen here. So what? The photon-based mass measurement is 126.6±0.3±0.7 — the first uncertainty number is due to random statistics, the second is called “systematic” and includes experimental defects and other problems. So it has a systematic uncertainty of nearly a GeV/c2 (which is always ignored by the press, as though uncertainties don’t matter in interpreting what you actually know). Systematic uncertainties are often not random; they may give an overall shift to all the data, moving the peak uniformly up or down. And the lepton-based measurement is 123.5±0.9+0.4-0.2 GeV/c², which has an upward systematic uncertainty of almost half a GeV/c2. So if ATLAS got unlucky and their lepton-based result got pulled down by a couple of GeV/c2 purely due to the statistical effects we’ve seen today, and if they have small systematic problems of nearly a GeV/c2 in one or both of their measurements, they could potentially get a 3 GeV/c2 discrepancy.
Is such a big discrepancy likely? No; it is certainly possible, but it is certainly not very likely.
But here you have to remember how statistics works. If instead of asking “is this particular weird phenomenon likely” you had instead asked “is it likely that somewhere, in all of the measurements that ATLAS is making about the Higgs, one or two of them would have turned out weird”, the answer is “very likely indeed!” I’m writing and you’re reading a post about the mass measurement — and so are other bloggers and Scientific American and all the rest — because currently this is the one that looks odd. It could instead have been that there was a double peak in the photon-based plot, or that the lepton-based plot was showing no peak at all (simply because the signal rate fluctuated down from 20 events to 11, which is just 2 standard deviations.) Or the measurements of the spin and parity of the Higgs could be looking strange. In that case we’d be talking about those things instead. In July people were talking about the hint that the Higgs didn’t seem to be decaying to tau leptons; well that’s over and done.
In other words, there’s a tremendous bias both among scientists and the news media. We always talk about the outliers, the things that look odd to us. We make a big deal about them, and of course, to some extent we should. But we often forget that although these outliers look unlikely,
they aren’t generally as unlikely as they look to our brains, and
the probability of something being an outlier, when many things are being measured, is not small.
I personally think it would be enormously helpful if scientists would remind the news media of this well-known fact, and if the news media would convey it to the public. It would help the public understand how science is really done — and explain why it is so very common that the big story that you read about on the science pages simply disappears, after its 15 minutes of fame, without leaving a trace.
The most interesting outlier is ATLAS’s hint that the Higgs decays more often than expected to two photons; on this everyone (including the Scientific American journalist) agrees. We had that hint last December, in July, and still now. However, although CMS saw something somewhat similar in July, they’ve (somewhat disturbingly) delayed making their most recent data public on this measurement. So right now there’s still no way to know if this is more than a fluke, because the ATLAS result by itself is still not statistically significant.
Ok, everyone; by now you’ve all learned that the ATLAS experiment at the Large Hadron Collider [LHC] announced recently their measurement of the mass of the Higgs particle, in its decay to two photons, is at 126.6±0.3±0.7 GeV/c²; and meanwhile they measure the mass for apparently the same particle, in its decay to two lepton/anti-lepton pairs, to be 123.5±0.9+0.4-0.2 GeV/c², about 3 GeV/c² lower. “So bizarre”, wrote Michael Moyer at Scientific American, bandying about the idea that there are two Higgs-like bosons in this data (though, having pointed out the ambulance to you, and neglecting also to mention CMS’s data from November that directly disfavors this interpretation of the ATLAS data, he tells you later that some physics bloggers say you shouldn’t chase it…)
Well. How bizarre is this 2.7 standard deviation discrepancy really?
At the end of this post are 20 plots showing randomly generated data, in amounts comparable to those used in the current measurement of Higgs decaying to two lepton/anti-lepton pairs (often called “four leptons” for short). [Warning: This certainly hasn’t been done with the level of care needed to match the ATLAS measurement in any precise way; I’ll say a bit more below about the caveats.]
In some of the plots, there’s just a random flat background of about 40 events, similar (though not identical) to what arises in the four-lepton Higgs measurement.
In some of the plots, there’s a Higgs-like peak of about 20 events — a very sharp peak with a perfect detector, but one which is smoothed out a bit by the inevitable imperfections in a real particle detector.
In each plot with a peak, the mass of the Higgs has been chosen to lie somewhere between 122 GeV/c² and 127 GeV/c² [not equally populated].
So:
Can you tell which plots have a Higgs-like signal, and which ones don’t?
In each plot where there is a signal, can you estimate the Higgs mass? Again, in each plot, it lies somewhere between 122 and 127 GeV/c². You’re not going to get it exactly right — that’s impossible — but do your best, and let’s see what happens.
A couple of additional comments to help you:
The resolution on the measurement (i.e., the effect of imperfections in the measurement) is such that with infinite amounts of data, the peak that you’d observe would be a bump whose width, at half the bump’s maximum height, would be about 4 GeV/c².
The bins in each plot are 1 GeV/c² wide; the bin just to the right of the number 2 in “125” runs from 125 to 126, the next from 126 to 127, and so forth.
Lastly, a caveat: in the real ATLAS or CMS measurement, the mass of the Higgs is not measured simply by fitting a Gaussian peak over a flat background. So don’t take this exercise too seriously! It’s just a useful learning experience, and nothing more. What the experiments actually do is far more sophisticated, accounting for the properties of each event separately!!
Here we go: Good Hunting! (If your browser has trouble with the figure, try clicking on it.)
Twenty sets of simulated data, showing number of events versus the “mass” of a putative particle, in GeV/c2. Each contains about 40 events of a non-Higgs-like background that is flat in mass. Some but not all plots contain a signal which is in the form of a peak, comparable to the current size of the expected Higgs particle signal (about 20 events). In each case the mass of the Higgs is chosen between 122 and 127 GeV/c2. Experimental imperfections make the full-width of the signal peak at half its maximum about 4 GeV/c2 wide.
This is a post about constancy and inconstancy, one of my favorite topics. And about how alcohol can make you smarter.
There are many quantities that we call “constants of nature”. Of course, anything we call a “constant” is merely something that, empirically, appears to be constant, to the extent we can measure it. Everything we know comes from observation and experiment, and our knowledge is always limited by how good our measurements are.
We have pretty good evidence that a number of basic physical quantities are pretty much constant. A lot of evidence comes from the constancy of the colors of light waves (i.e. the frequencies of waves of electromagnetic radiation) that are emitted by different types of atoms, which appear to be very much the same from day to day and year to year and even across billions of years (neat trick! will describe that another time), and from here to the next country and on to the moon and to the sun and across our galaxy to distant galaxies. For example, if the electron mass changed very much over time and place, or if the strength of the electromagnetic force varied, then atoms, and the precise colors they emit, would also change. Since we haven’t ever detected such an effect, it makes sense to think of the electron mass and the electromagnetic force’s strength as constants of nature.
But they’re not necessarily exactly constant. One can always imagine they vary slowly enough across time or place that we wouldn’t have noticed it yet, with our current experimental technology. So it makes sense to look at very distant places and measure whatever we can to seek signs that maybe, just maybe, some of the constants actually vary after all.
Suppose they did vary? Well, the discovery of any variation whatsoever, in any quantity, would be a bombshell, and it would open up a door to an entirely new area of scientific research. Once one quantity were known to vary, it would be much more plausible that others vary too. For instance, if the electron mass varies, why not the W particle’s mass, which affects the strength of the weak nuclear force, and thereby radioactivity rates and the properties of supernovas? If the electromagnetic force strength varies, why not that of the strong nuclear force? There would be interest in understanding whether the variation is over space, over time, or both. Is it continuous and slow, or does it occur in jumps? One can imagine dozens of new experiments that would be proposed to study these questions — and the answers might reveal relations among the laws and “constants” of nature that we are currently completely unaware of, as well as giving us new insights into the history of the universe.
So it would be a very big deal. [Though I should note it would also be puzzling: even small variations in these constants would naively lead to large variations in the “dark energy” (i.e. cosmological “constant”) of the universe, which would potentially make the universe very inhomogeneous. However, we don’t understand dark energy, so this expectation might be too naive.] Since there’s no story about it on the front page of the New York Times, you can already guess that no variation’s been found. But a nice new measurement’s been done. (more…)
[Note Added: this afternoon the author of the Scientific American article made a few corrections. I leave it to you to judge for yourself whether he addressed the issues raised here.]
There’s been a little silliness floating around (sadly, in Scientific American, whose article contains at least two factual errors) unscientifically speculating that ATLAS’s new results on the Higgs-like particle, from data collected at the Large Hadron Collider [LHC], suggest there are two such particles rather than one. The mass measurement of this particle using the data when it decays to two photons, 126.6±0.3±0.7 GeV/c², is different, by 2.7 standard deviations, from the mass measurement obtained from its decays to two lepton/anti-lepton pairs, 123.5±0.9+0.4-0.2 GeV/c². So… huh… gee… maybe there are two Higgs-like particles, a lighter one which rarely decays to two photons and a heavier one which rarely decays to two lepton/anti-lepton pairs?
[Note Added: I should emphasize, lest anyone blame ATLAS for this implausible line of speculation, that in the ATLAS presentation last week, which was one of several presentations that morning, these two mass measurements were presented simply and responsibly, as results from data. Not a single speculative word was said about there being a hint of two Higgs particles. I don’t know who got the ball rolling on that idea, but it wasn’t ATLAS. And it’s not a plausible idea: see below.]
Take a deep breath. For not only would the two types of particles somehow have to be magically and implausibly arranged to mimic, at first glance and to a rough extent, a single Standard Model Higgs particle (the simplest possible type of Higgs particle), there’s another experiment, which unfortunately the writer of the Scientific American article neglected to consult.
ATLAS’s mass measurement from the events with two lepton/anti-lepton pairs also disagrees with CMS’s mass measurement obtained from the same type of events: 126.2±0.6±0.2 GeV/c². Two similar experimental detectors, same measurement, moderate disagreement. Nature is nature; there’s no way that ATLAS can be making one type of particle all the time, while CMS is making a different one all the time. So there is no evidence here, taking ATLAS and CMS together, favoring the existence of a separate particle with a mass of about 123.5 GeV/c² that decays to two lepton/anti-lepton pairs.
What is behind these discrepancies, then? ATLAS and CMS each have scarcely a dozen of these two lepton/anti-lepton events, and their extraction of the Higgs particle’s mass from each event is somewhat uncertain, which is why many events are required for a good mass measurement. When you still have small amounts of data, funny statistical fluctuations will often occur. We’ve seen this before; back in 1989, when the Stanford Linear Collider (SLC) produced its first few Z particles at the Stanford Linear Accelerator Center, the plot of the Z particle’s mass gave a double resonance peak, instead of the single peak that was expected. A brief moment of speculation occurred, but with more data the anticipated single peak structure emerged. I’ve heard at least one other similar story from an earlier decade. In fact ATLAS and CMS had a 2 GeV mass discrepancy when the first Higgs hints came in; that was just an effect of statistics. Combine a fluctuation of this form with a minor detector calibration problem, and you’ll get discrepancies like this.
Multiple types of Higgs particles are certainly possible; people have considered this scenario for decades, and I’ve written about it here, for instance. Efforts to search for a second type of Higgs particle have been going on since the discovery of the first one. But let’s not manufacture one out of thin air by looking selectively at the data; that’s not how reliable science gets done.
At the CERN laboratory today, there’s an ongoing report to the CERN council that oversees the lab, and this includes talks from the Large Hadron Collider [LHC] accelerator operators, and from the experimentalists who built and operate the detectors (ATLAS, CMS, LHCb, ALICE, TOTEM) that are designed to detect and interpret the debris from the LHC’s proton-proton collisions. Among the results being presented today are some measurements of the properties of the Higgs-like particle whose discovery was announced in July, including ones that were notably missing from the HCP conference presentations in Kyoto last month.
Here are some highlights, to be fleshed out in more detail later, if warranted.
LHC accelerator operations report:
An excellent year. In the best week the LHC produced 1.35 inverse femtobarn (fb) of data for both ATLAS and CMS; as of December 5, LHC produced 23.2 inverse fb for the year per experiment (note each experiment will have somewhat less recorded, due to normal losses), slightly above the target for the year.
Biggest problems: beam instability (much bigger problem in 2012 than 2011); stray high-energy particles affecting electronics in the tunnel; dust falling out of the beampipe into the beam, potentially a significant problem for 2015.
After the 2013-2014 shutdown, what will be the likely running conditions in 2015? The current intention is to go to 25 nanoseconds between collisions (the design) rather than the 50 nanoseconds used in 2012, and to start at 13 TeV per collision.
ATLAS: New two-photon and four-lepton measurements; new spin and parity measurements.
Two photons: new categories of events added, with either 1 lepton or of two jets at low invariant mass, characteristic of production of a Higgs with a Z or W.
This channel now shows 6.1 standard deviation significance (3.3 expected) by itself: discovery of a Higgs-like particle in a single decay mode. Mass 126.6±0.3±0.7 GeV/c²
Signal remains high: 1.8 ± 0.3 + 0.29 – 0.21 times the Standard Model expectation. (But note the expectation depends somewhat on the assumed mass of the Higgs; not sure yet which mass was taken here. 126.6 GeV was assumed.)
Four leptons: 4.1 standard deviations, signal strength 1.3 ± 0.4 times Standard Model expectation. Mass 123.5±0.9+0.4-0.2 GeV/c² — notably lower than two photons.
The two mass measurements are 3 GeV apart (surprising but not impossible given the amount of data; or perhaps there is a technical problem somewhere, though I’m sure they looked very, very hard for one). They are compatible only at 2.7 standard deviations. Combined mass: 125.2 +- 0.3 +- 0.6 GeV/c²
Spin (from photons): spin 2 disfavored at the 91% level; compatible with spin 0.
Spin (from leptons): spin 2 disfavored only at the 85% level; compatible with spin 0.
Parity (from leptons): Exclusion of odd-parity spin-0 particle at 99%.
CMS:
First limit on Higgs decay to Z + photon: although still ~20 times the Standard Model expectation, this limit is good enough to rule out various non-standard interpretations of the Higgs-like particle.
No update of Higgs decay to two photons. This is too bad. It’s somewhat exciting that ATLAS’s result on Higgs decay to two photons remains somewhat high compared to expectations. But the excess is still not yet 3 standard deviations. Deviations of this size do come and go. And we don’t have confirmation from CMS. So the situation remains tantalizing but unfortunately not yet very convincing. We may not learn anything more from CMS or ATLAS til March, when they have analyzed the full 2012 data set.
I did not catch anything new from LHCb or ALICE; generally I haven’t had time to cover ALICE’s research program here. TOTEM, a special purpose detector for measuring things I haven’t discussed on this website, is still getting rolling.