Monkey classification errors

More Wynne & Udell (2013):

Michael D’Amato and Paul van Sant (1988) trained Cebus apella monkeys to discriminate slides containing people from those that did not. The monkeys readily learned to do this. Then the monkeys were presented with novel slides they had never seen before which contained either scenes with people or similar scenes with no people in them. Here also the monkeys spontaneously classified the majority of slides correctly. So far, so good – clear evidence that the monkeys had not just learned the particular slides they had been trained on but had abstracted a person concept from those slides that they then successfully applied to pictures they had never seen before.

Or had they? D’Amato and van Sant did not stop their analysis simply with the observation that the monkeys had successfully transferred their learning to novel slides – rather they went on to look carefully at the kinds of errors the monkeys had made. Although largely successful with the novel slides, the monkeys made some very puzzling mistakes. For example, one of the person slides that the monkeys had failed to recognize as a picture of a human being had been a head and shoulders portrait – which, to another human, is a classic image of a person. One of the slides that the monkeys had incorrectly classified as containing a human had actually been a shot of a jackal carrying a dead flamingo in its mouth; both the jackal and its prey were also reflected in the water beneath them. What person in her right mind could possible confuse a jackal with a flamingo in its mouth with another human being?

The explanation for both these mistakes is the same: the monkeys had generalized on the basis of the particular features contained in the slides they had been trained with rather than learning the more abstract concept that the experimenters had intended. The head and shoulders portrait of a person lacked the head-torso-arms-legs body shape that had been most common among the images that the monkeys had been trained with, and consequently, they had rejected it as not similar enough to the positive image they were looking for. Similarly, during training, the only slides that had contained flashes of red happened to be those of people. Three of the training slides had contained people wearing a piece of red clothing, whereas none of the nonperson slides had contained the color red. Consequently, when the jackal with prey slide came along during testing, it contained the color red, and so the monkeys classified it as a person slide.

Adversarial examples for pigeons

From Wynne & Udell (2013):

Michael Young and colleagues carried out experiments that add to a sense that the pigeon’s perception of pictures of objects is not identical to our own. They trained pigeons to peck in different locations on a computer-controlled touch screen, depending on which of four different objects was presented: an arch, a barrel, a brick, and a triangular wedge (Young et al., 2001). The objects were initially presented to the pigeons as images shaded to suggest light shining on them from one direction. Next, Young and colleagues tested the pigeons with pictures of the same objects, but this time illuminated from a different direction… To the experimenters’ surprise, the pigeons’ ability to recognize the objects was disturbed by changes in lighting that human observers were barely able to perceive… [see below]

pigeons study

Books, music, etc. from April 2017

Books

  • Callahan, The Givers. An interesting quick portrait of contemporary mega-philanthropy. I haven’t bothered to form opinions about the recommendations in the final chapter.
  • Walters, Feminism: A Very Short Introduction. Meh.

Music

Music I most enjoyed discovering this month:

Movies/TV

Ones I “really liked” (no star), or “loved” (star):

  • Ade: Toni Erdmann (2016)
  • Guadagnino: A Bigger Splash (2016)
  • Yeon: Train to Busan (2016)

Media I’m looking forward to, May 2017 edition

Books

* = added this round
bold = especially excited

[Read more…]

Books, music, etc. from March 2017

Books

  • Dormehl, Thinking Machines. This “history” of AI is mostly a quick survey of news stories about AI progress from the past three years.
  • Wood, The Way of the Strangers. Quite good, afaict.
  • Barrett, How Emotions Are Made. The book is a mixed bag, but fwiw I find this general approach more promising than Ekman/Panksepp/etc. Best Cliffs Notes is maybe this interview.

Music

Music I most enjoyed discovering this month:

Movies/TV

Ones I “really liked” (no star), or “loved” (star):

  • Birbiglia & Barrish, Sleepwalk with Me (2012)
  • Carloni & Nelson, Kung Fu Panda 3 (2016)
  • Blair, I Don’t Feel at Home in This World Anymore (2017)
  • Fukunaga, Beasts of No Nation (2015) ★
  • Audiard, Dheepan (2015)
  • Ferreras, Wrinkles (2011)

A few thoughts for religious believers struggling with doubts about their faith

In various places on my old atheism blog, I mention that I’m willing to engage in a bit of email correspondence with religious believers who are struggling with their faith, or who have recently deconverted, and who are feeling a bit lost, worried about nihilism without religion, and so on.

I noticed recently that my first email reply to most people who contact me about this is roughly the same, so I might as well write it up publicly so I can link to it.

Here, then, is my “FAQ for the sort of person who usually contacts me about how they’re struggling with their faith, or recently deconverted.”

 

Now that I’m losing my faith, I’m worried that nothing really matters, and that’s depressing.

I remember that feeling. I was pretty anxious and depressed when I started to realize I didn’t have good reasons for believing the doctrines of the religion I’d been raised in. But as time passed, things got better, and I emotionally adjusted to my “new normal,” in a way that I thought couldn’t ever happen before I got there.

I’ve collected some recommended reading on these topics here; see also the more recent The Big Picture. It’s up to you to decide what your goals and purposes are, but I think there are plenty of purposes worth getting excited about and invested in. In my case that’s effective altruism, but that’s a personal choice.

But really, my primary piece of advice is to just let more time pass, and spend time socially with non-religious people. Your conscious, deliberative brain (“system 2“) might be able to rationally recognize that of course millions of non-religious people before you have managed to live lives of immense joy and purpose and so on, and therefore you clearly don’t need religion for that. But if you were raised religiously like I was, then it might take some time for your unconscious, intuitive, emotional brain (“system 1“) to also “believe” this. The more time you spend talking with non-religious people who are living fulfilling, purposeful lives, the more you’ll train your system 1 to see that it’s obvious that meaning and purpose are possible without any gods — and getting your system 1 to “change its mind” is probably what matters more.

Where I live in the San Francisco Bay Area, it seems that most people I meet are excitedly trying to “make the world a better place” in some way (as parodied on the show Silicon Valley), and virtually none of them are religious. Depending on where you live, it might not be quite so easy to find non-religious people to hang out with. You could google for atheist or agnostic meetups in your area, or at least in the nearest large city. You could also try attending a UU church, where most people seem to be “spiritual” but not “religious” in the traditional sense.

My spouse and/or kids are religious, and my loss of faith is going to be super hard on them.

Yeah, that’s a tougher situation. I don’t know anything about that. Fortunately there’s a recent book entirely about that subject; I hope it helps!

Thanks, I’ll try those things. But I think I need more help.

I would try normal psychotherapy if you can afford it. Or maybe better, try Tom Clark, who specializes in “worldview counseling.”

Books, music, etc. from February 2017

Books

  • Dennett, From Bacteria to Bach and Back. Generally good, though it’s mostly a “tools for thinking” book like Dennett (2013) or Yudkowsky (2015), not a detailed argument for a specific theory of consciousness like Prinz (2012), Dehaene (2014), or even Dennett (1991).
  • Kranish & Fisher, Trump Revealed. Meh, you know most of it already if you followed the campaign.
  • Harari, Homo Deus. Fun to read, not much else. Surprisingly little of it is about the future.

Music

Music I most enjoyed discovering this month:

Movies/TV

Ones I “really liked” (no star), or “loved” (star):

  • Larraín, Jackie (2016)
  • Craig, The Edge of Seventeen (2016) ★
  • Lonergan, Manchester by the Sea (2016) ★
  • Davis, Lion (2016)
  • Jenkins, Moonlight (2016)
  • Washington, Fences (2016)
  • Scorsese, Silence (2016)
  • Ford, Nocturnal Animals (2016) ★
  • Cresciman, Sun Choke (2016)
  • Bujalski, Results (2015) ★
  • Ergüven, Mustang (2015) ★

Media I’m looking forward to, March 2017 edition

Books

* = added this round
bold = especially excited

[Read more…]

How long does it take to identify, mitigate, and remediate a major problem?

Baiocchi & Welser (2010):

…we conducted a literature survey on each of the [problems comparable to the problem of space debris]. We then determined the length of time spent in each stage (problem identification, establishment of normative behaviors, mitigation, and remediation) based on research from periodical sources, legislative records, and court rulings… Finally, we inspected each timeline and made a judgment about the approximate year in which each problem entered a new stage… The result is shown in Figure 6.1, and it provides a notional comparison that shows how each of the problems progressed through the four stages.

Figure 6.1

Could be interesting to see this kind of analysis for a greater range of societal challenges, or sets of challenges chosen for how similar they are to a different target case. (The target case for this report was space debris.)

A utilitarian foundation?

The introduction to Jacobson (1984) makes it sound as though the John A. Hartford Foundation was roughly cause-neutral and utilitarian in its approach, at least for some of its history:

The 1958 annual report of the Hartford Foundation describes its starting point:

Neither John Hartford nor his brother George, in their bequests to the organization, expressed any wish as to how the funds they provided should be used… Our benefactors’ one common request was that the Foundation strive always to do the greatest good for the greatest number.

…If available funds are to be used effectively, it is necessary to carve from the whole vast spectrum of human needs one small band that the heart and mind together tell you is the area in which you can make your best contribution.

The first task of the Foundation was thus to define the greatest good. Basing its decision on the pattern of John Hartford’s previous giving, the Foundation chose to support biomedical, largely clinical, research. Between 1954 and 1979, the Hartford Foundation participated in some of the most important advances in modern medicine, supplied hospitals and medical centers with equipment that reflected those advances, provided for the training of a generation of researchers, saved countless lives, and involved itself deeply in the burgeoning of the current health care crisis. In that period, the Foundation spent close to $175 million [presumably this is 1984 dollars, i.e. $408 million in 2016 dollars].

…Many modern research-supporting institutions have chosen to bear the costs of close supervision and peer review in order to ensure the quality of projects supported either directly or indirectly by the public. But both the trustees and the staff of the Hartford Foundation came from a background that stressed minimizing administrative costs so as to maximize benefits to the public. During the Foundation’s first seven years as a leading source of funds for biomedical research, the full-time staff consisted of one person. To achieve quality control at low cost, the Foundation adopted a policy of hiring consultants as they were needed to review particular grant applications.

As a matter of policy, too, the Foundation tried to fund projects and types of research that could not obtain funding from other sources. For example, the Hartford Foundation was the first to pay for the patient-bed costs of clinical research. Filling this gap was clearly desirable. But the Foundation also supported some researchers whose theories or personalities inspired skepticism in their colleagues. These grants were calculated risks. Many of the projects thus supported were unsuccessful; a few have produced major advances in clinical medicine.

When these successes occurred, the Hartford Foundation could have chosen to publicize its role in them. But John and George Hartford disliked publicity. The trustees and staff made this family trait a matter of policy. They believed that being in the public eye was tasteless, a waste of time, and likely to produce an excess of grant requests unmanageable by a small staff. As a result, the pool of grant applicants was limited largely to those who heard about the Foundation by word of mouth — from past grantees or consultants.

Probably the truth is more complicated; I haven’t investigated the foundation’s history closely. Note also that the foundation seems to have cared a lot about the overhead ratio, whereas today’s effective altruists tend to think overhead ratio considerations should be subordinate to impact per dollar.

Have any of my readers heard of any other charitable foundations aspiring to be (roughly) cause-neutral and utilitarian in their approach?

Bill Koch, romancer

Pretty sure my friends’ nerdy-romantic messages are cleverer than Bill Koch’s:

[Bill Koch’s lover] referred to herself in a separate fax as a “wet orchid” who yearned for warm honey to be drizzled on her body. In another, she wrote: “My poor nerve endings are already hungry. You are creating such a wanton woman. I can feel those kisses, and every inch of my body misses you.”

Bill’s far-less-sensuous facsimiles displayed the MIT-trained engineer’s geeky side: “I cannot describe how much I look forward to seeing you again,” he wrote. “It is beyond calculation by the largest computers.” In another fax, he jotted an equation to express his devotion, ending with a hand-drawn heart and, within it, the mathematical symbol for infinity.

Books, music, etc. from January 2017

Books

  • Lewis, The Undoing Project. Fine, I guess. Knowing the studies already, I found the late-chapter parts about Kahneman & Tversky’s “breakup” most interesting.
  • Gazzaniga, Tales from Both Sides of the Brain. Mostly interesting.
  • Mayer, Dark Money. The American poor are doomed.

Music

Music I most enjoyed discovering this month:

Movies/TV

Ones I really liked, or loved:

  • Soderbergh, Behind the Candelabra (2013)
  • Gibson, Hacksaw Ridge (2016)
  • Egoyan, Remember (2015)

Media I’m looking forward to, February 2017 edition

Books

* = added this round
bold = especially excited

[Read more…]

Friedman on economics chairs

Funny comment in a 1990 letter penned by Milton Friedman, quoted in Blundell (2007), p. 47:

I have personally been impressed by the extent to which the growing acceptability of free private-market ideas has produced a lowering of the average intellectual quality of those who espouse those ideas. This is inevitable, but I believe it has been fostered by… the creation of free-enterprise chairs of economics. I believe that they are counterproductive.

Scott Aaronson on order and chaos

Yup:

One of my first ideas was to write about the Second Law of Thermodynamics [in response to Edge.org’s Annual Question], and to muse about how one of humanity’s tragic flaws is to take for granted the gargantuan effort needed to create and maintain even little temporary pockets of order. Again and again, people imagine that, if their local pocket of order isn’t working how they want, then they should smash it to pieces, since while admittedly that might make things even worse, there’s also at least 50/50 odds that they’ll magically improve. In reasoning thus, people fail to appreciate just how exponentially more numerous are the paths downhill, into barbarism and chaos, than are the few paths further up. So thrashing about randomly, with no knowledge or understanding, is statistically certain to make things worse: on this point thermodynamics, common sense, and human history are all in total agreement. The implications of these musings for the present would be left as exercises for the reader.

Or, in cartoon form:

different

So apparently this is why we have positive psychology but not evidence-based psychological treatment

Here’s Marty Seligman, past president of the American Psychological Association (APA):

APA presidents are supposed to have an initiative and… I thought mine could be “evidence-based treatment and prevention.” So I went to my friend, Steve Hyman, the director of [National Institute of Mental Health]. He was thrilled and told me he would chip in $40 million dollars if I could get APA working on evidence-based treatment.

So I told CAPP [which owns the APA] about my plan and about NIMH’s willingness. I felt the room get chillier and chillier. I rattled on. Finally, the chair of CAPP memorably said, “What if the evidence doesn’t come out in our favor?”

…I limped my way to [my friend’s] office for some fatherly advice.

“Marty,” he opined, “you are trying to be a transactional president. But you cannot out-transact these people…”

And so I proposed that Psychology turn its… attention away from pathology and victimology and more toward what makes life worth living: positive emotion, positive character, and positive institutions. I never looked back and this became my mission for the next fifteen years. The endeavor… caught on.

My post title is sort-of joking. Others have pushed on evidence-based psychology while Seligman focused on positive psychology, and Seligman certainly wouldn’t say that we “don’t have” evidence-based psychological treatment. But I do maintain that evidence-based psychology is not yet as well-developed as evidence-based medicine, even given EBM’s many problems.

Books, music, etc. from December 2016

Books

  • Goodale & Milner, Sight Unseen, 2e. Pretty thrilling if you’re unfamiliar with the subject matter (as I was). Unfortunately, its presentation of the evidence is very one-sided.
  • Bloom, Against Empathy. Probably one of the best not-explicitly-EA books to give someone if you want to nudge them toward EA.

Music

Music I most enjoyed discovering this month:

Movies/TV

Ones I really liked, or loved:

  • Mackenzie, Hell or High Water (2016)
  • Stanton & MacLane, Finding Dory (2016)
  • Yates, Fantastic Beasts and Where to Find Them (2016)
  • Chazelle, La La Land (2016)

Media I’m looking forward to, January 2017 edition

Books

* = added this round
bold = especially excited

[Read more…]

Favorite podcasts of 2016

(Unordered.)

* = added after original publication of this list

Top favorites

  • Vox’s The Weeds (policy analysis)
  • Crimetown (true crime)
  • Planet Money (economics)
  • Homecoming (drama)
  • StartUp Podcast (stories about startups)
  • In the Dark (true crime)
  • More Perfect (stories about the Supreme Court)
  • Radiolab (stories about science-ish stuff)
  • Casefile (true crime)
  • Reply All (stories about the internet)
  • Serial, Season 2 (story of Bowe Bergdahl)
  • This American Life (stories about all kinds of stuff)

[Read more…]