Prepare for robot nonsense

February 26, 2018

Pär SegerdahlAs computers and robots take over tasks that so far only humans could carry out, such as driving a car, we are likely to experience increasingly insidious uses of language by the technology’s intellectual clergy.

The idea of ​​intelligent computers and conscious robots is for some reason terribly fascinating. We see ourselves as intelligent and conscious beings. Imagine if also robots could be intelligent and aware! In fact, we have already seen them (almost): on the movie screen. Soon we may see them in reality too!

Imagine that artifacts that we always considered dead and mechanical one day acquired the enigmatic character of life! Imagine that we created intelligent life! Do we have enough exclamation marks for such a miracle?

The idea of ​​intelligent life in supercomputers often comes with the idea of a test that can determine if a supercomputer is intelligent. It is as if I wanted to make the idea of ​​perpetual motion machines credible by talking about a perpetuum mobile test, invented by a super-smart mathematician in the 17th century. The question if something is a perpetuum mobile is determinable and therefore worth considering! Soon they may function as engines in our intelligent, robot-driven cars!

There is a famous idea of ​​an intelligence test for computers, invented by the British mathematician, Alan Turing. The test allegedly can determine whether a machine “has what we have”: intelligence. How does the test work? Roughly, it is about whether you can distinguish a computer from a human – or cannot do it.

But distinguishing a computer from a human being surely is no great matter! Oh, I forgot to mention that there is a smoke screen in the test. You neither see, hear, feel, taste nor smell anything! In principle, you send written questions into the thick smoke. Out of the smoke comes written responses. But who wrote/generated the answers? Human or computer? If you cannot distinguish the computer-generated answers from human answers – well, then you had better take protection, because an intelligent supercomputer hides behind the smoke screen!

The test is thus adapted to the computer, which cannot have intelligent facial expressions or look perplexed, and cannot groan, “Oh no, what a stupid question!” The test is adapted to an engineer’s concept of intelligent handling of written symbol sequences. The fact that the test subject is a poor human being who cannot always say who/what “generated” the written answers hides this conceptual fact.

These insidious linguistic shifts are unusually obvious in an article I encountered through a rather smart search engine. The article asks if machines can be aware. And it responds: Yes, and a new Turing test can prove it.

The article begins with celebrating our amazing consciousness as “the ineffable and enigmatic inner life of the mind.” Consciousness is then exemplified by the whirl of thought and sensation that blossoms within us when we finally meet a loved one again, hear an exquisite violin solo, or relish an incredible meal.

After this ecstatic celebration of consciousness, the concept begins to be adapted to computer engineering so that finally it is merely a concept of information processing. The authors “show” that consciousness does not require interaction with the environment. Neither does it require memories. Consciousness does not require any emotions like anger, fear or joy. It does not require attention, self-reflection, language or ability to act in the world.

What then remains of consciousness, which the authors initially made it seem so amazing to possess? The answer in the article is that consciousness has to do with “the amount of integrated information that an organism, or a machine, can generate.”

The concept of consciousness is gradually adapted to what was to be proven. Finally, it becomes a feature that unsurprisingly can characterize a computer. After we swallowed the adaptation, the idea is that we, at the Grand Finale of the article, should once again marvel, and be amazed that a machine can have this “mysterious inner life” that we have, consciousness: “Oh, what an exquisite violin solo, not to mention the snails, how lovely to meet again like this!”

The new Turing test that the authors imagine is, as far as I understand, a kind of picture recognition test: Can a computer identify the content of a picture as “a robbery”? A conscious computer should be able to identify pictorial content as well as a human being can do it. I guess the idea is that the task requires very, very much integrated information. No simple rule of thumb, man + gun + building + terrified customer = robbery, will do the trick. It has to be such an enormous amount of integrated information that the computer simply “gets it” and understands that it is a robbery (and not a five-year-old who plays with a toy gun).

Believing in the test thus assumes that we swallowed the adapted concept of consciousness and are ecstatically amazed by super-large amounts of integrated information as: “the ineffable and enigmatic inner life of the mind.”

These kinds of insidious linguistic shifts will attract us even more deeply as robotics develop. Imagine an android with facial expression and voice that can express intelligence or groan at stupid questions. Then surely, we are dealing an intelligent and conscious machine!

Or just another deceitful smoke screen; a walking, interactive movie screen?

Pär Segerdahl

This post in Swedish

The temptation of rhetoric - the ethics blog

The Nobel Prize in Economic Sciences

October 10, 2017

Pär SegerdahlIn the old days, economists received the Nobel Prize for identifying the human with an economic ideal of rationality.

Nowadays, they are awarded the Nobel Prize for pointing out that the human is not rational.

Apparently, economists know how to maximize Nobel Prize wins using an intellectual capital they never had. 🙂

Pär Segerdahl

Following the news - the ethics blog

Moral panic in the intellect

September 6, 2017

Pär SegerdahlMoral panic develops intellectually. It is our thoughts that are racing. Certain mental images make such a deep impression on us that we take them for Reality, for Truth, for Facts. Do not believe that the intellect is cold and objective. It can boil over with agitated thoughts.

This is evident in bioethics, where many issues are filled with anguish. Research information about cloned animals, about new techniques for editing in the genome, or about embryonic stem cell research, evoke scary images of subversive forms of research, threatening human morality. The panic requires a sensitive intellect. There, the images of the research acquire such dimensions that they no longer fit into ordinary life. The images take over the intellect as the metaphysical horizon of Truth. Commonplace remarks that could calm down the agitated intellect appear to the intellect as naive.

A science news in National Geographic occasions these musings. It is about the first attempt in the United States to edit human embryos genetically. Using so-called CRISPR-Cas9 technique, the researchers removed a mutation associated with a common inherited heart disease. After the successful editing, the embryos were destroyed. (You find the scientific article reporting the research in Nature.)

Reading such research information, you might feel anxiety; anxiety that soon takes possession of your intellect: What will they do next? Develop “better” humans who look down on us as a lower species? Can we permit science to change human nature? NO, we must immediately introduce new legislation that bans all genetic editing of human embryos!

If the intellect can boil over with such agitated thoughts, and if moral panic legislation is imprudent, then I believe that bioethics needs to develop its therapeutic skills. Some bioethical issues need to be treated as affections of the intellect. Bioethical anxiety often arises, I believe, when research communication presents science as the metaphysical horizon of truth, instead of giving science an ordinary human horizon.

It may seem as if I took a stand for science by representing critics as blinded by moral panic. That is not the case, for the other side of moral panic is megalomania. Hyped notions of great breakthroughs and miraculous cures can drive entire research fields. Mental images that worry most people stimulate other personalities. Perhaps Paolo Macchiarini was such a personality, and perhaps he was promoted by a scientific culture of insane mental expectations on research and its heroes.

We need a therapeutic bioethics that can calm down the easily agitated intellect.

Pär Segerdahl

This post in Swedish

We think about bioethics :

Internal investigation of research misconduct often fails

May 30, 2017

Pär SegerdahlWhat characterizes a research scandal? In a short article in Hastings Center Report, Carl Elliott uses as an example the case of Paolo Macchiarini at the Swedish Karolinska Institutet.

Macchiarini’s deadly experiments with stem cell-covered artificial trachea, transplanted to patients who did not have life-threatening diseases, have unique features linked to the personality and charisma of the researcher. However, the scandal resembles other scandals on one point, Elliott says. Whistle-blowers who use internal channels at the home university to handle research misconduct often fail. Justice is not done until the press reveals the scandal. In this case, a Swedish documentary film, The Experiments, exposed the scandal.

If Elliott is right, I personally draw two conclusions. The first is that investigative journalism is important. It reveals misconduct that would otherwise not be exposed. My second conclusion is that we cannot be satisfied with this.

Angry customers who want to force the shop assistant to correct what they think went wrong can threaten: “If you don’t fix this, I’ll contact the local newspaper.” A responsible person who suspects research misconduct should not have to act in a way that others can interpret as partial exercise of power. It poisons the situation and increases the risk for the whistle-blower.

If internal channels often fail to handle research misconduct, as Elliott claims, a system of external management is required. Therefore, it is good that a Swedish public inquiry recently suggested that an independent agency should investigate suspected research misconduct.

Contacting the media should not have to be “the way” of effectively exposing research misconduct; it is a way out if the standard way fails. If the way out often is required, something is wrong with the way.

Pär Segerdahl

This post in Swedish

We want solid foundations - the Ethics Blog

The New Yorker features resignation syndrome

March 29, 2017

Pär SegerdahlLast year I wrote a post about resignation syndrome in children in families who are denied asylum in Sweden. I described a hypothesis about the syndrome suggested by Karl Sallin, PhD student at CRB in the field of neuroethics and neurophilosophy.

An intuitive explanation is that the syndrome is a reaction to prolonged stress and depression. A reaction that is triggered when the family is denied asylum. However, if the explanation is correct, the syndrome should exist on a similar scale also in other countries that receive refugee families. It seems it does not.

To understand what happens to these children, we should, Karl Sallin suggested, see it as a psychological reaction that occurs in the meeting between certain cultures and Swedish cultural conditions. For another peculiarity is the fact that the syndrome occurs mainly in families from certain parts of the world. We are dealing with a culture bound psychopathology, Sallin proposed in Frontiers in Behavioral Neuroscience.

The New Yorker recently wrote about this “Swedish” syndrome, in a long article in which Karl Sallin interviewed.

The article contains a touching description of how one of these children falls ill when the family is denied asylum. For several months, he is confined to bed, not contactable, and he must be tube fed. When the family gets permanent residence, they try to convey this to the boy. After two weeks, he begins to open his eyes. After a further seven weeks, the nasal tube taped to his cheek falls out. Finally, he can return to school and begin to talk about the disease.

The article in The New Yorker emphasizes that the syndrome is a culture-bound psychopathology. However, the tendency seems to be to point out Sweden’s crumbling self-image as the relevant cultural context for the disease. We see “apathetic refugee children” as symbols of our own moral failure to treat them and their families humanely. Therefore, we tube feed them without further treatment, while waiting for the family to hopefully get their residence permit. This creates a culture where children become sick when their families are denied asylum.

This can hardly be the whole explanation, since it then becomes difficult to understand why mainly children from certain parts of the world are afflicted. Moreover, mainly children who come together with their families, rather than unaccompanied refugee children. The cultural dynamics seems to be more complex than the desire to find scapegoats for the syndrome can handle.

Pär Segerdahl

This post in Swedish

We want to be just - the Ethics Blog

Commercialization, but not at any price

February 14, 2017

Pär SegerdahlIn a previous post, I tried to make the point that the pharmaceutical industry can support altruism between research participants and patients, despite the fact that the industry itself is not altruistic but is driven by profit. Medical research will not benefit patients, unless results are developed into commercially available treatments.

However, this presupposes, of course, that pricing is reasonable, so that we can actually afford the drugs. Otherwise, research and research participation become meaningless.

Today, I just want to recommend an article in the journal Cell, where the authors argue that the prices of new cancer drugs have become indefensibly high. They propose new collaborations between academic researchers and small companies, to offer cancer drugs at more reasonable prices. Researchers should ensure that the companies they work together with are willing to sell the drugs with smaller profit margins.

You can find a summary of these ideas in The Guardian.

Pär Segerdahl

Workman, P. Draetta, G. F., Schellens, J. H. M., Bernards, R. (2017). How much longer will we put up with $100,000 cancer drugs? Cell 168: 579-583.

This post in Swedish

We recommend readings - the Ethics Blog

Not just facts, ideas are also needed

February 8, 2017

Pär SegerdahlWhen fraudulent “academic” journals publish articles without proper peer review. When websites online spread fake information. When politicians talk about alternative facts. Then undeniably, one feels a need for a general tightening up.

A possible problem in this reaction is that we castrate ourselves. That we don’t dare to propose and discuss ideas about the situation we are in. That we don’t dare to think, interpret and analyze. Because we fear being found guilty of error and of contributing to the scandalous inflation of facts and truths.

We hide ourselves in a gray armor of objectivity. In order not to resemble what we react to.

But why do these tendencies occur now? Is it about the internet? Is it about neglected groups of citizens? Is it about economic and political shifts in power?

In order to understand this complex situation and act wisely, we need not just facts but also good questions, thoughts, interpretations and analyses of the situation. If we take that task seriously, we also take relevant facts seriously when we discuss the ideas.

If we react with hypercorrection, with an armor of correctness, we risk repressing our questions about how we should think about our situation. We repress our uncertainty: the motive for thinking, interpreting and analyzing.

Pär Segerdahl

This post in Swedish

We care about communication - the Ethics Blog

%d bloggers like this: