Fourmilog: None Dare Call It Reason

Your Sky and Solar System Live Updates

Wednesday, February 6, 2019 23:16

I have posted an overhaul of the Web pages supporting Your Sky and Solar System Live. The Your Sky Object Catalogues for asteroids by name, asteroids by number, and periodic comets now include links both to show the current position of the object in the sky in Your Sky and, for objects in non-hyperbolic orbits, plot the orbit in Solar System Live, automatically selecting a plot of the inner or full solar system depending upon the semi-major axis of the object's orbit.

The Object Catalogue files have been upgraded in style and typography from the 1990s to the eve of the Roaring Twenties, and a common CSS file defines the style for all files. The automatically-generated catalogues for asteroids and comets are all now XHTML 1.0 Strict (some of the other catalogues remain Transitional); all have passed validation. A new logo was developed which is compatible with a white background and used in all of the pages. All static GIF files in the Your Sky document tree have been converted to PNG. Information in the Object Catalogue planets page for Pluto has been updated to reflect data from the New Horizons fly-by.

All of the request pages for Your Sky maps which contain the latitude and longitude of the observer's site now use a free geolocation server to guess the requester's location from their IP address. (This is dodgy, but even when it falls on its face, it's usually better than the alternative of simply filling in Fourmilab's co-ordinates until the user enters something else.) The main Your Sky pages are now all XHTML 1.0 Strict. (Some of the help file pages remain Transitional.)

Back

Reading List: At Our Wits' End

Saturday, February 2, 2019 16:08

Dutton, Edward and Michael A. Woodley of Menie. At Our Wits' End. Exeter, UK: Imprint Academic, 2018. ISBN 978-1-84540-985-2.
During the Great Depression, the Empire State Building was built, from the beginning of foundation excavation to official opening, in 410 days (less than 14 months). After the destruction of the World Trade Center in New York on September 11, 2001, design and construction of its replacement, the new One World Trade Center was completed on November 3, 2014, 4801 days (160 months) later.

In the 1960s, from U.S. president Kennedy's proposal of a manned lunar mission to the landing of Apollo 11 on the Moon, 2978 days (almost 100 months) elapsed. In January, 2004, U.S. president Bush announced the “Vision for Space Exploration”, aimed at a human return to the lunar surface by 2020. After a comical series of studies, revisions, cancellations, de-scopings, redesigns, schedule slips, and cost overruns, its successor now plans to launch a lunar flyby mission (not even a lunar orbit like Apollo 8) in June 2022, 224 months later. A lunar landing is planned for no sooner than 2028, almost 300 months after the “vision”, and almost nobody believes that date (the landing craft design has not yet begun, and there is no funding for it in the budget).

Wherever you look: junk science, universities corrupted with bogus “studies” departments, politicians peddling discredited nostrums a moment's critical thinking reveals to be folly, an economy built upon an ever-increasing tower of debt that nobody really believes is ever going to be paid off, and the dearth of major, genuine innovations (as opposed to incremental refinement of existing technologies, as has driven the computing, communications, and information technology industries) in every field: science, technology, public policy, and the arts, it often seems like the world is getting dumber. What if it really is?

That is the thesis explored by this insightful book, which is packed with enough “hate facts” to detonate the head of any bien pensant academic or politician. I define a “hate fact” as something which is indisputably true, well-documented by evidence in the literature, which has not been contradicted, but the citation of which is considered “hateful” and can unleash outrage mobs upon anyone so foolish as to utter the fact in public and be a career-limiting move for those employed in Social Justice Warrior-converged organisations. (An example of a hate fact, unrelated to the topic of this book, is the FBI violent crime statistics broken down by the race of the criminal and victim. Nobody disputes the accuracy of this information or the methodology by which it is collected, but woe betide anyone so foolish as to cite the data or draw the obvious conclusions from it.)

In April 2004 I made my own foray into the question of declining intelligence in “Global IQ: 1950–2050” in which I combined estimates of the mean IQ of countries with census data and forecasts of population growth to estimate global mean IQ for a century starting at 1950. Assuming the mean IQ of countries remains constant (which is optimistic, since part of the population growth in high IQ countries with low fertility rates is due to migration from countries with lower IQ), I found that global mean IQ, which was 91.64 for a population of 2.55 billion in 1950, declined to 89.20 for the 6.07 billion alive in 2000, and was expected to fall to 86.32 for the 9.06 billion population forecast for 2050. This is mostly due to the explosive population growth forecast for Sub-Saharan Africa, where many of the populations with low IQ reside.

U.N. World Population Prospects: 2017 Revision

This is a particularly dismaying prospect, because there is no evidence for sustained consensual self-government in nations with a mean IQ less than 90.

But while I was examining global trends assuming national IQ remains constant, in the present book the authors explore the provocative question of whether the population of today's developed nations is becoming dumber due to the inexorable action of natural selection on whatever genes determine intelligence. The argument is relatively simple, but based upon a number of pillars, each of which is a “hate fact”, although non-controversial among those who study these matters in detail.

  1. There is a factor, “general intelligence” or g, which measures the ability to solve a wide variety of mental problems, and this factor, measured by IQ tests, is largely stable across an individual's life.
  2. Intelligence, as measured by IQ tests, is, like height, in part heritable. The heritability of IQ is estimated at around 80%, which means that 80% of children's IQ can be estimated from that of their parents, and 20% is due to other factors.
  3. IQ correlates positively with factors contributing to success in society. The correlation with performance in education is 0.7, with highest educational level completed 0.5, and with salary 0.3.
  4. In Europe, between 1400 and around 1850, the wealthier half of the population had more children who survived to adulthood than the poorer half.
  5. Because IQ correlates with social success, that portion of the population which was more intelligent produced more offspring.
  6. Just as in selective breeding of animals by selecting those with a desired trait for mating, this resulted in a population whose average IQ increased (slowly) from generation to generation over this half-millennium.

The gradually rising IQ of the population resulted in a growing standard of living as knowledge and inventions accumulated due to the efforts of those with greater intelligence over time. In particular, even a relatively small increase in the mean IQ of a population makes an enormous difference in the tiny fraction of people with “genius level” IQ who are responsible for many of the significant breakthroughs in all forms of human intellectual endeavour. If we consider an IQ of 145 as genius level, in a population of a million with a mean IQ of 100, one in 741 people will have an IQ of 145 or above, so there will be around 1350 people with such an IQ. But if the population's mean IQ is 95, just five points lower, only one in 2331 people will have a genius level IQ, and there will be just 429 potential geniuses in the population of a million. In a population of a million with a mean IQ of 90, there will be just 123 potential geniuses.

(Some technical details are in order. A high IQ [generally 125 or above] appears to be a necessary condition for genius-level achievement, but it is insufficient by itself. Those who produce feats of genius usually combine high intelligence with persistence, ambition, often a single-minded focus on a task, and usually require an environment which allows them to acquire the knowledge and intellectual tools required to apply their talent. But since a high IQ is a requirement, the mean IQ determines what fraction of the population are potential geniuses; other factors such as the society's educational institutions, resources such as libraries, and wealth which allows some people to concentrate on intellectual endeavours instead of manual labour, contribute to how many actual works of genius will be produced. The mean IQ of most Western industrial nations is around 100, and the standard deviation of IQ is normalised to be 15. Using this information you can perform calculations such as those in the previous paragraph using Fourmilab's z Score Calculator, as explained in my Introduction to Probability and Statistics.)

Of the pillars of the argument listed above, items 1 through 3 are noncontroversial except by those who deny the existence of general intelligence entirely or the ability of IQ tests to measure it. The authors present the large body of highly persuasive evidence in favour of those items in a form accessible to the non-specialist. If you reject that evidence, then you needn't consider the rest of the argument.

Item 4, the assertion that wealthier families had more children survive to adulthood, is substantiated by a variety of research, much of it done in England, where recorded wills and church records of baptisms and deaths provide centuries of demographic data. One study, for example, examining wills filed between 1585 and 1638 in Suffolk and Essex found that the richer half of estates (determined by the bequests in the wills) had almost twice as many children named in wills compared to the poorer half. An investigation of records in Norfolk covering the years 1500 to 1630 found an average of four children for middle class families as opposed to two for the lower class. Another, covering Saxony in Germany between 1547 and 1671, found the middle class had an average of 3.4 children who survived to become married, while the working class had just 1.6. This differential fertility seems, in conjunction with item 5, the known correlation between intelligence and social success, to make plausible that a process of selection for intelligence was going on, and probably had been for centuries. (Records are sparse before the 17th century, so detailed research for that period is difficult.)

Another form of selection got underway as the middle ages gave way to the early modern period around the year 1500 in Europe. While in medieval times criminals were rarely executed due to opposition by the Church, by the early modern era almost all felonies received the death penalty. This had the effect of “culling the herd” of its most violent members who, being predominantly young, male, and of low intelligence, would often be removed from the breeding population before fathering any children. To the extent that the propensity to violent crime is heritable (which seems plausible, as almost all human characteristics are heritable to one degree or another), this would have “domesticated” the European human population and contributed to the well-documented dramatic drop in the murder rate in this period. It would have also selected out those of low intelligence, who are prone to violent crime. Further, in England, there was a provision called “Benefit of Clergy” where those who could demonstrate literacy could escape the hangman. This was another selection for intelligence.

If intelligence was gradually increasing in Europe from the middle ages through the time of the Industrial Revolution, can we find evidence of this in history? Obviously, we don't have IQ tests from that period, but there are other suggestive indications. Intelligent people have lower time preference: they are willing to defer immediate gratification for a reward in the future. The rate of interest on borrowed money is a measure of a society's overall time preference. Data covering the period from 1150 through 1950 found that interest rates had declined over the entire time, from over 10% in the year 1200 to around 5% in the 1800s. This is consistent with an increase in intelligence.

Literacy correlates with intelligence, and records from marriage registers and court documents show continually growing literacy from 1580 through 1920. In the latter part of this period, the introduction of government schools contributed to much of the increase, but in early years it may reflect growing intelligence.

A population with growing intelligence should produce more geniuses who make contributions which are recorded in history. In a 2005 study, American physicist Jonathan Huebner compiled a list of 8,583 significant events in the history of science and technology from the Stone Age through 2004. He found that, after adjusting for the total population of the time, the rate of innovation per capita had quadrupled between 1450 and 1870. Independently, Charles Murray's 2003 book Human Accomplishment found that the rate of innovation and the appearance of the figures who created them increased from the Middle Ages through the 1870s.

The authors contend that a growing population with increasing mean intelligence eventually reached a critical mass which led to the industrial revolution, due to a sufficiently large number of genius intellects alive at the same time and an intelligent workforce who could perform the jobs needed to build and operate the new machines. This created unprecedented prosperity and dramatically increased the standard of living throughout the society.

And then an interesting thing happened. It's called the “demographic transition”, and it's been observed in country after country as it develops from a rural, agrarian economy to an urban, industrial society. Pre-industrial societies are characterised by a high birth rate, a high rate of infant and childhood mortality, and a stable or very slowly growing population. Families have many children in the hope of having a few survive to adulthood to care for them in old age and pass on their parents' genes. It is in this phase that the intense selection pressure obtains: the better-off and presumably more intelligent parents will have more children survive to adulthood.

Once industrialisation begins, it is usually accompanied by public health measures, better sanitation, improved access to medical care, and the introduction of innovations such as vaccination, antiseptics, and surgery with anæsthesia. This results in a dramatic fall in the mortality rate for the young, larger families, and an immediate bulge in the population. As social welfare benefits are extended to reach the poor through benefits from employers, charity, or government services, this occurs more broadly across social classes, reducing the disparity in family sizes among the rich and poor.

Eventually, parents begin to see the advantage of smaller families now that they can be confident their offspring have a high probability of surviving to adulthood. This is particularly the case for the better-off, as they realise their progeny will gain an advantage by splitting their inheritance fewer ways and in receiving the better education a family can afford for fewer children. This results in a decline in the birth rate, which eventually reaches the replacement rate (or below), where it comes into line with the death rate.

But what does this do to the selection for intelligence from which humans have been benefitting for centuries? It ends it, and eventually puts it into reverse. In country after country, the better educated and well-off (both correlates of intelligence) have fewer children than the less intelligent. This is easy to understand: in the prime child-bearing years they tend to be occupied with their education and starting a career. They marry later, have children (if at all) at an older age, and due to the female biological clock, have fewer kids even if they desire more. They also use contraception to plan their families and tend to defer having children until the “right time”, which sometimes never comes.

Meanwhile, the less intelligent, who in the modern welfare state are often clients on the public dole, who have less impulse control, high time preference, and when they use contraception often do so improperly resulting in unplanned pregnancies, have more children. They start earlier, don't bother with getting married (as the stigma of single motherhood has largely been eliminated), and rely upon the state to feed, house, educate, and eventually imprison their progeny. This sad reality was hilariously mocked in the introduction to the 2006 film Idiocracy.

While this makes for a funny movie, if the population is really getting dumber, it will have profound implications for the future. There will not just be a falling general level of intelligence but far fewer of the genius-level intellects who drive innovation in science, the arts, and the economy. Further, societies which reach the point where this decline sets in well before others that have industrialised more recently will find themselves at a competitive disadvantage across the board. (U.S. and Europe, I'm talking about China, Korea, and [to a lesser extent] Japan.)

If you've followed the intelligence issue, about now you probably have steam coming out your ears waiting to ask, “But what about the Flynn effect?” IQ tests are usually “normed” to preserve the same mean and standard deviation (100 and 15 in the U.S. and Britain) over the years. James Flynn discovered that, in fact, measured by standardised tests which were not re-normed, measured IQ had rapidly increased in the 20th century in many countries around the world. The increases were sometimes breathtaking: on the standardised Raven's Progressive Matrices test (a nonverbal test considered to have little cultural bias), the scores of British schoolchildren increased by 14 IQ points—almost a full standard deviation—between 1942 and 2008. In the U.S., IQ scores seemed to be rising by around three points per decade, which would imply that people a hundred years ago were two standard deviations more stupid that those today, at the threshold of retardation. The slightest grasp of history (which, sadly many people today lack) will show how absurd such a supposition is.

What's going on, then? The authors join James Flynn in concluding that what we're seeing is an increase in the population's proficiency in taking IQ tests, not an actual increase in general intelligence (g). Over time, children are exposed to more and more standardised tests and tasks which require the skills tested by IQ tests and, if practice doesn't make perfect, it makes better, and with more exposure to media of all kinds, skills of memorisation, manipulation of symbols, and spatial perception will increase. These are correlates of g which IQ tests measure, but what we're seeing may be specific skills which do not correlate with g itself. If this be the case, then eventually we should see the overall decline in general intelligence overtake the Flynn effect and result in a downturn in IQ scores. And this is precisely what appears to be happening.

Norway, Sweden, and Finland have almost universal male military service and give conscripts a standardised IQ test when they report for training. This provides a large database, starting in 1950, of men in these countries, updated yearly. What is seen is an increase in IQ as expected from the Flynn effect from the start of the records in 1950 through 1997, when the scores topped out and began to decline. In Norway, the decline since 1997 was 0.38 points per decade, while in Denmark it was 2.7 points per decade. Similar declines have been seen in Britain, France, the Netherlands, and Australia. (Note that this decline may be due to causes other than decreasing intelligence of the original population. Immigration from lower-IQ countries will also contribute to decreases in the mean score of the cohorts tested. But the consequences for countries with falling IQ may be the same regardless of the cause.)

There are other correlates of general intelligence which have little of the cultural bias of which some accuse IQ tests. They are largely based upon the assumption that g is something akin to the CPU clock speed of a computer: the ability of the brain to perform basic tasks. These include simple reaction time (how quickly can you push a button, for example, when a light comes on), the ability to discriminate among similar colours, the use of uncommon words, and the ability to repeat a sequence of digits in reverse order. All of these measures (albeit often from very sparse data sets) are consistent with increasing general intelligence in Europe up to some time in the 19th century and a decline ever since.

If this is true, what does it mean for our civilisation? The authors contend that there is an inevitable cycle in the rise and fall of civilisations which has been seen many times in history. A society starts out with a low standard of living, high birth and death rates, and strong selection for intelligence. This increases the mean general intelligence of the population and, much faster, the fraction of genius level intellects. These contribute to a growth in the standard of living in the society, better conditions for the poor, and eventually a degree of prosperity which reduces the infant and childhood death rate. Eventually, the birth rate falls, starting with the more intelligent and better off portion of the population. The birth rate falls to or below replacement, with a higher fraction of births now from less intelligent parents. Mean IQ and the fraction of geniuses falls, the society falls into stagnation and decline, and usually ends up being conquered or supplanted by a younger civilisation still on the rising part of the intelligence curve. They argue that this pattern can be seen in the histories of Rome, Islamic civilisation, and classical China.

And for the West—are we doomed to idiocracy? Well, there may be some possible escapes or technological fixes. We may discover the collection of genes responsible for the hereditary transmission of intelligence and develop interventions to select for them in the population. (Think this crosses the “ick factor”? What parent would look askance at a pill which gave their child an IQ boost of 15 points? What government wouldn't make these pills available to all their citizens purely on the basis of international competitiveness?) We may send some tiny fraction of our population to Mars, space habitats, or other challenging environments where they will be re-subjected to intense selection for intelligence and breed a successor society (doubtless very different from our own) which will start again at the beginning of the eternal cycle. We may have a religious revival (they happen when you least expect them), which puts an end to the cult of pessimism, decline, and death and restores belief in large families and, with it, the selection for intelligence. (Some may look at Joseph Smith as a prototype of this, but so far the impact of his religion has been on the margins outside areas where believers congregate.) Perhaps some of our increasingly sparse population of geniuses will figure out artificial general intelligence and our mind children will slip the surly bonds of biology and its tedious eternal return to stupidity. We might embrace the decline but vow to preserve everything we've learned as a bequest to our successors: stored in multiple locations in ways the next Enlightenment centuries hence can build upon, just as scholars in the Renaissance rediscovered the works of the ancient Greeks and Romans.

Or, maybe we won't. In which case, “Winter has come and it's only going to get colder. Wrap up warm.”

Here is a James Delingpole interview of the authors and discussion of the book.

Back

HotBits: Server 3.9 released, JSON support

Thursday, January 31, 2019 00:57

HotBits server version 3.9 is now in production at Fourmilab. This server is 100% upward compatible with existing HotBits users and API client programs, but has been extensively restructured to improve reliability and fault tolerance. It is able to communicate with multiple HotBits generators and recover from any timeouts or connection problems in obtaining data from them, and requests data from the two identical Fourmilab HotBits generators in a round-robin sequence.

In addition to the existing hexadecimal, binary C data structure, and XML data formats, JSON is now supported. JSON is a JavaScript-derived data structure representation which is increasingly used by Web applications. HotBits delivered in JSON format provide all of the information to clients that the XML representation delivers.

Version 3.9 of the HotBits server supports random data generation using the RDSEED instruction implemented in recent Intel microprocessors. This generator can be configured when the HotBits server is built, and allows testing a HotBits generator on a machine which has a suitable Intel processor without the need for the radioactive generator. This option is never used in production HotBits servers, but makes it much easier to test the generator software in development environments.

If you want to set up your own HotBits server (which is now more easily done if you have an Intel processor which supports RDSEED), you can download the HotBits version 3.9 software.

Back

Books of the Year: 2018

Monday, December 31, 2018 13:08

Here are my picks for the best books of 2018, fiction and nonfiction. These aren't the best books published this year, but rather the best I've read in the last twelve months. The winner in both categories is barely distinguished from the pack, and the runners up are all worthy of reading. Runners up appear in alphabetical order by their author's surname. Each title is linked to my review of the book.

Fiction:

Winner: Runners up:

Nonfiction:

Winner: Runners up:

Back

Reading List: Iron Sunrise

Wednesday, December 26, 2018 18:00

Stross, Charles. Iron Sunrise. New York: Ace, 2005. ISBN 978-0-441-01296-1.
In Accelerando (July 2011), a novel assembled from nine previously-published short stories, the author chronicles the arrival of a technological singularity on Earth: the almost-instantaneously emerging super-intellect called the Eschaton which departed the planet toward the stars. Simultaneously, nine-tenths of Earth's population vanished overnight, and those left behind, after a period of chaos, found that with the end of scarcity brought about by “cornucopia machines” produced in the first phase of the singularity, they could dispense with anachronisms such as economic systems and government. After humans achieved faster than light travel, they began to discover that the Eschaton had relocated 90% of Earth's population to habitable worlds around various stars and left them to develop in their own independent directions, guided only by this message from the Eschaton, inscribed on a monument on each world.

  1. I am the Eschaton. I am not your god.
  2. I am descended from you, and I exist in your future.
  3. Thou shalt not violate causality within my historic light cone. Or else.

The wormholes used by the Eschaton to relocate Earth's population in the great Diaspora, a technology which humans had yet to understand, not only permitted instantaneous travel across interstellar distances but also in time: the more distant the planet from Earth, the longer the settlers deposited there have had to develop their own cultures and civilisations before being contacted by faster than light ships. With cornucopia machines to meet their material needs and allow them to bootstrap their technology, those that descended into barbarism or incessant warfare did so mostly due to bad ideas rather than their environment.

Rachel Mansour, secret agent for the Earth-based United Nations, operating under the cover of an entertainment officer (or, if you like, cultural attaché), who we met in the previous novel in the series, Singularity Sky (February 2011), and her companion Martin Springfield, who has a back-channel to the Eschaton, serve as arms control inspectors—their primary mission to insure that nothing anybody on Earth or the worlds who have purchased technology from Earth invites the wrath of the Eschaton—remember that “Or else.”

A terrible fate has befallen the planet Moscow, a diaspora “McWorld” accomplished in technological development and trade, when its star, a G-type main sequence star like the Sun, explodes in a blast releasing a hundredth the energy of a supernova, destroying all life on planet Moscow within an instant of the wavefront reaching it, and the entire planet within an hour.

The problem is, type G stars just don't explode on their own. Somebody did this, quite likely using technologies which risk Big E's “or else” on whoever was responsible (or it concluded was responsible). What's more, Moscow maintained a slower-than-light deterrent fleet with relativistic planet-buster weapons to avenge any attack on their home planet. This fleet, essentially undetectable en route, has launched against New Dresden, a planet with which Moscow had a nonviolent trade dispute. The deterrent fleet can be recalled only by coded messages from two Moscow system ambassadors who survived the attack at their postings in other systems, but can also be sent an irrevocable coercion code, which cancels the recall and causes any further messages to be ignored, by three ambassadors. And somebody seems to be killing off the remaining Moscow ambassadors: if the number falls below two, the attack will arrive at New Dresden in thirty-five years and wipe out the planet and as many of its eight hundred million inhabitants as have not been evacuated.

Victoria Strowger, who detests her name and goes by “Wednesday”, has had an invisible friend since childhood, “Herman”, who speaks to her through her implants. As she's grown up, she has come to understand that, in some way, Herman is connected to Big E and, in return for advice and assistance she values highly, occasionally asks her for favours. Wednesday and her family were evacuated from one of Moscow's space stations just before the deadly wavefront from the exploded star arrived, with Wednesday running a harrowing last “errand” for Herman before leaving. Later, in her new home in an asteroid in the Septagon system, she becomes the target of an attack seemingly linked to that mystery mission, and escapes only to find her family wiped out by the attackers. With Herman's help, she flees on an interstellar liner.

While Singularity Sky was a delightful romp describing a society which had deliberately relinquished technology in order to maintain a stratified class system with the subjugated masses frozen around the Victorian era, suddenly confronted with the merry pranksters of the Festival, who inject singularity-epoch technology into its stagnant culture, Iron Sunrise is a much more conventional mystery/adventure tale about gaining control of the ambassadorial keys, figuring out who are the good and bad guys, and trying to avert a delayed but inexorably approaching genocide.

This just didn't work for me. I never got engaged in the story, didn't find the characters particularly interesting, nor came across any interesting ways in which the singularity came into play (and this is supposed to be the author's “Singularity Series”). There are some intriguing concepts, for example the “causal channel”, in which quantum-entangled particles permit instantaneous communication across spacelike separations as long as the previously-prepared entangled particles have first been delivered to the communicating parties by slower than light travel. This is used in the plot to break faster than light communication where it would be inconvenient for the story line (much as all those circumstances in Star Trek where the transporter doesn't work for one reason or another when you're tempted to say “Why don't they just beam up?”). The apparent villains, the ReMastered, (think Space Nazis who believe in a Tipler-like cult of Omega Point out-Eschaton-ing the Eschaton, with icky brain-sucking technology) were just over the top.

Accelerando and Singularity Sky were thought-provoking and great fun. This one doesn't come up to that standard.

Back