Streaming replication FATAL: database system identifier differs between the primary and standby

Cause (in my case)

I tried to set-up replication without making standby a clone of master.

Solution

Take a base backup with pg_basebackup and make standby use it. For freshly initialised databases copying the generated folder and file structure into the data directory of the standby was sufficient.