Security Radar 2019: Wake-up call for Europe!

Countries: Germany, France, Latvia, Poland, Russia, Ukraine, Serbia

Mode: Computer Assisted Telephone Interviewing (CATI)

Sampling: Random sampling, representative for the population of the country

Target group: Resident population aged 18+ that lives in a private household and is attainable via landline and / or mobile telephone connection

Interviews: n=1,000 interviews in each country, 7,000 in total

Weighting: The sample structure of the reported results is adjusted to the official statistics (weighting based on age, gender and region)

Fieldwork: August-October 2018

The research is designed to shed light on two main factors that have substantial impact on political decision makers when faced with security or foreign affairs issues: public opinion and the perspective of political consulting experts. Accordingly, the design of the study consists of two main steps of data collection and analysis: a representative public opinion poll and expert group discussions.

A representative public opinion poll was conducted in seven European countries: Germany, France, Latvia, Poland, Serbia, Ukraine and Russia. The aim was to systematically investigate the attitudes to the current security and foreign policy situation in Europe. The pollster Ipsos Public Affairs in Berlin was assigned to carry out the necessary fieldwork. Expert-group-discussions in each of the seven countries provided access to (a) expert-knowledge and (2) the typical mind-set of the regional consulting expert community. This step aimed to replicate how regional expert communities define and evaluate the current security and foreign policy situation and investigated what useful lessons could be derived from their perspective.

Survey

A representative opinion survey was conducted with the help of a fully standardised instrument (CATI Dual-Frame). The target population surveyed consisted of citizens of the seven countries detailed above, aged 18 or over, with access to at least one landline telephone or at least one cell-phone. The survey explores public opinion concerning the current security and foreign policy situation in five dimensions:

• Perception of the current threat situation
• Trust and attitudes towards institutions
• Attitudes towards foreign and security policy
• Attitudes towards national identity
• Prospects for the development of security policy in Europe.

Furthermore, descriptors consisting of sociodemographics, political views and information behaviour were collected. The survey uses Likert-scaled, binary and open-ended questions. The objective of Likert-scaling is to measure the extent of agreement or disagreement with a question or statement. In most cases, the extent is measured on a four-point scale ranging from ‘strongly agree’, ‘somewhat agree’, ‘somewhat disagree’ to ‘strongly disagree’. Some five-point and ten-point scales were also used. The respondents could also decline to agree or disagree with the question or statement. In this case, the answer was coded as ‘I don‘t know’. For statistical analysis, each point scale is converted into a number from one to four (and in a few cases one to five or ten). Statistical analysis was performed using Microsoft® Excel® and IBM® SPSS® Statistics Version 25. Before the main fieldwork began, a pre-test was conducted in Germany (n=52) and Serbia (n=54) to test the clarity of the questions, answer options, the questionnaire’s length, as well as willingness to participate. The pre-test took place between May 29th and 30th 2018. Contacts were recruited under realistic fieldwork conditions. The results of the pre-test were used to inform the final design of the questionnaire.

The sampling method consisted of a multi-level, layered random selection process based on a sample, together with a random sample of the interviewees (Random Last Two Digits Approach). By applying the Dual-frame method, two separate samples were formed in each of the survey countries. The data was weighted in a multi-stage process. First, the landline telephone household-sample was transformed into a person-sample. Second, the landline telephone household-sample and the cell-phone individual-sample were transformed into a person-sample. Finally, the unweighted sample-structure was adjusted to the official statistics. For the last step of the weighting process the sex, age and region variables were used to calculate the weighting factors. The iterative ‘Rim weight’ procedure supplied by Quantum Software ® was used.

Expert Group Discussion

With the help of a semi-structured interview instrument, expert group discussions were conducted in each of the above-mentioned countries. Trained moderators carried out the data collection. Target groups were active political consulting experts and analysts. All expert group discussions took place in October and November 2018. The central theme of the discussion was the current foreign and security situation in Europe. The participants were instructed that the notion of ‘Europe’ should go beyond the European Union and should be understood as ‘Greater Europe’.

The semi-structured interview instrument consisted of three phases:

1. An open discussion about the current security and foreign policy situation in Europe. Guiding questions were:

• What concrete challenges have shaped the landscape of foreign policies of European countries as well the security situation in Europe in recent years?
• Can you broadly describe the current security situation in Europe?
• How did the current situation emerge?

2. A summary of the discussion and identification of key corresponding categories was compiled together with the participants, as well as a focused reflection on how every category was understood. The content was limited to the aspects introduced by the participants. The moderators provided no additional external information or content.

The main goal of the first two phases was to gain access to country specific expert-knowledge.

3. A subsequent guided discussion focused on necessary political steps to improve the status quo. In this phase, the experts were put in the virtual role of policy advisors. To provide comparability, the dimensions of the guided focus were the same as in the survey.

The main goal of this phase was to gain access to the shared underlying perspective, with which the experts participate in the current political discourse.

The criteria for including the experts in the sample were that they had (a) proven expert-knowledge, which is acknowledged within the country specific expert-discourse and (b) influence on the political discourse within the country. Expert group discussions were realised in each country with between five and seven experts involved in each discussion. The duration of the discussion varied between 120 and 140 minutes. ‘Chatham House Rules’ were applied to protect the participants from possible repercussions. 

After each discussion, the moderators compiled a verbatim protocol from memory. Furthermore, the discussion was recorded and transcribed for content and mind-set analyses. Finally, after content and mind-set analyses for each country were completed, the results were triangulated with the results of the public opinion poll.