KEMs

Experimental environments

GOAL

Innovating through experimentation
Stimulating and shaping experiments to prepare innovations for practical application.

PHASE IN DEVELOPMENT PROCESS

  • Discover
  • Define
  • Develop
  • Deliver

APPLICATION

  • Subjecting ideas and interventions to 'real' environments at an early stage.
  • Testing, adjusting and further developing interventions based on feedback from key target groups.
  • Assist in setting up experimental environments.
  • Helping to learn experimental environments,

What does it entail?

What does this category entail?
KEMs in this category help set up and learn from experimental environments. These environments can be physical or virtual, taking place in everyday life, at a festival, or in a shared workshop. 

Experimental environments enable innovative ideas and interventions to be subjected to complex, near-real-life conditions – often in close collaboration with industry, government, knowledge institutions, and/or end users. This allows for early testing, adjustment, and further development of interventions based on user feedback. Experimental environments thus provide insight into the impact of interventions on an environment and how people cope with their (new) reality.

Why is that important?
Societal challenges and transitions are not easy to manage and related issues are surrounded by uncertainties and ambiguous information. Transitions are complex, partly due to the many relationships between individuals and the great dependence on environmental factors. This makes it difficult to determine the impact of an innovation in advance and at the same time estimate how it will be received in society. For this reason, interventions can best be developed in a situation that resembles the 'real' environment as much as possible, involving as many relevant parties as possible - including end users. These experimental environments are already part of the intended change and will accelerate it further.

When do you apply these KEMs?
For questions such as:

  • How do you set up an experimental environment?
  • What conditions must an experimental environment meet? 
  • What degree of similarity of the experimental environment to the actual situation is required? 
  • How can technical and social innovation be accommodated in an experimental environment? 
  • What expertise, regulatory agreements, and financial resources do you need? 
  • How and when can you scale?

What methods are there?

Experimental environments form a 'multicoloured palette', in which a combination of methods and technologies is often used. These environments cannot be summarised in a limited number of types: they differ from each other because they are composed on the basis of the needs within the issue. 

If you look exclusively at the location of the experiment, three types of experimental environments can be distinguished:

  • Purely virtual experimental environments, such as digital twins (digital replicas) and other forms that emphasize digital simulation. 
  • Experimental environments with a physical location, such as test setups or open-air laboratories, where innovations can be tested in test setups. This also includes workshops or fablabs (cooperative making environments) in which actual joint (tangible) making is central.
  • Experimental environments in everyday life, such as city labs where public space forms the test environment.

In each of these types, different methods and technologies can be introduced to shape the experiment. For example, more and more experimental environments use digital technology to simulate situations, sensor data and methods to closely involve end users in an experiment. Experimental environments can thus, in their form, more or less merge into each other. For example, consider how virtual reality can be used as a virtual experimental environment within a lab in an everyday environment.

Methods that are frequently used are:

Methods for an environment for experimentation based on simulation:  

  • Digital Twins. These are digital replicas of living or non-living physical entities (such as people, objects or processes), where the digital replica adapts based on data from the physical world (El Saddik, 2018). The digital replica can be used as a test environment to monitor or to research processes in physical reality. They can also help predict the possible impact of interventions in the real environment by experimenting with certain variables in the model. For example, Digital Twins can help determine a good time for necessary maintenance in complex infrastructure or industrial installations. 
  • Of a different order, but sometimes also very relevant for experimental environments is the Equilibrium Analysis. This method helps to study the impact of interventions in the context of the economy.
  • Sandboxes provide isolated digital environments where developers can create and test new concepts without interfering with other (critical) components in a project.
  • Virtual Reality (VR) is the collection of technologies and application methods for virtual environments that can actually be experienced by people. These virtual environments offer the control of laboratories, but can also simulate complex processes such as an industrial production line or an airport control tower. Related is Augmented Reality (AR), which makes it possible to add extra (virtual) information to the real world.   
  • Serious Gaming (eg Mayer et al., 2014) is a method to study collaborations and realize trainings within virtual environments. The limitation of these virtual environments is that they mainly serve the visual and auditory channel and to a very limited extent the other senses.

Methods for an environment for experimentation through following real world sensor data:

  • Crowdsourcing is the online use of the knowledge, skills or creativity of a large group of people. By using sensor data or active input from other users, information can be acquired digitally. This offers an insight into the target group that minimally interferes with daily life.
  • Perpetual Beta is a method in software development where the implementation of systems is always in a test phase, and developers are continuously intervening. It allows early design iterations to be implemented in the real world and uses online channels to obtain user feedback and improve designs. Perpetual Beta is applied, for example, in urban development (Fredericks et al., 2019).
  • Technology Probes are specially designed objects with sensors and possibly actuators that are connected to the internet and can exchange data from the environment. This allows experimental environments to be created in physical and/or virtual environments that are part of society. These so-called Experiential Design Landscapes serve as a playground for in-situ design research by multi-stakeholder teams (Peeters & Megens, 2014).
  • Data-enabled Design is a method in which data is obtained from the environment using existing products and services. By combining sensor data from physical and digital products with qualitative data from users, designers obtain detailed and nuanced contextual, behavioral, and experience-oriented insights from everyday life (Van Kollenburg & Bogers, 2019). This method is already widely used in the business world (such as by Philips Design) for the development of new products and services.

Methods for an environment for experimentation based on direct interaction with (end) users: 

  • Test gardens, Field labs and Living Labs are experimental environments in which large, possibly more homogeneous, target groups come together. In these environments, user-oriented methods are used and open innovation is often stimulated. They are used to observe and measure, build and validate prototypes, and address complex challenges in as many real-life situations as possible. Many labs are linked to so-called Smart City initiatives, particularly around Amsterdam, Rotterdam and Eindhoven. The environments are linked to daily activities, but offer more control. 
  • Living Labs can also be linked to specific target groups, such as athletes, by turning a sports complex into an experimental environment. Or doctors, nurses and patients in a hospital. Living labs can also be temporary, such as at festivals. During festivals, prototypes can be tested and experienced and a lot of data can be collected or feedback can be obtained in a short time. A festival is considered a temporary mini-society with challenges in the areas of energy, waste, logistics, water and food. Innofest, for example, is an organisation that offers entrepreneurs the opportunity to conduct research at various festivals. On the other hand, during the GLOW festival in Eindhoven, researchers observed how light can influence the routing of large groups for the purpose of crowd management (Corbetta et al., 2018).
  • In City Labs citizens, researchers, students, technologists, businesses, NGOs, entrepreneurs, teachers and policy makers come together (Scholl & Kemp, 2016). An example of this is NEMO Kennislink where, in the context of the Science Museum, solutions for the future of the Amsterdam metropolitan area are worked on through co-creation.
  • In addition to cities, there is also regional applications are being considered: in the Brainport region around Eindhoven, for example, a stretch of highway and several streets have been designated for the Helmond Smart Mobility Living Lab where traffic research can be conducted.
  • Policy Labs (Olejniczak et al., 2019) are environments where government and citizens come together to explore innovative ideas. Through citizen participation and a changing government culture, it is hoped to achieve social impact. However, there is still limited coherence between the methods used in the various labs. The effectiveness of these environments on policy change has not yet been sufficiently proven and - because of their short existence - it is not known whether these labs are sustainable. Advantages are that the feasibility and scalability of initiatives can be tested in a short time and in a relatively flexible manner and that they offer a safe environment for co-design and participation.

Methods for an environment for experiment with emphasis on make together: 

  • Workshops. In these making environments, making is central and control is more in the hands of the users. By enabling a large diversity of people to create, new work methods and data can be generated on a large scale. By linking these together, research is supported by practice, which ultimately leads to increased creativity and knowledge production.
  • In the Maker Movement (Dougherty, 2012) People in environments such as Fablabs create artefacts. Knowledge is shared about production processes, models and software code for this. This can also lead to new research initiatives such as Citizen Science (Irwin, 1995).
  • Critical Making, based on Critical Design (Dunne, 1999), provides artists, designers and scientists with tools for critical reflection on technology in society. 
  • By means of Speculative Making or Art-science a hybrid form of art and science is created, both of which have a unique capacity to shape our understanding of the world. The collaboration yields new insights for both and leads to new hybrid forms of knowledge and presentation. Artistic research offers space for subjectivity; by using performative and speculative research methods this can lead to generically applicable principles.
  • This type of research is often linked to the shop window approach or Showroom Approach (Koskinen et al., 2011). The experimental environments that are linked to this are exhibitions and museums or Future Labs.

Experimental environments in practice

Methods

The first digital KEM monitor was published at the end of 2025. This concise, English-language trend report offers a current and concise overview of the most important developments in Key Enabling Methodologies (KEMs) over the past year. New methodological developments, insights, and research questions are mapped out for each KEM category.

Cases

The Ministry of Social Affairs and Employment (SZW) does not only want to design the new financing system for childcare theoretically, but also to test and optimize it practically. For this reason, they have been working with potential implementation organizations since the design phase. Together, they had the following questions:

Cases

There is a clear need to integrate sustainability into military operations, but not all stakeholders recognize its importance. This project offers the opportunity to let military personnel experience in an interactive workshop how alternative choices in the structure of military missions contribute to both operational readiness and logistic independence.