Developing Multilevel Models for Research

Developing Multilevel Models For Research

Researchers analyze hierarchical or nested structures, when conducting applied research in organizations, schools, health care facilities, and family settings. Hofmann (2002) indicated that ignoring these simple hierarchical structures can lead to incomplete and misspecified models. These hierarchical structures “shape, create, encourage, and reward behavior in organizations” (Hofmann, 2002, p. 248). Including this hierarchical structure into conceptual and theoretical models allows researchers to better capture the level of complexity because hierarchical systems increase our levels of understanding.

In the past, a large number of research efforts concentrated on single-level analysis, primarily studies concentrating on one level of analysis (i.e., personality studies, evaluation of manager’s leadership abilities). Researchers who only conduct a single-level analysis are finding it harder to justify because of advancements in statistical software and research techniques. Today, researchers replace the single-level research studies with the more complex multilevel analysis techniques. For example, researchers who study hierarchical systems, such as organizations and schools, want to consider multiple impacts within the system. In these hierarchical systems, when a change is made in one part of the system each adjoining system is also affected, changing the whole system. By concentrating only on a single-level study, researchers ignore the surrounding environment, the effect that the individual has on the group and the organization / school. Alternatively, changes at the organization / school level also affect the team and the individual levels. To better understand the complex nature of hierarchical systems Kozlowski and Klein (2000) proposed that researchers utilize “approaches that are more integrative, that cut across multiple levels, and that seek to understand phenomena from a combination of perspectives” (p. 77).

In theoretical and applied research, the level of analysis is typically ill defined (Kozlowski & Klein, 2000). Literature often contains errors when individual-level data is incorrectly applied to team, organization, or school levels (Kozlowski & Klein, 2000). Some common errors in organizational and school research include misspecification errors, such as:

• •

  Blind aggregation of individual-level measures to represent unit-level constructs;

• •

  Use of unit-level measures to infer lower-level relations (the well-known problems of aggregation bias and ecological fallacies); and

• •

  Use of informants who lack unique knowledge or experience to assess unit-level construct (Kozlowski & Klein, 2000).