COLLECTING DATA

Developing a sound, systematic way to collect data is critical to a good evaluation plan. Evaluation findings are less defensible if data collection procedures are not sound.

Common Ways to Collect Data

The following are some common ways to collect data.

Survey -- Collecting data through a structured instrument. Surveys can be mailed (surface or electronic), completed on-site, or administered through interviews (face-to-face or telephone).
Case study -- Examining a particular program, group, individual, or site. Case studies rely on multiple sources of data to get a complete picture.
Interviews -- Collecting data by talking with and listening to people. Interviews range from those that are tightly structured (as in a survey) to those that are free flowing and conversational.
Key Informants -- Getting information, over time, from a community resident who can provide information on how well a program is serving its intended beneficiaries. Key informants might include school teachers, foodservice managers, and local leaders.
Observation -- Getting information by "seeing" and "listening." Observations can be structured or unstructured.
Focus Groups -- Asking a group of 6 to 12 people a semi-structured series of questions. Participants are free to talk with other group members and the focus group moderator.
Delphi -- Getting information from participants without physically assembling them. Information is often exchanged via mail, FAX, or email.
Community Forums -- Sharing ideas at an event that anyone can attend, where a panel of experts shares information, and where members of the audience can ask questions during a pre-set time.
Testimonial -- Getting a statement that represents an individual's personal response and/or reaction to an issue or program.
Test -- Using established standards to assess knowledge, skills, or performance, such as a certification exam.
Photograph, slide, and video -- Using photography to capture visual images.
Diary and journal -- Recording events over time to reveal the personal perspective of the writer/recorder.
Log -- Recording chronological entries, which are usually brief and factual.
Document analysis -- Using content analysis and other techniques to analyze and summarize printed material and existing documents.
Action cards -- Using index cards on which participants record what they did (the action) and when they reached their goal.
Simulation -- Using models or mock-ups to solicit perceptions and reactions.
Problem story -- Using a narrative account of past, present, or future situations as a means of identifying perceptions. Using fictional characters externalizes the problem situation.
Creative expression -- Using art forms to represent people's ideas and feelings through stories, drama, dance, music, or art.
Unobtrusive measures -- Gathering information without one knowing. For example, observing food handling practices in a restaurant while eating in the restaurant.

Test Your Knowledge

1. What is the data collection method called when a researcher convenes a group of 6-12 volunteers to discuss a topic?

2. What are three ways that a survey can be administered?

3. What is the name of the data collection method in which you get information by seeing and listening to people?

4. What data collection method does not require you to physically assemble the participants?

5. What data collection method uses established standards to assess knowledge, skills, or performance?

ANSWER KEY