Data Collection Methods for Program Evaluation: Observation

                         

Observation  is way of gathering data by watching behavior, events, or noting physical characteristics in their natural setting. Observations can be overt (everyone knows they are being observed) or covert (no one knows they are being observed and the observer is concealed).

Observations can also be either direct or indirect. Direct observation is when you watch interactions, processes, or behaviors as they occur; for example,. Indirect observations are when you watch the results of interactions, processes, or behaviors.

When should you use observation for evaluation?

·         When you are trying to understand an ongoing process or situation.

If you want evaluating the situation you can use observation for get the information.

·         When you are gathering data on individual behaviors or interactions between people.

If you are want analysis individual behavior you can use observation.

·         When data collection from individuals is not a realistic option.

If respondents are unwilling or unable to provide data through questionnaires or interviews, observation is a method that requires little from the individuals for whom you need data.

How do you plan for observations?

·         Determine the focus.

Think about the evaluation question(s) you want to answer through observation and select a few areas of focus for your data collection.

·         Design a system for data collection. Once you have focused your evaluation think about the specific items for which you want to collect data and then determine how you will collect the information you need.

·         Recording sheets and checklists

·         Observation guides list the interactions, processes, or behaviors to be observed with space to record open-ended narrative data.

·         Field notes are the least standardized way of collecting observation data and do not include preset questions or responses. Field notes are open-ended narrative data that can be written or dictated onto a tape recorder.

·         Select the sites. Select an adequate number of sites to help ensure they are representative of the larger population and will provide an understanding of the situation you are observing.

·         Select the observers. You may choose to be the only observer or you may want to include others in conducting observations. Stakeholders, other professional staff members, interns and graduate students, and volunteers are potential observers.

 What are the advantages of observation?

• Collect data where and when an event or activity is occurring.
• Does not rely on people’s willingness or ability to provide information.
• Allows you to directly see what people do rather than relying on what people say they did.

What are the disadvantages of observation?

• Susceptible to observer bias.
• Susceptible to the “hawthorne effect,” that is, people usually perform better when they know they are being observed, although indirect observation may decrease this problem.  
• Can be expensive and time-consuming compared to other data collection methods.
• Does not increase your understanding of why people behave as they do.