13. monitoring and evaluation 

In agricultural extension, which has been going on for a long time, extension workers normally have a set of "proven" messages based on results of extensive research. This situation is different from that of the extension worker promoting agroforestry. Agroforestry has only recently received attention in research, and simultaneously efforts in agroforestry extension have been intensified. Thus, the research information that extension workers can use to make recommendations on species, sites, arrangements and management techniques is limited. In addition, agroforestry technologies are usually complex and site specific. Hence, the extension worker usually has no "proven" technical packages to rely on but instead has to use the extension work itself as a method of technology development together with farmers.

Effective feedback of information from farmers to extension workers, and from them to researchers is, thus, even more important in agroforestry extension than in agricultural extension. Based on such feedback and on monitoring of field activities, recommendations have to be continuously modified.

Effective monitoring of progress is more important if new technologies are being introduced than if traditional practices are promoted since the risk of failure is generally greater with new or little-known technologies.

Extension is by definition aimed at improving the livelihood of the people, and it is of course the final impact of the efforts that will distinguish useful and successful extension work from failures. Different indicators can be used to evaluate impact depending on the nature of the activities and how long the extension work has been going on. In the early stages of extension, intermediate indicators need to be used, but eventually the "real", or so-called final indicators, should be used.

Figure 13.1 Evaluation is vital

If, for example, the objective of the extension work in an area is to ease the burden of fuelwood collection for women by planting more trees nearby, in the initial stages of extension the number of tree seedlings planted must be used as an indicator of success. After a year or two it may be possible to make survival checks and see how many trees are actually growing on the farms. Both these indicators are intermediate ones giving only tentative indications of whether the objectives are likely to be met. It is not until the trees are actually in use for fuel that the final indicators can be used. In this example the final indicator may be how much less time women spend on firewood collection compared with the situation before the trees came into use. An even better final indicator would be how the women used the time saved due to the increased supply of firewood, what extra income they managed to earn as a result, how much more leisure time they had and what they thought of the improvement generally.

It is only by using such final indicators that the real success of extension can be measured, but due to the relatively long time required for trees to grow and mature, evaluation of forestry and agroforestry projects is often based on intermediate indicators.

It is important to treat results from evaluations based on intermediate indicators with caution. For example, the number of seedlings produced in nurseries is a poor indicator of success in agroforestry extension. There are many later pitfalls in the process of growing trees that may make the final outcome less satisfactory even if the early indicators were favourable.

In day-to-day extension work it is important to observe what is going on and how different combinations of trees and crops appear to be performing in the area concerned. Much can be learnt by careful observations, e.g. what kind of tree management seems to be most effective in a certain situation, or which spacing is most appropriate.

Another important way of monitoring day-to-day progress is to carefully listen to the reactions of the target group. Careful listening not only provides an excellent opportunity to learn more but also shows farmers that the extension worker is seriously interested in his task.

Finally, in day-to-day monitoring, notes should be taken regularly, both on direct observations made and on information provided by the rural people. It is always good to be able to go back to your notes and remind yourself of the details of a certain situation.

Figure 13.2 Activities in day-to-day extension work

If extension workers work as a team in an area, which is strongly recommended, it is also essential once in a while to review the priorities and targets set, to scrutinize findings from any earlier data gathering, and jointly to discuss in more depth whether or not the priorities or targets need revision. These discussions should be held at least annually and, preferably, more often.