GEM Home
Evaluation Findings

 

Evaluation findings

Gender Evaluation Methodology
for Internet and ICTs: A Learning Tool for Change and Empowerment
Preliminary Results Analysis and Tester Case Studies


Download .pdf in .zip format (276kb)


Credits and License
APC WNSP
Introduction

Part 1: Global Summary: Tool Building, Testing and Training


Part 2: Case Studies: Evaluation Findings from Six GEM Testers

Part 3: Who Is Using GEM: Overview of All GEM Testers

 

Gender Evaluation Methodology
for Internet and ICTs: A Learning Tool for Change and Empowerment

Association for Progressive Communications Women's Networking Support Programme
Editor: Chat Garcia Ramilo
Cover Illustrator and Graphic Design of Print Version: Josefina Leal Quiróz and Amando Ramirez Fuentes
Contributors
GEM Project Team:
GEM Global Coordinator: Chat Garcia Ramilo chat@apcwomen.org
GEM Africa: Fatma Alloo, falloo@zitec.org
GEM Asia: Cheekay Cinco, cheekay@apcwomen.org
GEM Central and Eastern Europe: Katerina Fialova katerina.fialova@apcwomen.org
Lenka Simerska, lenka@apcwomen.org
GEM Latin America: Dafne Plou, daphne@apcwomen.org
Knowledge Sharing Site Managers: Erika Smith, erika@laneta.apc.org
Josefina Leal Quiróz, josefinaleal@laneta.apc.org
APC WNSP Coordinator: Karen Banks, karenb@apcwomen.org
GEM Testers

Women'sNet, http://www.womensnet.org.za
Philippine Council for Health Research and Development (PCHRD) / Multi-Purpose Community Telecentres (MCT), http://www.barangay-mct.org
Mothers for Mothers, http://www.ehomemakers.net
Zamirnet, http://www.zamirnet.hr
Bulgarian Gender Research Foundation, http://www.bgrf.org
Modemmujer, http://www.modemmujer.org
Editorial Support: Mylene Soto, Anna Hidalgo, Jenny Radloff and Ernesto Hilario

Special thanks to the following organisations for supporting the GEM project: Department for International Development (DFID), United Kingdom Engineering Knowledge and Research Programme; International Development Research Centre (IDRC) Canada; UNIFEM, New York


APC WNSP Address: 2nd Floor, 33 Islington High Street, London N1 9LH, United Kingdom
wnsp@apcwomen.org , www.apcwomen.org
APC Address: P O Box 29755, Melville, 2109, South Africa
info@apc.org, www.apc.org

Published December, 2003

This work is published under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike License.

Under this license, you are free to copy, distribute, display, and perform the work; or to make derivative works under the following conditions:
Attribution. You must give the original author credit.
Noncommercial. You may not use this work for commercial purposes.
Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one.

For any reuse or distribution, you must make clear to others the license terms of this work. Any of these conditions can be waived if you get permission from the author. Your fair use and other rights are in no way affected by the above.

ASSOCIATION FOR PROGRESSIVE COMMUNICATIONS WOMEN'S NETWORKING SUPPORT PROGRAMME
Networking for change and women's empowerment since 1993
http://www.apcwomen.org


APC WNSP is a global network of women who support women's networking for social change and women's empowerment, through the use of Information and Communication Technologies (ICTs).

APC WNSP aims to promote the consideration and incorporation of gender in ICT policy-making bodies and forums; initiate and implement research activities in the field of gender and ICT; advance the body of knowledge, understanding, and skills in the field of gender and ICT by implementing training activities and; facilitate access to information resources in the field of gender and ICT.

We engage in research, evaluation, training, information, and support activities in the field of ICT policy, skills-sharing in the access and use of ICT, and women's network-building. The programme works primarily in an world. Using a combination of email, mailing lists and real time text and voice'chat', we are able to coordinate, develop action plans, implement activities, support and mentor one another while maintaining and strengthening our organisational and personal relationships. We meet face-to-face whenever opportunities present themselves (such as national, regional or international workshops and conference) or through explicitly funded workshops and meetings of the programme.

APC WNSP is a part of the Association for Progressive Communications (APC), an international network of civil society organisations dedicated to empowering and supporting groups and individuals working for peace, human rights, development and protection of the environment, through the strategic use of information and communication technologies (ICTs), including the internet.


Contacts:
APC WNSP global network contact: wnsp@apcwomen.org
APC-Africa-Women contact: africa@apcwomen.org
Asia and the Pacific contact: asia@apcwomen.org
Latin American and the Caribbean contact: parm@apcwomen.org
Central and Eastern Europe contact: cee@apcwomen.org

Introduction

It took10 months of research, workshops, meetings and painstaking writing before we completed the first version of the Gender Evaluation Methodology (GEM) tool. Finally, in October 2001, we published the first version of the GEM tool . Since then GEM has been through several incarnations coming from the combined wisdom and experience of a talented community of ICT practitioners, gender specialists and evaluators who contributed as researchers, critical reviewers, resource persons and workshop facilitators.

In January 2002, we were ready to test and refine the GEM tool and began the GEM project. Through the support of the Department for International Development, International Development Research Centre and UNIFEM, we implemented a two-year programme of tool-building, resource sharing and field-testing. Our multicultural and multilingual GEM Project Team and the whole APC WNSP network have gone through an incredible learning experience in this period and have amassed a wealth of knowledge in gender and ICT evaluation. In the last 18 months we worked with partners in 20 countries in 4 world regions evaluating 26 projects, organised and facilitated 20 workshops with over 300 participants and presented GEM in over 50 events in about 25 countries.

As we approach the final phase of our project, we have started to harvest the lessons and findings from this experience. This publication is our first crop. Part 1 is a synthesis of our experience in tool building, testing and training globally. Part 2 is a presentation of the evaluation findings of six GEM testers from South Africa, Philippines, Malaysia, Croatia, Bulgaria and Mexico. Through these examples, we have tried to demonstrate the numerous dimensions of gender issues in a variety of ICT initiatives - telecentres, teleworking, training, advocacy and networking. In no way was our selection of case studies an indication that the rest of our GEM testers are of less quality. Many of our partner organisation's evaluation activities are still ongoing. And finally, Part 3 is an overview of all the 26 GEM testers in 20 countries.

This year, APC WNSP is celebrating 10 years of networking support for women's actions and agenda. We dedicate this publication to the many women and some men who have persevered in making sure that gender equality and women's empowerment remain at the centre of the ICT agenda.

Chat Garcia Ramilo
GEM Global Coordinator
Manila, Philippines

Acknowledgements

APC WNSP would like to thank the community of ICT practitioners, gender specialists, educators and evaluators who have contributed to the creation of the GEM tool.

Anriette Esterhuysen, Maureen James, Rebecca Holmes, Sonia Jorge, Sarah Earl, Sara Hlupekile Longwe, Natasha Primo, Anita Seibert, Joelle Palmieri, the Popular Education for People's Empowerment, Angela Nicolettou and special thanks to Gilles Cliché.

Part 1
Global Summary: Tool Building, Testing and Training


About the GEM Project

The Gender Evaluation Methodology (GEM) for ICT initiatives is an innovative evaluation guide for ICT practitioners seeking an appropriate gender framework and analysis tools for their information and communication technology (ICT) interventions.

GEM was developed by the Association for Progressive Communications Women's Networking Support Programme (APC WNSP), a global network that facilitates the strategic use of ICTs in support of women's actions and agendas. Since 1994, APC WNSP has worked globally, co-ordinating research and "on-the-ground" activities that have highlighted the need for strengthening consideration of gender concerns in the planning and implementation of ICT initiatives.

In 1997, as a contribution to the Global Knowledge conference held in Toronto, the APC WNSP began an evaluation of its own research activities to contribute to the development of a generic ICT audit tool designed to learn more about the role and impact of ICTs on development projects. APC WNSP saw that more comprehensive tools and criteria were needed when evaluating the role and use of ICTs from a gender perspective. From this experience, we initiated a 'Lessons Learned' Project to contribute to the development and strengthening of practical, relevant and sustainable women's networking initiatives at the global, regional and national level in 1999. Through this project, we began the process of creating a framework and developing methodologies that will help us determine if ICTs have really improved women's lives. As more and more of today's development work and money is channelled into projects that employ ICTs, their effects on women are of great importance. For women, the accessibility of ICTs requires adequate equipment, information, financing, organisation, training and time. Evaluation of ICT development work is therefore critical to ensure gender equality and women's empowerment are addressed.

The first step in this process was taken in Manila, Philippines. In January 2001, 35 ICT practitioners from 16 countries gathered for a workshop on "Building An ICT Gender Evaluation Tool". The discussion at this workshop was our starting point in developing the GEM tool. The first version of the tool was completed in October 2001. After six months, we published the revised version and we were ready to test the tool. The GEM project was our main testing ground.

The GEM project's aim is to strengthen and sustain gender accountability in global, regional and national ICT networking initiatives by:

  • developing evaluation methodologies for ICT initiatives
  • generating research on the gender dimensions of ICT, particularly its impact on gender equality, women's empowerment and social transformation
  • catalysing a process of resource sharing and tools-building
  • providing insights and new directions for projects and initiatives, policy interventions and more meaningful use of ICTs for and by women worldwide
  • providing training to undertake gender evaluation of ICT initiatives
  • facilitating the creation of a network of "gender equality and ICT champions" (both individuals and organisations), with increased capacity in evaluation, policy, advocacy, and training


Through the GEM project, the evaluation tool has undergone testing and refining in the last 18 months.


GEM Tool Overview

The GEM Tool is a guide to integrating gender analysis into evaluations of initiatives that use Information and Communication Technologies (ICTs) for social change.

It provides a means for determining whether ICTs are really improving women's lives and gender relations as well as promoting empowering change at the individual, institutional, community and broader social levels.

The GEM tool contains:

  • Theory: a gender analytical framework as well as basic concepts and principles of evaluation.
  • Practice: practical 'how-to' approaches and worksheets to help you conduct your own evaluation.

GEM can be used by practitioners, including:

  • Organisations using ICT for development, human rights and other issues
  • Project managers and project staff using ICT in projects without a specific gender or women's focus
  • Evaluators working in the ICT field
  • Donors and development agency staff working in the ICT field
  • Gender focal points that support women's and ICT issues
  • Policy makers
  • ICT planners
  • Consultants in the area of gender and ICT


The guide provides users with an overview of the evaluation process (including links to general evaluation resources) and outlines suggested strategies and methodologies for incorporating a gender analysis throughout the evaluation process. GEM is not simply an evaluation tool. It can also be used to ensure that gender concerns are integrated into a project planning process.


Learning for Change

Learning for Change is the overall framework that we use in the APC WNSP evaluation model. Our model is based on the notion that learning is continually evolving and dynamic. It is interactive and not static.

The WNSP evaluation model focus examines how an ICT intervention has affected changes at an individual, organisational, community and broader social level from a gender perspective.

Special attention is directed to self and social change. This means that throughout an evaluation process there is an emphasis on understanding the dynamic relationship between an ICT initiative and both self and social change. We use the term "self" to mean not only individuals but also the organisations and communities involved in an ICT initiative. Focusing on self-change in an evaluation then means examining the dynamic relationship between ICT initiatives and the way individuals, organisations and communities operate.

Focusing on social change means that an evaluation process must scrutinise the relationship between the ICT initiative and the broader social, political, cultural, and economic context and seek to understand how this context affected an ICT initiative and vice versa.

Gender Analysis

Gender analysis in evaluation involves a systematic assessment of the different impacts of project activities on women and men. Gender analysis within an ICT context asserts that power relations involving class, race, ethnicity, age, and geographic location interact with gender to produce complex inequalities relating to social change in general, and those changes brought on by ICTs in particular. Disaggregating data by sex, analysing the sexual division of labour, and understanding the gender disparities of access to and control over resources are basic components of a gendered approach to evaluation.

GEM Knowledge Sharing Site

The GEM website www.apcwomen.org/gem was built through a collective process of structured consultations, face-to-face discussions and the collaborative work of our Knowledge Site managers. The main features of the GEM site are the GEM tool; information about the GEM project, links to WNSP's research on gender and ICTs and relevant evaluation resources; news about GEM-related activities; and information about the community of GEM practitioners. Printer-friendly versions of documents and a downloadable version of the GEM tool are also available from the site. The site is bilingual in Spanish and English. The GEM Spanish site www.apcwomen.org/gem/esp has total correspondence with the English site. The GEM tool is also available in Portuguese at www.apcwomen.org/gem/portuguese/index.htm.

GEM Intranet: The GEM Intranet was developed to enable the WNSP and its project team, GEM testers and partners, to work together collaboratively. Currently the content includes profiles of GEM testers and projects, resources such as GEM PowerPoint presentations, GEM articles and graphics, a quick reference guide and information about regional workshops.


Testing GEM

In 2002, the APC WNSP regional networks, partners and other selected organisations began testing GEM to enrich the methodology and customize it to their own ICT networking contexts and social spheres. The GEM project team has been working with 27 organisations in evaluating a variety of initiatives spread over 20 countries. Initiatives include:

  • community telecentres
  • education and training initiatives for women
  • employment and e-commerce projects
  • networking and community building projects
  • e-governance progammes
  • advancement of women's rights through women's information activities and advocacy campaigns on a range of women's issues

Table 2: GEM Testers Profile

Region

No. of Testers

Number of Countries

Regional Initiatives

Latin America

6

5

1

Asia

7

5

1

Africa

7

4

2

Central/Eastern Europe

6

6

1

Total

26

20

5

 

GEM regional coordinators are working directly with testers from all regions in developing evaluation plans and conducting evaluation activities. This is being done through means as well as face-to-face meetings. Field visits were carried out in 8 locations in 7 countries. During field visits regional coordinators met with evaluation teams to finalise evaluation plans (i.e., setting indicators, methodologies, stakeholders, and evaluation activities). In some cases they participated in evaluation activities like interviews and focus group discussions.

Network of GEM Practitioners

A total of 192 participants (157 women and 35 men) from 30 countries have been trained in the use of the GEM Toolkit through regional and local workshops. Some of these workshops focused on raising awareness about gender and ICT issues. Participants represented projects that are field testing GEM, members of the regional WNSP networks and partners who intend to use GEM in their organisations outside the testing environment.

APC WNSP planned a programme of testing and interpretation work in 4 regions: Latin America, Asia, Africa (Anglophone) and Central and Eastern Europe. Participants in the regional training workshop learned about concepts of gender analysis as they relate to ICT projects and went through the whole process of developing an evaluation plan using the GEM Toolkit. The training equipped them with enough knowledge to lead the evaluation of their organisations/initiatives with the support of the GEM project team.
At the same time, the GEM project team honed their skills as GEM trainers as they developed modules, exercises and materials to best respond to participant feedback. The team's methodology evolved through facilitation and consistent evaluation of each workshop.

Lessons in Testing

The GEM testing experience has been a very instructive process for conducting gender evaluation of ICT initiatives. The process of clarifying the objectives of an evaluation and identifying gender indicators are occasions for learning about what constitutes a gender perspective and how a gender analytical framework can be applied in projects using ICT.

GEM's conceptual documents on learning and evaluation and a social change framework for ICT use, steered testing organisations onto a solid evaluation track. Participants began to analyse their own learning experiences and the way their views and perspectives have been influenced by their context, culture, religion and various aspects of society. This understanding about gender and its relationship to ICT is one of the most significant outcomes from GEM tool use in all the regions.

For example, testers from Bulgaria, Croatia, Slovakia, Poland, Lithuania and Romania gave feedback reports that using GEM helped them to understand what role ICT can play in women's empowerment. Generally they also felt that they have become more aware about the gender and ICT issues in their context. This growing awareness is critical especially in Central and Eastern Europe where there is almost an absence of gender advocacy in the ICT policy arena and most of women advocates and organisations in the region are not familiar with the information society policies and debates nor are they connected with the existing gender and ICT advocacy networks.

The most immediate result of the testing is the discovery that most of the organisations did not have plans for evaluating their projects nor any clearly defined indicators, whether gender or general indicators, to measure the effectiveness of their interventions. After developing their evaluation plans, all of the GEM testers affirmed the usefulness of this exercise in reviewing their project plans and most of them realized the significance of their evaluation results for institutional and project planning.

In addition, the participatory approach espoused by GEM values encouraged organisations to be inclusive of all stakeholders. From the very beginning the GEM team emphasized that the GEM tool was to be used by a group or team of people ready to work on equal terms and share responsibilities and results.


Lessons from the Field

The final evaluation results of GEM testers are still to be completed; however, our findings from the testing so far have yielded a number of lessons:

Gender Sensitivity Sessions

In most cases, it is necessary to conduct gender and ICT sensitisation workshops before starting to develop a gender evaluation plan. From our GEM testers' experience, these workshops could be customized depending on the needs of the organisation. This could be a half- or whole-day session that will provide participants with an understanding of the basic concepts of gender, gender equality, women's empowerment and the intersections of gender, social transformation and ICT. Our experience has shown that while most organisations grasped the issues of gender and ICT separately, analysing the relationship between these two issues was new terrain for them.

This preparatory step is even more relevant in gender evaluation of telecentres because these initiatives are usually based in grassroots communities where traditional values and beliefs about gender roles and relations are still the norm. In all of the telecentres that tested the GEM tool, the evaluation teams consciously set in place gender sensitisation strategies promoting reflection and opening opportunities for dialogue to avoid antagonistic confrontations.

For example, in two communities in Ecuador, the GEM team was told that the community (i.e., men leaders who make decisions) wouldn't allow workshops on "feminism", because they had had problems with women's groups coming to their place to "put women against men". The GEM team decided to use another starting point: "communication, equity and ICTs". In the case of the indigenous groups, another argument is that racial discrimination comes first and to overcome racial discrimination and work in favour of cultural and racial diversity should be on top of their aims. In this case, the concept of "equity" was used with a broad meaning, including racial, gender, age, cultural and social discrimination.

From: daphne@uolsinectis.com.ar
To: gem-team@apcwomen.org
Subject: [Gem-team] Workshop in Colinas del Norte
Reply-To: gem-team@apcwomen.org
X-Reply-To: daphne@uolsinectis.com.ar
Date: Thu, 14 Aug 2003 13:37:38 -0300 (GMT+3)


Hello GEM team,

Today I met with Marcelo, Florencio and Givanna Tipan,who will be working with me in the workshop we’ll have tomorrow in Colinas del Norte, up in the mountains outside Quito. Giovanna is in charge of the manual on gender issues for telecentres.

The workshop will take place with the young people’s community organisation. It will be centred in the work they are doing for their community journal, that comes out once a month and it’s run by them. They are also in charge of the local telecentre, where the journal is produced.

It is interesting to see Gem’s development so far. Foundation ERPE will use it for planning their work in the telecentres from the very start and they think the tool will help them to address equity, which for them includes not only gender issues, but also class and racial issues. Discrimination of indigenous people in Riobamba is rampant. I had never seen it so clearly. Colleagues told me that not so many years ago indigenous people were not even allowed to take the local buses. It’s interesting to see how GEM can widen its outreach in local use. I think it’s very challenging!!!

As for Colinas del Norte, as it is a poor neighbourhood outside Quito, people there also feel discriminated because of class issues, so gender issues will also be considered within a wider perspective. They are planning to use GEM to sensitise on gender issues first, then to evaluate what they are doing in their local newspaper and as a third step, to plan their work in the very new telecentre that they are starting to run.

Remember I told you about "The Queens" group? Today, Chasquinet colleagues told me that the full name is "Queens Association" and it is not a name the girls choose for themselves, but that the community gave them because the community created that group for the girls that have been candidates or have won beauty awards in the community. So in a way from the beginning their image has been very much attached to sexism. Girls complain that they are treated as "empty heads" or "decorative objects" and that they want their community to understand their real interests and commitments. So they are very excited about taking part in the workshop. They also plan to work with the group of older women who have their small business of arts and crafts in the community. They want to show that they can do other things and not only be there to be invited to community events as pretty faces. And, of course, they also want to take more active part in the local newspaper, not only in the photographs, but in the content.

As always, I think that GEM is opening more fields for work than expected.

Cordially,

Dafne

 

Setting Gender and ICT Indicators

Identifying gender indicators in ICT initiatives, whether in policies, strategies, programs, projects and activities can be an effective way of ensuring that women's particular needs are considered in planning processes. Gender-sensitive indicators are useful tools in measuring or evaluating the impact of development initiatives in general and can be applied in the ICT field. While there is a rich body of gender indicators that have been developed in areas like health, education, human rights and political empowerment, development of gender indicators or even general development and social change indicators for ICT initiatives is only just beginning.

One important section of the GEM tool deals with identifying gender and ICT indicators for projects that are being evaluated. This exercise has been the most challenging step for most GEM testers when preparing evaluation plans. At the same time, it has been the key component in determining how and why specific ICT initiatives lead to changing women's conditions, gender roles or gender relations. Identifying quantitative indicators of access and participation has been straightforward for most of the GEM testers. What have been more complicated to track are qualitative indicators. Yet, as we know from other gender evaluation methodologies, these indicators have more vividly illustrated the relationship of ICT interventions and women's empowerment.

"Given the dimensions of a gender issue, and their obvious embeddedness within a patriarchal system, it becomes obvious that interventions on gender issues cannot be dictated by 'top-down' planners. On the contrary, women's advancement involves the process of empowerment, which we may give the preliminary definition of the process by which women achieve increased control over public decision making. Such empowerment is women's route to changing the practices and laws that discriminate against them, and achieving an equitable gender division of labour and allocation of resources. Clearly, therefore, we need a lens to see the process of empowerment, as the sequence of women's action by which a gender issue can be tackled."

"Spectacles for Seeing Gender in Project Evaluation"
Written by Sara Hlupekile Longwe for the Africa GEM Workshop held in Zanzibar in November 2002. Sara Longwe participated in this workshop as the gender evaluation specialist.

For example, five of our testers are telecentres mostly operating in rural communities in Ecuador, Colombia, Philippines and Nigeria.  Before the GEM evaluation, the telecentres simply disaggregated their user data by sex. After much probing about gender and ICT indicators, data differentiated by sex on participation in decision-making bodies, roles of volunteers and staff, activities of users in telecentres, training received and several more were identified as additional qualitative indicators. These could be classified as indicators of access, participation and use which reflect different levels of empowerment.

One lesson to be learned from the GEM testing process is that ICTs and ICT-based projects do not exist in a vacuum and that they operate within existing gendered social structures such as laws and traditional cultural beliefs and practices. The gender issues in ICTs do not only exist in the gender disaggregation of data but, more importantly, they exist in the reasons for the disaggregation. While the numbers may sometimes show that there is hardly any gender disparity in the usage and benefits of ICTs, the stories and reasons behind the numbers may reveal different realities. In planning and developing ICT policies and programmes, this framework is crucial if ICTs are to be used for social development and gender equality.

ICT for Information Sharing and Advocacy

One of the most valuable uses of ICT within the women's movement is the advancement of women's rights through women's information activities and advocacy campaigns on a range of women's issues. As such, GEM selected several projects from various regions to learn how effectively ICT tools have been used. Projects evaluated included specific e-bulletins, radio programmes and e-lists by women's information centers like Modemmujer in Mexico, Karat Coalition based in Poland, Women of Uganda Network (WOUGNET) and regional AMARC networks in Africa and Latin America.

All of these organisations designed and conducted surveys among their audience to gauge the effectiveness of their medium as well as content. For many of them, the GEM evaluation gave them their first opportunity to systematically ask for feedback from their public. Overall, the survey results were encouraging in validating the significance of the information to women in their localities or region.

An excerpt from Karat Coalition's GEM report illustrates how women-focussed information resources contribute to women's empowerment:

95,5% of the respondents of Karat's questionnaire think that Karat News helps to promote women's issues in the region and the same percentage thinks that newsletter helps to show Central and Eastern Europe/CIS perspective on gender issues. Only some of the readers share information from Karat News outside of their organisations by reprinting them in their own publications, putting them on the websites or translating them to the local language. The others use them mostly for their own needs as applying for grants, attending conferences/training they find in the news and learning about gender issues in the European Union.

As a Karat News reader puts it:

'It is the only space where regional info is accessible in one place. Every other newsgroup claims to focus on one area or region, but rarely does this happen. I rarely read those because it is supposed to be about Central and Eastern Europe and then I get everything else about Asia and Africa and what kind of conference is happening in New York. I read Karat News to follow what is really happening with women in the region, and because I know it is relevant and coming directly from the region'.

For example, Karat Coalition received feedback that information from the region and local social movement  groups are generally difficult to collect. A lot of women's activists mentioned their e-bulletin as a very important component of their daily work, keeping them informed about the main initiatives, trends in the region and helping them to learn new experiences, shape objectives for their future activities, find new partners and give them ideas for the development of their NGOs. Most of the women activists, especially those from the European Union candidate countries, are also looking for information about the EU enlargement process that directly impacts on the economic and political situation in that region.

A common limitation noted in many instances is the need for more content translated into major regional languages or local languages.  Most regions are not linguistically homogenous, therefore language should be a key indicator that measures accessibility of information. 

In an evaluation of a Ugandan information network, respondents said that WOUGNET's website and mailing lists contributed to the visibility of Ugandan women's issues and had promoted women's causes in Uganda. Information provided were repackaged for further dissemination by alternative means such as radio and print publications. The need for more local content and information in local languages was emphasized. In addition, it was noted that while WOUGNET is very beneficial to all its members, active participation is limited to a few and therefore more work is needed to enable more members to fully engage in the network. Respondents also called for ICT awareness and training sessions, greater networking among members, consideration of other modes of information sharing/dissemination - targeting rural access in particular, and support in acquiring ICT equipment and internet services.

GEM Raises Awareness about the Significance of ICTs on Women's Lives and Society

While the objective of the GEM evaluation is to zero in on examining specific projects, the process to get to this point has led the GEM team and GEM testers to comprehend critical trends and issues connected with the so-called information or knowledge society. Depending where the testers are from, the issues that have been tackled in GEM workshops and reports range from the digital divide, privacy and security, democracy and governance, employment and economic opportunities and many more.

A clear recommendation emerging from testing is the need to document and promote models of strategic use of ICTs among women, as well as other disadvantaged groups. Of equal importance is building awareness among gender advocates and women's organisations with the strategic aim of making them more familiar with gender issues in ICT and to support the development of pro-active gender advocacy in ICT policies.

Through the GEM testing, we have deepened our understanding of many critical gender and ICT issues. Some of these are elaborated on through the case studies that are presented in this report. We would like to highlight three significant issues resulting from our regional testing.

  • Women and Teleworking

ICTs are being touted as opening new opportunities for employment. They are presented as a novel employment model with employees working from the comfort of their homes. In many cases, teleworking is seen as an option among those who want to be employed but prefer or need to stay home for reasons such as disabilities, chronic illness or caring for the children. Women, who are mostly responsible for child caring, domestic work or caregiving for old and chronically ill members of family, are seen to be one of the groups that could move into this new organisation of work. In many parts of the world, teleworking is becoming more widespread as a way of home-based work. However, there is a general lack of information regarding the potential problematic aspects of teleworking (such as social security of teleworkers) and its real impact on the life and empowerment of women. There is a need to examine and open the discussion about the impact of teleworking on women's multiple roles in the family. A teleworking case study is presented in this report to shed light on this significant ICT development. While the findings about how teleworking challenges traditional male and female roles in the home are not conclusive, the report points out that indicators and benchmarks in terms of changes in gender roles and relations as a result of teleworking will be critical in determining the long term impact of work arrangement.

  • ICT Training for Women

Five ICT training initiatives are participating as GEM testers and are evaluating their projects. These initiatives vary from basic training for rural women in South Africa to  employment skills training in Croatia to web-based information management and e-commerce for women's organisations in Asia-Pacific. In most cases, these training opportunities have been positive for the women trained. Indicators of various levels of empowerment include the reinforcement of their self-esteem as women found themselves able to learn a new and more advanced communications technology,

ICT facilitated networking that in turn has allowed expanded participation in decision-making and strengthened internal democracy, led to improving one's chances of finding a job and provided people with renewed confidence in themselves.

Many more women can benefit from appropriately designed training programmes in all regions. There is need for more resources to support training initiatives that have demonstrated a developmental and empowering impact.

  • Universal Access Issues

Access to ICT infrastructure and basic ICT skills continue as the most common gender and ICT issues identified by all our GEM testers. The digital divide is mostly linked to developing countries of Africa, Asia and Latin America, but it is also an important issue in Central East Europe, considering the low access of traditionally marginalized groups. It is crucial to focus especially on the women  who are disadvantaged by several social factors, such as single mothers, disabled women, older women, women living in rural areas, unemployed women or women from low-income groups, women refugees and women from ethnic minorities.

Despite statements that universal access is a priority in most ICT national policies for the majority of the countries included in the testing, the use of ICT remains difficult because of the low levels of access. Given these limitations, promoting good practice on strategic use of ICTs for women's empowerment and gender equality becomes more critical.

Evaluation Plus: GEM's Other Uses

WNSP's Policy Advocacy Work

The GEM tool has informed WNSP's policy work through its conceptual papers expounding a critique on gender and ICTs. The analysis and positions in these papers have been used as the main basis for WNSP's advocacy positions in the current preparatory activities for the World Summit on the Information Society. Advocacy for integrating a gender perspective in ICT programs and policies was high on the agenda of WNSP's recommendations. WNSP has been a leading gender advocate in all WSIS regional and global Preparatory Meetings held in Bamako, Tokyo, Bucharest, Bavaro and Geneva. APC WNSP 's gender Issues Paper for WSIS can be found in www.genderit.org and in the APC Publication "Involving Civil Society in ICT Policy" http://www.apc.org/english/news/index.shtml?x=14223

There are early indications that in the area of policy development, GEM's initial work in identifying gender and ICT indicators will have an impact. The development of gender and ICT indicators has been consistently taken up as part of policy recommendations.

Outside of the WNSP and our partners, we have been asked to present the GEM tool in numerous events and many organisations have asked us about how to use the tool.
The promotion and dissemination of GEM has expanded and reached new audiences. The GEM project was presented in several international activities including the Second Global Congress of Citizens Networks, Buenos Aires, Argentina, December, 2001; World Association of Christian Communication World Congress, December 2001; Symposium on Gender Equality and ICTs Development in Hong Kong, Hong Kong, April 2002; KnowHow Conference, Kampala, Uganda, August 2002; AWID Forum, Guadalajara, Mexico, October 2002; Global Communities Network, Montreal, Canada, October, 2002; Pacific Islands Regional ICT Consultation, Suva, Fiji, April 9-11, 2003; UNESCO Expert Group Meeting on "Digital Inclusion and Social Change: Technologies and Strategies", Paris, France, July 14, 2003; and the Forum on ICT and Gender, Kuala, Lumpur, Malaysia, August 27-30, 2003.

GEM Service

In keeping with APC WNSP's focus on building its overall capacity in delivering sustainable GEM service to a much wider audience, the project has involved 26 WNSP members from its networking regions. Members have been trained through the GEM regional workshops and are involved in actual evaluation of projects. GEM has also been used as a framework in:

  • Mainstreaming gender in national ICT policy development
  • Integrating a gender perspective in e-governance and political participation programs
  • Developing a framework for gender and ICT research

GEM team members have also successfully applied GEM in gender and ICT consultancy projects for international agencies.

Table 5: GEM related consultancies

Project
International Agency
GEM Application
Output
E-Governance for Efficiency and Effectiveness Program,
Bilateral Co-operation with Philippine Government
Canadian International Development Agency Assess capacity of Philippine government to mainstream gender in e-governance project using GEM framework Gender Audit of current e-governance programsGender indicators e-governance program
UNIFEM Support For E-Quality in The Information Society (Eastern Europe) UNIFEM Provision of technical advice on gender and ICT issues in relation to overall WSIS process including integration of gender dimension in European Economic Commission policy paper. Recommendations in developing a gender and ICT program to help strengthen women associations and movements in Eastern Europe UNIFEM Policy paper and presentation at WSIS regional meeting in Bratislava on November 7.

GEM Team members act as resource persons for UNIFEM's program development workshop.

Gender and ICT in CEE/CIS: Assessment of the state of ICT from gender perspective United Nations Development Program/UNIFEM Central and Eastern Europe Office Identification of best practices, challenges and lessons learned; Gender analysis of key initiatives, activities, programmes, projects undertaken (or planned) by different stakeholders in the region Report mapping the situation with regard Gender & ICT, identifying problems and providing recommendations
Gender and ICT in CEE/CIS:
Engendering the E-governance Academy UNDP Project, Estonia
United Nations Development Program,
Central and Eastern Europe Office
GEM methodology will be applied to the existing course curriculum, with a view to advising as to how the curriculum could be modified to incorporate a gender perspective Guideline for mainstreaming gender into the current
curriculum of E-governance Academy
International Seminar- Equality and Gender Unit Equality and Gender Unit, Regional Government of Andalucia, Spain Introducing GEM to local national government of Spain and local and regional government of Andalucia, people
working in the Structural Funds initiatives, Gender
Equality Machinery all over Spain, Universities and gender experts.
Conducted two workshops for over 100 participants.
ICT for Development Seed Grants Global Knowledge Partnership Using GEM as a framework for developing evaluation plans for ICT projects Evaluation and Monitoring Plans (that integrates a gender perspctive) for 9 ICT seed grants projects. Ongoing.
Gender and Agriculture in the Information Society (GENARDIS) Small Grants Fund Technical Center for Agriculture and Rural Co-operation (CTA), The International Institute for Communication and Development (IICD) and theInternational Development Research Center (IDRC) Using GEM to develop an evaluation and monitoring plan for the Grants Program. Evaluation and Monitoring Plan. Ongoing.

GEM in 2004

Two thousand and four will be a bumper year for the GEM project. After two years of field-testing, refining the GEM tool, training a network of GEM practitioners and presenting GEM in numerous forums all over the world, WNSP will reap a rich harvest of resources, lessons and skills. We offer these significant insights and new directions for projects and initiatives, policy interventions and more meaningful use of ICTs for and by women worldwide. And, we expect that this process will also facilitate the creation of a network of "gender equality and ICT champions" (both individuals and organisations), with increased capacity in evaluation, policy advocacy, and training. We hope that this bumper crop will be a significant contribution towards sustainability of women's ICT networking initiatives and the strengthening of gender accountability in ICT initiatives and projects in general.

When you visit the APC WNSP - GEM knowledge sharing site next year, expect a new, revised version of the GEM tool that you can use or download, with more exercises, examples of indicators and methodologies and reports of GEM testers' evaluations. The site will include an interactive feature for GEM users and you will be able to add your own indicators and methodologies.

We will also include GEM guides for specific uses such as GEM for Telecentres (a resource being developed Chasquinet, one of our GEM testers), GEM for planning and GEM for ICT policy analysis. The GEM tool will also be translated in more languages including French and Arabic.

The APC WNSP network sees this work as part of our advocacy to promote the strategic use of ICTs for women's empowerment and equality.