![]() |
![]() |
|
Guide to Quality: Even Start Family Literacy Program
Implementation and Continuous Improvement
Final Draft submitted to:
Even Start Family Literacy Program _________________________________________________________________
This draft guide has been submitted to U.S. Department of Education for publication and is available for public use and may be copied and disseminated. Use of the guide and its contents, in whole or in part, should be cited as follows: RMC Research Corporation. (2001, June). Guide to Quality: Even Start Family Literacy Program, Volume I (revised). Manuscript submitted for publication. _________________________________________________________________
U.S. DEPARTMENT OF EDUCATION Rod Paige Secretary Office of Elementary and Secondary Education Susan B. Neuman Assistant Secretary OFFICE OF COMPENSATORY EDUCATION Joseph Johnson Director EVEN START FAMILY LITERACY PROGRAM Patricia McKee Group Leader JUNE 2001 This publication is in the public domain. Authorization to reproduce it in whole or in part is granted. This guide was supported by a contract between RMC Research Corporation and the U.S. Department of Education. The document contains Web sites for information and resources created and maintained by other public and private organizations. This information is provided for the reader’s convenience. The U.S. Department of Education does not control or guarantee the accuracy, relevance, timeliness, or completeness of this outside information. Further, the inclusion of information or addresses or Web sites for particular items does not reflect their importance, nor is it intended to endorse any views expressed, or products or services offered. Copies of this publication may be ordered in the following ways:
Guide to Quality: Even Start Family Literacy Program, Volume I (Revised)
Table of Contents
Preface ____________________________________________________________________ This Guide is a revised version of the original Guide to Quality, published in 1995, and it includes new research and best practices from the field of family literacy and programs throughout the country. The research findings from the multiple fields that comprise family literacy are supported and augmented by the first-hand experiences and knowledge of practitioners and program administrators. This revised Volume I replaces the original Guide and will have a companion guide, Volume II, that will cover additional topics and program services (to be published in 2002). Some of the highlights of the revised Volume I are:
Acknowledgements Many people provided guidance and feedback throughout the writing of this Guide. From the U.S. Department of Education, we would like to thank: Patricia McKee, Doris Sligh, Tanielle Johnson and Laura Lazo (Even Start Program office); DonnaMarie Marlow (Migrant Education); and Miriam Whitney (Office of the General Counsel). We received invaluable comments and suggestions from Even Start state coordinators and staff from agencies, such as Parents as Teachers, who participated in focus groups. And special thanks goes to Diane D’Angelo of RMC Research, who contributed greatly to the writing and review of the Guide. We hope that the accumulated research, wisdom and practice contained in this Guide help you to design and conduct programs that enable families to reach their literacy and life goals, thereby improving the lives of those you touch by helping them to realize their dreams for a better life.
M. Christine Dwyer Section I
Purpose and Development of the Guide Purpose Effective family literacy programs are an important part of President Bush’s education agenda and pledge to "leave no child behind." The Guide to Quality: Even Start Family Literacy Program Implementation and Continuous Improvement, Volume I (Revised) covers what has been learned by Even Start program staff in the field and research that informs practice from the last ten years. The Guide describes characteristics of high quality, effective Even Start programs, and is intended to be used for multiple purposes related to improving program quality. This Guide: (1) serves as an outline of important program characteristics and practices for implementing new and existing Even Start programs; (2) provides a self-assessment tool that programs can use to identify strengths and weaknesses, and areas for staff development and continuous program improvement; (3) helps state personnel and peer review teams to improve programs by identifying characteristics of quality programs, as well as noting indications of possible problems; and (4) gives potential collaborators information about Even Start goals. The ultimate purpose of the Guide is to improve literacy and self-sufficiency outcomes for Even Start families. The statements of quality included here are intended as guidelines that can be used to design effective family literacy programs based on research and best practices. Scientifically-based research available from the fields of early childhood education, literacy and parenting is reflected in this Guide. The U.S. Department of Education (the Department) perceives the design of local programs to be a matter of state and local discretion, once the statutory program requirements are met. The quality statements are examples of approaches that have led to successful outcomes; they are not program requirements. Even well-managed and effective programs may not implement all the suggestions included in this Guide. This Guide does not replace federal laws or program guidance; programs must meet all of the requirements of the Even Start law, Part B of Title I of the Elementary and Secondary Act of 1965 (ESEA), as reauthorized and amended by the Literacy Involves Families Together (LIFT) Act of 2000 (see Appendix). Development The original and revised Guides were developed in response to requests from Even Start state coordinators for a document they could use during project site visits to engage staff in discussions about "what makes a quality family literacy program." The process of development included input and review from Even Start and other family literacy practitioners, Even Start state coordinators and federal staff. The Guide incorporates information from a variety of sources: (1) Even Start national evaluation results; (2) research in fields related to Even Start, specifically early childhood education, adult education, collaboration, parenting education and home visiting; (3) the accumulated wisdom and practice of family literacy program staff and administrators that has been shared through conferences and site visits; (4) the theoretical base that has emerged for family literacy led by the work of the National Center for Family Literacy; (5) the work of other fields in developing indicators of quality, especially adult education and the National Institute for Literacy; and (6) legal requirements in the Even Start program legislation. Special Populations Even Start programs that serve special populations (for example, migrant or English language learners) or operate in specialized contexts (for example, isolated rural areas, homeless shelters or prisons) will need to adapt the quality statements to their program circumstances. Some of the quality statements may not apply or they may apply very differently to these programs. The staff of programs serving special populations may need to consider cultural and linguistic characteristics of their families and adjust services accordingly. Organization of the Guide The statements of quality are presented within twelve major topic areas. In practice, these areas are integrated so there are many interconnections across the topics.
Using the Guide for Continuous Program Improvement _____________________________________________________________________________ Lessons from the National Evaluations of Even Start The purpose of the Even Start Family Literacy Program (Even Start) is to help break the cycle of poverty and illiteracy by improving educational opportunities for the Nation’s low-income families through the integration of early childhood education, adult literacy (adult basic education or English as a Second Language), and parenting education in a unified family literacy program. Under Even Start, Federal financial assistance has been provided since 1989 for family-centered education projects to help parents gain the literacy and parenting skills they need to become full partners in the education of their young children (ages birth through seven), and to assist those children in reaching their full potential as learners. The Department has conducted three National Evaluations of Even Start, which have traced the growth, changes, progress and trends among programs. There are direct connections between the quality considerations suggested in this Guide and findings from the national evaluations. Whether a program retains families, offers sufficient hours and types of services, and collaborates with other agencies to meet families’ needs greatly affects the participation rates and success of family members. A few highlights of the evaluation findings are:
Adult Education. When 16 or less hours of service are offered per month, adults’ participation averages 100 hours per year. When 48 or more hours of service are offered per month, adults’ participation averages 216 hours per year. Parenting Education. When 8 or less hours of service are offered per month, adults’ participation averages 29 hours per year. When 25 or more hours of service are offered per month, adults’ participation averages 80 hours per year. Early Childhood Education. When 24 or less hours of service are offered per month, children’s participation averages 235 hours per year. When 80 or more hours of service are offered per month, children’s participation averages 410 hours per year.
Another important finding relates to families’ involvement in the above-mentioned services and in parent-child interactive literacy activities. Overall, families in projects that dedicated significant amounts of time to parents and children learning and playing together had measurable improvements in their home environments compared to families in projects with considerably less parent-child time. Some of the indicators of improved home environment were: having more reading materials in the home; practicing positive disciplinary approaches; and parents and children engaging in learning activities related to daily events and routine family activities. Even Start Services and Indicators of Program Quality Family literacy programs are complex to implement because they rely on cooperation among education and other community services, and require knowledge of best practices in a number of fields. In 1995, the Department published the first edition of the Guide to Quality to highlight the practices associated with programs that produced positive outcomes for families. The practices listed in the Guide to Quality came to be widely known in the family literacy field as "program quality indicators." In a move toward increasing the quality of all Even Start programs, Congress amended Section 1210 of the Even Start law (Part B of Title I of the ESEA) in 1998 to require that all states develop "indicators of program quality" based on the best available research and evaluation data. The amendments also require States to use those indicators to monitor, evaluate and improve the progress of Even Start projects. But some confusion was introduced at the same time because Section 1210 uses the term "quality indicators" in a new way, meaning indicators that describe performance outcomes for adults and children. For example, required indicator categories in the law include attainment of secondary diplomas or equivalents and employment for adults, and progress on reading readiness skills and school attendance for children. In addition to the required indicators for participant outcomes, the law allows states to develop other participant and program quality indicators. Program quality indicators that describe best practices in the design and delivery of Even Start services are the subject of this Guide.
Use of the Guide by state agencies This revised edition of the Guide provides ideas for state agencies to use in developing quality standards for Even Start program implementation to supplement the required performance outcomes. States could select indicators of quality from the Guide that they consider important enough to require of all their programs. These may include: (1) expectations associated with staff development and staff supervision; (2) the nature and frequency of home-based instruction; (3) procedural requirements, such as exit and transition policies; and (4) particular features of instructional approaches, such as explicit teaching of phonological awareness, vocabulary, and comprehension skills. States are encouraged to focus local programs’ attention on best practices in order to emphasize the quality of program delivery as well as program outcomes. The quality considerations in this Guide are based on evaluation and research findings, and the advice of expert theorists. When particular intensities or ranges of behavior are suggested, they are grounded in evidence from research. Individual states may choose to be more prescriptive than the Guide in their setting of quality standards for programs. For example, a state may decide to require programs to maintain particular staff-to-family ratios or provide a specific number of service hours. Use of the Guide by local programs Local Even Start programs should consult their state’s plan for information about the specific program standards and performance outcomes that apply to them. The terms or phrases used to describe different types of expectations may vary by state. States usually make distinctions in terminology between qualities of program implementation (often called "quality indicators," the subject of this Guide) and outcomes for participants (often called "performance indicators"). In some cases, they are both called program quality indicators or other similar terms. The purpose of using indicators to measure program quality is more important than the terminology. Local program administrators are encouraged to use the indicators in this Guide for reviewing and assessing local program implementation, whether or not their state agency requires them to measure program quality in a formal way.
Even Start Snapshots
Scenes in the Life of Even Start Programs
The following snapshots are based on examples from local Even Start programs throughout the country, the Even Start National Evaluation, and work of the National Center for Family Literacy and RMC Research Corporation.
Snapshot 1: Partnerships, Collaborations and Recruitment ____________________________________________________________________ Creating a vision and a plan » An urban school district and a county non-profit family service agency are partners on a successful Even Start proposal, and they are implementing the plan together. The Even Start program is scheduled to open in a few months. Community agencies representing a wide range of services – the housing authority, Head Start, adult basic literacy – supported the proposal and wrote contracts with the new Even Start entity. These contracts describe the services and resources they will provide as part of their collaboration with the program. The partners and collaborating agencies discussed their vision for the program as part of writing the proposal, and the new Even Start director, Angela, wants to get everyone back together as soon as possible to develop a detailed first year plan based on this vision. She knows that she cannot assume everyone has the same approach or agenda for the families they will serve, and that all the agencies need to develop good working relationships for the Even Start program to be successful. When the school district and the family service agency were writing the proposal, they asked some of the collaborators and local leaders if they would serve on an advisory board. Angela is holding an "opening celebration" for the Center, where her staff, advisory board members, and staff from other programs will meet and get to know each other. Angela and the partners will explain the purpose and services of Even Start, and outline the types of support the new Center needs. In fact, one of the board members has already donated office furniture. It is important that everyone involved can articulate the vision and their commitment, and represent the program in their personal and professional circles. One collaboration challenge that Angela already anticipates is the relationship with the Head Start program that operates in the local schools. Angela sees no duplication of services and little competition for families, but she wants to avoid any perception of real or imagined "turf wars" between programs. There are a large number of families who need the services of Even Start and Head Start, and collaborators have been chosen because they can reach different target populations and serve different needs. In fact, at the first planning meeting of collaborating agencies, representatives made short presentations about each program’s mission, services, eligibility, and client demographics and profile. One strategy Angela is going to suggest at the next planning meeting is that they develop a joint screening and intake tool. This will facilitate the referral of families to appropriate agencies and ensure that they receive some services while waiting to enroll in programs. The agencies have already implemented a tracking system for referrals made among programs, so a common intake tool would enhance cooperation and management of services to families. The collaborating agencies have already started joint staff training. The first steps were easy because agencies that already had scheduled training shared that information. Also, the agencies’ staffs filled out surveys concerning what topics they were interested in, what their subject and training expertise were, and if they were willing to present cross-training workshops. Some of the topics they said they would like to have training in were: child development, literacy, nutrition, health issues, legal services, and parenting education. The staffs of Even Start and Head Start have also decided to hold a joint family day event, because they anticipate they may have some families in common. The partner agencies, advisory board members and Angela plan to have a retreat at the end of the first program year. They will review the budget, program records, and progress made during the first year. Some of the topics that staff and board members have suggested for discussion are whether the recruitment and intake processes are reaching the neediest families, and uncovering their social service as well as literacy needs, and if there are sufficient services available to meet the identified needs. They will also set goals for the second year, and identify resources to support the long-term program plans. Six months later, recruitment is underway » Angela and her staff developed an annual recruitment plan using multiple methods and resources. The plan includes: a highly visible media campaign (for example, public service announcements, calendar of events, ads in newspapers, flyers, brochures, posters); an open house twice a year; monthly special events; participation in community events (for example, fairs, neighborhood days); and a schedule for distributing materials through community agencies and in neighborhoods. Recruitment materials are written in the languages and at the literacy level of the families targeted by the program. Neighborhood canvassing is done as often as possible; at a minimum, it is done three times a year. Teams of staff members canvass neighborhoods with which they are most familiar. Current Even Start participants are encouraged and asked to join the recruiting teams. Canvassing is frequently done door-to-door, particularly targeting homes with young children’s toys in the yards and hallways. Staff also visit the local laundromats and convenience stores to talk about Even Start and to leave brochures. Staff set recruitment goals related to identifying families that are most in need based on profiles of the community, which they get from local government and other agency annual reports. Calls are made to potential families, and are followed up with personal visits whenever possible. Staff and parents complete a "screening questionnaire" at home, which is intended to describe the family as well as provide clues about their literacy skills. For instance, staff may ask the age and educational level of all persons living in the home, what they enjoy doing together in their leisure time, what activities the children do at home, if there are special concerns about any family member, and what about the Even Start program sounds important or appeals to the family. The staff select the families most in need of Even Start services based on this screening tool. Staff need to keep in mind the program’s limited resources and determine how they will most effectively serve the families most in need. Staff will refer families to other services in the community if Even Start has a waiting list. Staff review the waiting list each month and stay in contact with the families by mail and phone. Staff talk about the expectations of participants with each family before they enroll in Even Start. In many cases, the staff provide some type of support to the families until they can enroll, such as offering free books. Each staff member must be able to articulate the purpose and services of Even Start because recruitment is a continual process. To prepare, staff model talking about Even Start to potential families and referring agencies during staff meetings. Each staff member sets recruitment goals, such as number of monthly contacts with families and agencies. Recruitment becomes a weekly agenda item at staff meetings. Angela has hired bilingual staff to communicate with Spanish-speaking families during recruitment and enrollment. Staff exhibit their desire and need to be knowledgeable about community resources by serving on other agencies’ committees and boards, which also increases the visibility and outreach of the Even Start program. Many Even Start family events are planned with and include families in other agencies, such as Head Start and the YMCA. Resources and facilities are shared so that families learn about the other services. Ongoing and continuous community outreach builds trust and relationships with collaborating staff.
Snapshot 2: How Programs Structure Services for Families _______________________________________________________________________________ Wanda begins with home-based instruction » Wanda lives in a trailer at the end of a three-mile dirt road with her four children. She dropped out of school when she was fifteen to have her first child. Her two school-age children are enrolled in Title I programs and one child has some hearing loss in the right ear. He is waiting to receive a hearing aid. The youngest children are two and four years old. Wanda has a difficult time helping her children with homework and often accuses the teachers of asking her to do their work. Mona, the Even Start home instructor who works with Wanda’s family, says there are not enough pots to catch the water dripping from the ceiling when it rains. Wanda does the best she can, living far from town with no car. Twice a month, her sister comes over to take the family to town to buy supplies. The family’s main connection to the world is the television and Wanda’s love of stories. She enjoys making up pretend tales to entertain the children. She agreed to be part of a home-based Even Start program because she gets lonely, and wants the children to "learn something" and have a better life. Mona decides to discuss Wanda and her family at the next staff meeting so the team can help her plan an integrated approach to providing services. During the staff discussion, it becomes very clear to Mona that Wanda’s interests and needs are interrelated. Wanda’s desire to improve herself and to help her children could be the catalyst for addressing many of the concerns she has for her family. The staff recommend that Mona build the initial adult literacy lessons upon Wanda’s interest in reading to her children. She could write her "pretend" tales and practice reading them to her children. The parent-child interaction time could include writing down the children’s stories for school. The staff suggest that Mona talk to Wanda about what to expect at parent-teacher conferences at school so that Wanda will understand what her children are learning. Mona should use every opportunity that arises to emphasize to Wanda the value of reading and writing for herself and her children. Mona might ask Wanda what types of learning activities she would like to do with her children, and she can suggest things like a trip to the library if Wanda does not suggest it herself. Mona hopes to transition Wanda into the Center to involve her in discussions with peers about managing her children’s behavior, decreasing television viewing, and other parenting issues. Mona also wants to get Wanda’s youngest children involved in the early childhood education program at the Center. Wanda might want to come to the Center’s classes after meeting other parents and seeing first-hand what is available for her children there. Mona began developing a family action plan with Wanda during the next home visit. Wanda identified three goals she wanted for herself and her children. As next steps, Mona and Wanda identified a long list of resources she would need to accomplish her goals: money to buy a car, a driver’s license, job training and a job, a library card, better reading skills, and the self-confidence that she can do this. So Wanda began to prioritize the things she needed to do first: learn to read better, explore job options, ask her sister about watching the kids. Mona skillfully incorporated interactive literacy and parenting activities that related to Wanda’s goals into the weekly Even Start instructional home visits. She also guided her through problem-solving exercises to explore solutions to some of her needs, such as transportation and housing. Mona let Wanda use her laptop computer to practice writing her stories and printing pages so the children could illustrate them. Wanda was amazed how easy it was! Mona also suggested that Wanda call her church or volunteer groups to ask about free transportation to the library and to the school. To start her community outreach, Wanda decided to call the welfare office to see if there were funds to evaluate her son’s hearing loss. As she began to see evidence of her accomplishments, Wanda became very excited about her future. She agreed to bring the children to the "Family Fun Day" at the Center. Each child selected a favorite "homemade" book to bring. They loved the attention and praise they received from everyone. Claudet attends center-based adult literacy instruction » An Even Start program in rural Pennsylvania offers the adult education component both at the Even Start Center, located in the elementary school, and through the home-based instruction program, which offers an individualized adult learning curriculum. One of the students, Claudet, a married mother of four, is finishing her second year with Even Start. She dropped out of school in the tenth grade following the birth of her first child. Her main goal when she enrolled in Even Start was to be able to read "chapter books," not just picture books, to her children. She now has two children in grade school and she wants to help them learn. She feels this will encourage them to finish high school. She said she is embarrassed that she cannot read well, especially when she is out in public. For example, she cannot read all the words on food labels to buy "good" food for her children and feels "ripped off" at fast food restaurants because she cannot figure out if she gets the correct change. The friend who initially brought Claudet to Even Start has already gotten her general equivalency diploma and is starting a job. Claudet said she may want to get a job when her children are older. She knows she does not have adequate skills to get a decent paying job now. When she entered the program, her short term goals were to get a library card so she could get books to practice reading to her children, learn how to help her children with their homework, and improve her basic math skills. Initially, Claudet received adult education instruction at home, but made the choice to come to the Center with her two youngest children. One incentive for this was that transportation was provided by Even Start. Claudet admitted that she was afraid to come to the Center’s adult education program, but decided to try it because "all the staff who have visited me at home are so friendly and encouraging." She is finding that her children love their classes at the Center, and that she can set up a class schedule four days a week that is flexible and works around her family’s schedule. She also likes that the staff remind her about special events and call her if she misses classes because it shows they care. Although the whole family enjoys the interactive literacy activities and early childhood program, Claudet is afraid of being tested for her adult education classes at the Center. She is comfortable with the parenting sessions, since she feels she is a good parent and enjoys talking with the other mothers. But school to her means reading textbooks, filling in workbooks and taking tests – which she has never done well. To her surprise, the first thing Claudet and her teacher did was to discuss what she wanted to learn and she completed a self-evaluation. Eventually, she was tested on her literacy and math skills, but she was comfortable with the teacher and understood the purpose of the testing so she was less nervous and fearful. Claudet is surprised that she and the other students read real life materials, like novels and magazines, and discuss topics they want to learn about, such as budgeting, family health concerns, and how to write a resume. She is amazed that she and the other students have similar feelings and desires, and she is eager to talk about her life experiences during class discussions. Claudet also enjoys listening to the teacher read to the class and often takes a tape recorder home so that she can listen to lessons on tape. She finds she learns better by listening and is really pleased with the progress she has made. Claudet told the staff that she feels her adult education teacher is very knowledgeable and teaches the material in a way that she understands. Claudet was particularly pleased to announce to the class that her husband just enrolled in the adult education classes offered at night to get his GED because he saw how positive she felt about Even Start. Claudet is surprised by how much she likes computers. Her program has partnered with another Even Start program in the state and Claudet has a pen pal she keeps in touch with through e-mail. She is thrilled that she can take the Center’s laptop home to do work with her children. She decided that getting a job working with computers might be a good long-term goal. At the end of her first year of classes, she received a Certificate of Improvement because she has made significant progress toward completing a level in the adult education course. Claudet constantly says, "This is not like going to school. I feel good coming to my Even Start school." Because she feels more confident about her skills, Claudet is volunteering in her oldest child’s third grade classroom. She has already achieved one of her goals: learning how to help her children with their schoolwork. Luann and Hosea make progress » Hosea and his mother will have many changes in their lives this fall. Hosea will start kindergarten and his mother, Luann, will attend adult education and parenting classes full-time at the Even Start center. They have really enjoyed the visits from the home instructor, and Luann feels she does many more literacy activities with Hosea on her own at home. But when they discussed the topic of transition during parenting class last semester, Luann was concerned and nervous about how both she and Hosea would adjust to being in school all day and separated from each other. The Even Start staff assured her that they helped families make changes like these, and that she would discuss transition plans for herself and Hosea with a staff member. Even Start has a committee that maintains contact with teachers, social workers, employers and others so that staff and families have the information they need to plan smooth transitions for family members. Talking about her concerns gave Luann reassurance about Hosea beginning kindergarten, and she began to get excited about spending more time at the Center for her adult studies and job training. The Center already has several effective transition policies in place. For instance, Even Start staff meet with the kindergarten teachers each spring to discuss the children coming from the program and to focus on the needs and abilities of each child. They also exchange ideas about what worked and did not work programmatically for different children during the past year. They use this opportunity to set up joint training in early childhood development and curriculum planning for both staffs in the upcoming year. Hosea was given the screening test for kindergarten at Even Start to see if he had any disabilities that required attention. The staff explained all of the services and special opportunities that the public schools offer for children and families to Luann. Luann now feels that she could ask for additional services for Hosea, if he needs them. Luann’s home instructor encourages her to read books about going to school to Hosea, find or start a playgroup during the summer, and to talk about and emphasize all the positive things about school to prepare him. Hosea’s Even Start early childhood teacher has already agreed to accompany Luann to the parent orientation at the public school in a few weeks. Hosea and his friends from the Center who are going to kindergarten together are scheduled to visit the kindergarten class with their Even Start teacher. Luann received a voucher for public transportation to visit Hosea’s new kindergarten classroom. She was told that these vouchers are available for any visits she would like to make to help out in the classroom during the school year. The school mailed her an information packet, which was printed in both English and Spanish. She was able to share it with Hosea’s grandmother who only speaks and reads Spanish. At the parent orientation meeting, the teacher explains the developmental nature of the kindergarten program to Luann. She learns that a high level of parent involvement is welcomed and encouraged, and that her opinion of how Hosea is doing is very valuable to the teachers. There will be two scheduled parent-teacher conferences a year, and frequent written correspondence and telephone contact with parents. Hosea’s Even Start teacher tells Luann that she would be happy to review the materials from school with her at any time. Luann will also visit Hosea each week in kindergarten as part of the parent-child interaction time with Even Start. She is very pleased about this. As for her own "school schedule," Luann met with the adult education coordinator to discuss and choose her classes. She plans to take a mix of pre-GED classes and job training, to work toward her goal of being a teacher’s aide. Maybe she can work in Hosea’s school one day. Luann arranged her schedule at Even Start so she can accompany Hosea to school his first day. Luann is feeling much better about their "transitions into the future" this fall.
Snapshot 3: Evaluation leads to Program Improvement ___________________________________________________________________ Evaluating participant outcomes and program services » The topic of this monthly Even Start staff meeting is evaluation – specifically, what the staff can do to improve services based on their program’s evaluation data. The program director, Lynn, and her staff are concerned about the unexpectedly disappointing results of their adult learners’ TABE scores (Test of Adult Basic Skills) compared with other programs in their state. They also compared the number of adult education hours their program participants receive compared to national Even Start data, and found that their participants receive fewer instructional hours than the average hours for adults in other programs. So they decide to track content hours more closely this year, which will require the cooperation of collaborating agencies. The subject of collaborators brings up the whole issue of how well the current relationships are working. The staff at this meeting are from the two major Even Start partner agencies, which provide parenting and early childhood services. Most of the adult education services are provided by a collaborating agency. Lynn mentions that they need to expand their circle of collaborating agencies because the current agencies do not have the funds or service capability to handle the range of needs of enrolled families. The staff agree that more collaborators are needed. However, some of them bring up problems with current cross-agency coordination that they would like to discuss. The examples given are: (1) efforts to share information about and stay in contact with families are not reciprocated, and Even Start staff are not invited to other agencies’ meetings; (2) referrals from one particular agency are usually inappropriate, which suggests they do not understand the purpose of Even Start; (3) parents have complained that the adult education instructors do not use materials that relate to their goals or requests. Everyone agrees that these are problems that need to be addressed before additional collaborators are sought. Lynn suggests that they ask their independent evaluator, Jack, to include this issue in his upcoming annual evaluation plan. In the past, Jack has helped Lynn and the staff to assess the long-term family outcomes of their participants and to clarify program direction. For this year’s evaluation, Jack plans to: (1) assess the extent to which adults in the Even Start program have met goals in their Family Action Plans; and (2) examine parenting outcomes, such as changes in educational expectations of children, parent-initiated contacts with schools, and understanding of children’s curricula and instructional content. After discussing the history of and staff’s concerns with the current collaborators, Jack summarizes what he hears as the crux of the matter: the purpose of collaboration is to extend support services to families to meet the goal of comprehensive services for families, and the weaknesses in the current system are preventing this from happening. Based on the problems the staff has described, Jack notes that some of their basic criteria for successful collaborations are: regular communication, knowledge of each other’s programs, and common philosophies and goals. Lynn asks him to develop a plan to assess their collaboration efforts. Over a five-month period, Jack works with the staff of all the key agencies and gets their feedback on various aspects of collaboration. The guiding questions for the collaboration evaluation are: (1) How well do current collaborators understand the goals and operations of Even Start? (2) What are collaborators’ degrees of satisfaction with their relationship with Even Start? (3) How compatible are collaborators’ goals with Even Start goals? And have the goals of different programs grown closer as a result of the collaborative relationship? (4) What is needed to strengthen and improve collaborative relationships? Jack uses various approaches and instruments to collect evaluation data: focus groups, surveys, and follow-up interviews. The plan also addressed how the findings and recommendations would be presented, and it was agreed that Jack would make two presentations – one to the Even Start staff, and one to the collaborators’ staffs. Then the administrators from each agency will decide how they want to proceed. Soon after receiving the evaluation report, Lynn meets with her colleagues from the other agencies. Openly discussing the report and their individual perspectives on program services and participants reveals that, philosophically, they have similar hopes for family outcomes. But it is also obvious that the approaches reflected in their program designs and curricula are quite different, and most of the collaborators only concentrate on the family member that is their direct recipient or client. The administrators draw some immediate conclusions that echo the Even Start staff’s original concerns: (1) the lack of knowledge and coordination among agencies is causing services to conflict with each other and/or gaps in services, (2) families are not always looked at holistically, so some staff are not familiar with whole families and their goals and activities, and (3) both of these factors result in a lack of appropriate and sufficient services being provided to families. The discussion turns to how these problems can be improved. Numerous ideas and suggestions – and, of course, potential obstacles or difficulties – are generated. Lynn suggests they categorize the suggestions and issues into those that can be addressed now and those that require some long-range planning. She would like to end the meeting with some concrete action steps related to the short-term solutions. Everyone agrees that the following immediate steps will be taken to improve relationships and services: (1) They will schedule a joint staff training day devoted to familiarizing everyone with each other’s mission, program design and services, and client population. (2) The director and lead instructors from the adult education provider will meet with Lynn and her key staff to discuss how to improve the quantity and scheduling of adult education hours, and how they can integrate their instruction better based on family and adult learners’ goals. (3) The core collaborators will figure out a way to exchange relevant participant information, and to share and create cross-agency staff training. They have a lot of planning and work ahead of them to create a strong collaborative system, but Lynn feels optimistic as she leaves the meeting because she heard and saw her colleagues make the connection between the quality of their services and the successful experiences of families – and that it is mutually beneficial for everyone to work together on this. On that score, the evaluation process has already proved its worth.
Section II
Family Literacy Core Values: The Big Picture ____________________________________________________________________ This section begins with a brief discussion of seven essential values or themes that distinguish high quality family literacy programs. These values describe the "big picture" in Even Start. They are underlying principles for the design of high quality family literacy programs. The remainder of this section describes how these themes can be operationalized as quality indicators within and across program components. Focus on Literacy The improvement of literacy skills of family members is the primary focus of Even Start programs. Even Start programs target families who are most in need of services based upon low income, low level of literacy and other need-related factors, and who otherwise might not be reached or helped by other education programs. Literacy acquisition encompasses the four domains of language (reading, writing, speaking and listening) and numeracy. Literacy instruction should be woven into the activities of all program components, and presented and practiced in contexts that are meaningful to families’ lives and needs. Family-centered Programming As the primary stakeholders in Even Start programs, families are full partners in identifying their needs and priorities, shaping their goals, and making decisions about plans to achieve those goals. Program design is based on the needs, interests and goals of families. Even Start values the home and family unit as the most influential learning environment. Successful programs build on families’ strengths and celebrate their successes. Even Start is a safe and supportive place for families to grow and develop. Intensity and Duration of Services Even Start programs have high expectations for family involvement and commitment, and require that families participate fully in all program components. Programs encourage families to attend regularly and to remain in the program long enough to meet their long-term goals of academic improvement and self-sufficiency. The program is designed to provide services of the requisite intensity and duration to ensure that families can achieve such goals. Flexibility and Adaptability Successful Even Start programs fit services to families, not families to the program. Program services are tailored to meet the needs of individual families, both in content and the scheduling of services. Programs must remain flexible enough to recognize and accommodate the diverse interests and changing needs of families over time, including changes in support service needs (such as, transportation, child care and work demands). Programs also must respond to changing needs and populations in their communities. Partnership of Families and Service Providers Respect for the diverse languages, cultures, and life experiences of families is apparent in all aspects of program practice. Staff members view themselves as allies with other service providers in advocating for families within the larger community. Even Start staff work with families and other service providers to create and use social and resource support networks in the community. Continuity of Messages and Services Quality programs are characterized by research-based approaches, consistent values and curricula that are compatible across Even Start components and collaborating programs. The goal of Even Start programs is to provide seamless services for families through the many transitions that families will experience over time. To ensure continuity of services, Even Start administrators lead efforts to institutionalize family-centered approaches within the larger community of service providers. New Roles and Relationships for Staff Even Start programs require staff to operate in new ways and, thus, to provide cross-disciplinary and cross-agency training opportunities to support staff roles and responsibilities. The level of staff qualifications, experience and ongoing professional development are integral to the quality of programs. Staff from Even Start and collaborating agencies work together in the interests of their client families. This focus requires different types of relationships among service providers. Even Start places a high priority on developing truly collaborative relationships with key agencies to ensure comprehensive services for families.
Partnerships and Collaborations ____________________________________________ Challenge: To develop a strong partnership to operate the Even Start program and to form a network of service providers that, individually and collectively, take responsibility for providing and strengthening family literacy services. Even Start Note: It is important to distinguish between the many formal and informal agency relationships needed to implement a program, and the partnership agreement that constitutes the "eligible entity" that applies for an Even Start grant. Even Start programs apply for funding in partnerships of at least two organizational entities: one or more local educational agencies (LEAs) and one or more community-based organizations (CBOs), public agencies (non-LEA), institutions of higher education, or public or private nonprofit organizations of demonstrated quality. [Sections 1202(e)(1) and 1203(b)(1), ESEA.] The partners assume responsibility for the program’s compliance with legal requirements and proper use of federal funds, although they might not have equal management responsibilities. One partner, or the partnership as a whole, serves as the fiscal agent. In this section, the following terms are used:
See section on Program Leadership and Management for other indicators related to Partnerships and Collaborations. Quality Considerations:
Signs of Problems with Partnerships and Collaborations:
Program Leadership and Management _________________________________________________ Challenge: To provide leadership and direction for the Even Start program, and to employ management strategies that ensure that the program operates smoothly and can achieve its goals. The leadership maintains a vision of improving literacy for children and adults, and ensures that this vision is reflected in daily program practice. Even Start Note: The Even Start partnership helps to define the management structure of the program. A variety of administrative arrangements is possible, including variations in the degree to which the program is directed by an individual or by an administrative team, and the degree to which management functions are distributed among staff members. In this section, the following terms are used:
See sections on Partnerships and Collaborations and Staff Development for other indicators related to Program Leadership and Management. Quality Considerations:
Signs of Problems with Program Leadership and Management:
Integration of Instruction within PROGRAM Components _____________________________________________________________________ Challenge: To connect instruction within and across components through meaningful and consistent program messages and planning, and to have service providers work with the whole family, thereby providing an intensive experience intended to change intergenerational patterns associated with low levels of literacy. Even Start Note: The Even Start legislation requires programs to provide integrated family literacy services. [Section 1201, 1204, and 14101(15), ESEA.] Integration is one of the most difficult concepts associated with family literacy and holistic service approaches. It may include, but should not be confused with, "thematic planning" -- choosing a topic to be taught in all components and simply varying instruction per age group and skill level. The purpose of integrating components is to ensure that families receive consistent and reinforced messages about the value of education and learning from all staff. Integration of instruction within and across components ensures that, for each family member, learning in a variety of situations and mastery of new information and skills is thorough and complete. Even Start services are comprehensive, and the expectation is that all participants will actively and consistently participate in all program components:
Even Start program models vary widely. Most combine center-based and home-based services, and research shows that predominantly home-based programs are more effective when they have some center-based services. Some programs combine the services of different providers and operate in various locations. In other cases, a single provider offers all component services in a single location. Single or adjacent location of services facilitates integration. However, Even Start programs must build on existing high-quality educational services, combining and enhancing them with other community services to meet families’ needs. If component services are delivered by multiple providers at various sites, integration is more difficult and will require greater planning and collaboration. Quality Considerations:
Signs of Problems with Integration:
RECRUITMENT __________________________________ Challenge: To reach and recruit those families most in need, specifically low-income, disadvantaged families with low literacy skills, including those with limited English proficiency. Even Start Note: The Even Start program law requires programs to identify, recruit and serve families with the greatest need for Even Start services, as indicated by low income, level of literacy and English language proficiency of the eligible parents. In competitions, priority is given to projects planning to operate in areas with the highest concentrations of poverty or in empowerment zones or enterprise communities. Other need-related indicators also may be considered, such as disabling conditions, homelessness, or chronic unemployment. [Section 1205(1) and (14), ESEA.] To be eligible, families must have at least one eligible parent and one eligible child. Teen parents are eligible to participate if: they are within the state’s compulsory attendance age range; they are among those most in need and; the LEA provides or ensures the required basic education component. Teen parents over the compulsory school age range are eligible if they are attending school or qualify for services under the Adult Education and Family Literacy Act. [Section 1206(a)(1), ESEA.] Programs are required to serve at least a three-year age range of children, which may begin at birth and extend through age seven, and are encouraged to serve the full eligible age range. Children over age seven may participate in the program if the local project collaborates with a program under Title I, Part A and Title I, Part A funds contribute to the cost of providing Even Start services to those children, as long as the program continues to focus on families with young children. [Section 1206(b)(3), ESEA.] See section on Retention for other indicators related to Recruitment. Quality Considerations:
Signs of Problems with Recruitment:
RETENTION OF FAMILIES ___________________________________ Challenge: To keep families participating in the program long enough for them to achieve significant learning goals, make improvements in parenting skills, and increase their economic self-sufficiency. Even Start Note: The Even Start program is designed to facilitate the development of significant literacy skills in families who are most in need of literacy services and support. If goals related to literacy improvement are not part of a family’s overall goals, it will be difficult to retain them in the program and they may be better served in another type of program. Many Even Start participants need to remain in the program for one to two years to make substantial progress. Programs must encourage participating families to attend regularly and to remain in the program a sufficient time to meet their goals. [Section 1205(11), ESEA.] Many of the indicators in other sections also relate to Retention. Quality Considerations:
Signs of Problems with Retention:
Staff Development __________________________________ Challenge: To improve the skills of Even Start staff and staff from collaborating agencies to work effectively with participating families, and to plan and execute research-based program activities that support the achievement of family goals. Even Start Note: Staff development is required by the Even Start legislation, and is an important part of good program management and improvement, and the delivery of high-quality services. The legislation requires that staff whose salaries are paid partially or totally with Federal Even Start funds have certain qualifications, including that the majority of instructional staff have obtained an associate’s, bachelor’s or graduate degree in appropriate fields and meet any applicable state qualifications by December 21, 2004. New instructional staff must meet these qualifications when hired. [Section 1205(5), ESEA.] Through specialized training and the attainment of degrees and certifications, Even Start staff should be able to ascend a career ladder that is supported and recognized by the program. See section on Program Leadership and Management for other indicators related to Staff Development. Quality Considerations:
Signs of Problems with Staff Development:
Early Childhood Education for preschool children ___________________________________________________________________ Challenge: To provide a strong foundation for success in school for children from the families enrolled in Even Start by enhancing their cognitive and language development in developmentally appropriate settings. Even Start Note: Families with children from age birth through seven are eligible to participate in Even Start if a parent is eligible. [Section 1206, ESEA.] After the youngest child reaches the age of eight, a family may participate in Even Start for two more years until all participating parents are no longer eligible for adult basic education services under the Adult Education Act. [Section 1206(b), ESEA.] In addition, children over age seven may participate in the program if the local project collaborates with a program under Title I, Part A and Title I, Part A funds contribute to the cost of providing Even Start services to those children, as long as the program continues to focus on families with young children. [Section 1206(b)(3), ESEA.] All children in Even Start, including school-age children, should receive literacy services as long as they are eligible because children’s long-term success depends on consistent support of their development. For school-age children, this implies services that go beyond classroom participation. This section refers specifically to program settings for children ages 3 to 5. Quality considerations for younger and older children will be addressed in the second volume of the Guide to Quality. Quality Considerations:
Signs of Problems with Early Childhood Education for Preschool Children:
Adult Basic Education and Literacy _______________________________________________ Challenge: To improve the self-sufficiency of families by enabling adults to: identify their personal and educational needs; meet their goals related to those needs; increase their English-language literacy levels; enhance skills and opportunities related to employability; and improve their ability to be advocates for and teachers of their children. Even Start Note: Basic education and literacy instruction for parents that leads to economic self-sufficiency is a core component of all Even Start programs. [Sections 1205(4) and 14101(15), ESEA.] Teen parents are eligible to participate in Even Start if they:
Parents are eligible to participate under the Adult Education and Family Literacy Act if they:
In order to provide sufficient services to meet participants’ needs and goals and to avoid dupli |