Objective
To provide background information about Scientifically Based Research (SBR) as it applies to educational technology in K-12 schools, and to provide guidance for using existing SBR studies and planning SBR in state and district programs.

Key Questions: What does scientifically-based research mean and how will states design systems to implement scientifically-based programs?

According the No Child Left Behind Act of 2001 (NCLB), scientifically-based research is defined as: "Research that involves the application of rigorous, systematic, and objective procedures to obtain reliable and valid knowledge relevant to education activities and programs." To meet this standard, the act outlines that a scientifically based research program:

• Employ systematic, empirical methods;
• Involve rigorous data analyses;
• Rely on measurements or observational methods;
• Be evaluated using experimental or quasi-experimental designs;
• Ensure that experimental studies are presented in sufficient detail and clarity to allow for replication;
• Have been accepted by a peer-reviewed journal or approved by a panel of independent experts.

Guidance from SETDA
The Scientifically Based Research (SBR) Work Group began by reviewing the definition of SBR included in the NCLB legislation and accepted it as the gold standard for research. State leaders also referred to the guidance on given by The National Research Council on their report "Scientific Research in Education" which elaborates upon the methods available for scientifically-based educational research.

After determining an agreeable starting point, the SBR Work Group began to develop a method states could use to implement a scientifically based research program. They first identified a set of key questions on scientifically-based programs and developed a road map with specific steps for implementing such state-wide programs. The group also examined the Missouri eMINTS study to test theories.

SBR Work Group Questions on SBR
The SBR Work Group identified the key questions a state director needs to answer before embarking on a SBR project. The group developed answers to nine (9) questions which are found in the NLI toolkit. Some examples include:

• What are the criteria or considerations when designing scientifically based research?
• What is the relationship between SBR and evaluation?
• How can we determine whether research instruments and data collection procedures are valid, reliable, and educationally meaningful?
• How can we have appropriate comparison, baseline, and /or control group measures within the realities of schools and classrooms?

Steps Toward Implementation
As the group developed a set of questions and answers on SBR, they also discussed the steps necessary for implementing a state-wide SBR program. They outlined eight (8) key steps:

1. Engage External Evaluator and Other Experts;
2. Generate Problem Statements and/or Questions;
3. Establish a Conceptual Framework;
4. Design Your Methodology;
5. Acquire Resources;
6. Implement Research Project;
7. Synthesize Findings and Relate the Study to Existing Literature;
8. Report Findings.

SETDA Tools to Assist States
This toolkit provides education leaders with:

• Gold Standard Definition of Scientifically-Based Research and Supporting Documentation
• Questions and Answers About SBR
• Roadmap of Defined Steps for Implementing a State-wide SBR Program

Previous | Next

Scientifically Based Research | Technology Literacy Assessment | Common Data Elements | Effective Teaching with Technology Assessment | National Education Technology Plan

© 2003 SETDA. Toolkit Resources