Request for ECE Licensing Reports

Please share your research and evaluation reports about licensing in early care and education (ECE). Send the materials, along with your contact information, to by January 31, 2020.

The Office of Planning, Research and Evaluation (OPRE) recently posted a request for research and evaluation reports about licensing in ECE to inform this project, Understanding the Role of Licensing in Early Care and Education (TRLECE), 2019–2024. TRLECE will identify and address gaps in knowledge about how key features of the ECE licensing system are related to ECE quality and outcomes for children, families, and key stakeholders (e.g., providers, licensing agencies).

One of the early project activities is to refine a conceptual framework and to synthesize information regarding what is currently known about licensing research, policies, and administrative practices. The project team is searching for relevant licensing materials and will review a broad range of information. We invite you to share your relevant work with us. Examples include:

  • Evaluation reports of ECE licensing regulations or practices
  • Reports that summarize or analyze ECE licensing data at the local, regional, or state/territory level
  • Research reports, including manuscripts under review
  • National reports of licensing data across states or territories
  • Conceptual frameworks or models of ECE licensing
  • Logic models that include ECE licensing
  • Descriptions of outcomes or benefits of the ECE licensing system.

We will assume that the materials you share are publicly available unless you specify otherwise. Please include URL information for publicly available reports, if applicable. Please send all materials, along with your contact information, via email to by January 31, 2020.

We encourage you to share this email with colleagues who may have relevant work to share. To learn more about this request, visit the request for research and evaluation reports page.


TRLECE Project Team

Tracy Carter Clopet, Emily Ross, Ivelisse Martinez-Beck, and Ellen Litkowski, OPRE

Kelly Maxwell, Child Trends

Nina Johnson, ICF

Office of Child Care, Administration for Children and Families, U.S. Department of Health and Human Services, Mary E. Switzer Building, Fourth Floor, MS 4425, 330 C Street, S.W., Washington, DC  20201, General office number: (202) 690-6782, Fax: (202) 690-5600, General email:, Website:

Posted in | Leave a comment

Public Library of Science PLOS One: The iLookOut Research Study

Attached is the latest research article detailing the iLookOut Study and Program, Penn State, College of Medicine, Center for the Protection of Children:

Generalizing findings from a randomized controlled trial to a real-world study of the iLookOut, an online education program to improve early childhood care and education providers’ knowledge and attitudes about reporting child maltreatment


In recent years, real-world studies (RWS) are gaining increasing interests, because they can generate more realistic and generalizable results than randomized controlled clinical trials (RCT). In 2017, we published a RCT in 741 early childhood care and education providers (CCPs). It is the Phase I of our iLookOut for Child Abuse project (iLookOut), an online, interactive learning module about reporting suspected child maltreatment. That study demonstrated that in a RCT setting, the iLookOut is efficient at improving CCPs’ knowledge of and attitudes towards child maltreatment reporting. However, the generalizability of that RCT’s results in a RWS setting remains unknown. To address this question, we design and conduct this large RWS in 11,065 CCPs, which is the Phase II of the iLookOut. We hypothesize replication of the earlier RCT findings, i.e., the iLookOut can improve CCPs’ knowledge of and attitudes toward child maltreatment reporting in a real world setting. In addition, this RWS also explores whether demographic factors affect CCPs’ performance. Results of this RWS confirmed the generalizability of the previous RCT’s results in a real world setting. It yielded similar effect sizes for knowledge and attitudes as were found in the earlier RCT. Cohen’s d for knowledge improvement was 0.95 in that RCT, 0.96 in this RWS; Cohen’s d for attitude improvement was 0.98 in that RCT, 0.80 in this RWS. Also, we found several significant differences in knowledge and attitude improvement with regard to age, race, education, and employment status. In conclusion, iLookOut improves knowledge and attitudes of CCPs about child maltreatment prevention and reporting in a real-world setting. The generalizability of the initial RCT findings to this RWS provides strong evidence that the iLookout will be effective in other real world settings. It can be a useful model for other interventions aimed at preventing child maltreatment.

PLOS One Public Library of Science Research Article


Posted in | Leave a comment

CCDF Resource Manual and Differential Monitoring Algorithms

Below please find links to the CCDF Resource Manual which is a tremendous resource to state agency administrators as they are busy complying with the standards of the Child Care Development Fund.  The Office of Child Care has done a wonderful job in putting in one place a ton of resources that are readily available.

The second link is a series of papers that present the algorithms for putting in place a differential monitoring system.  It provides all the details for state agency Information Technology (IT) staff to get such a system up and running.  Again it provides one stop shopping for state administrators if they are interested in developing such a system.

CCDF Fundamentals Resource Guide

Differential Monitoring Algorithm Papers


Posted in | Leave a comment

NARA Annual Licensing Seminar

The National Association for Regulatory Administration (NARA) annual licensing seminar is next week.  It brings together key researchers, policy administrators, and licensing staff and administrators to discuss the latest developments in regulatory administration and science.  Attached is an overview highlighting the presentations for the week.  Please pay particular attention to the presentation by Lisa Clifford and Dawn Downer on Differential Monitoring Through Data Driven Decisions.  They have done a wonderful study in the state of Indiana in the development of a Licensing Key Indicator system and did some very interesting analyses in comparing licensing data with their QRIS system.   Many jurisdictions can learn about very effective and efficient data utilization from their approach.

NARA Licensing Seminar 2019 Schedule of Presentations


Posted in | Leave a comment

Three RIKI Technical Research Notes for Scientists, ECPQIM Data Distributions, and Principles of Regulatory Compliance Measurement

Listed in this RIKINotes blog are three RIKIllc Technical Research Notes for psychological scientists (geared for all scientists considering research with regulatory compliance data)(1), ECPQI2M (Early Childhood Program Quality Improvement and Indicator Model) data distributions(2), and proposed principles of regulatory compliance measurement(3).  These three technical research notes help to further delineate the nuances and idiosyncrasies of regulatory compliance data, measurement, and analysis.

  1. ECPQIM Regulatory Compliance Methods and Practices for Scientists
  2. ECPQIM DB Data Distributions
  3. Principles of Regulatory Compliance Measurement


Posted in | Leave a comment

Economic Application Utilizing the Theory of Regulatory Compliance

Here is an article published in the Academic Journal of Economic Studies utilizing the Theory of Regulatory Compliance (Fiene, 2016; 2019).  The study appraises the quality of compliance upheld by selected Nigerian and Ghanaian manufacturing companies to minimum disclosure requirements of IFRS during financial reporting. Hence, it determines whether any significant difference exists in the compliance quality of the post IFRS Financial Statements prepared in Nigeria and Ghana in their first five years of IFRS adoption. It is an empirical study that is descriptively designed to pave room for the use of the content analysis scoring system as the core instrument for data collection.

The study recommends that a more robust regulatory oversight on companies’ full compliance to IFRS disclosure requirements be upheld towards achieving a commendable level of comparison in both countries’ IFRS Financial Statements as expected. More so, companies’ consistent full compliance to IFRS requirements should hence be adopted as one of the prerequisites for there continued listing by the Nigerian and Ghana Stock Exchanges.

Academic Journal of Economic Studies

Posted in | Leave a comment

Exchange Leadership Initiative – New Exchange Leaders Announced

The July-August 2019 Issue of the Child Care Exchange Magazine was just published and I have the distinct honor to be included as one of the new Exchange Leaders announced in this edition of the magazine.  I feel humbled to be included with such a wonderful group of ECE professionals who are doing great work with young children.

Attached is the article that appeared in the magazine announcing the new Exchange Leaders and the Exchange Leader Webpage site:

Exchange Leadership Initiative Article

The Exchange Leaders


Posted in | Leave a comment

A Theory of Early Childhood Outcomes

Attached is a technical research note/abstract (RIKInote #75) on proposing a theory of early childhood outcomes based upon the combined impacts of professional development, program quality, and regulatory compliance.  This is an attempt to combine these major systems into a single unified equation in determining their relative weights for early childhood outcomes.  This is a controversial proposal but one based upon 50 years of research and empirical evidence, all taken from the Research Institute for Key Indicators’ Early Childhood Program Quality Improvement and Indicators Model data base.

TECO Fiene July 2019a


Posted in | Leave a comment

Capital Area Early Childhood Training Institute Reunion

We had a wonderful reunion of many of the staff and faculty from Penn State CAECTI – Capital Area Early Childhood Training Institute.  It was wonderful seeing everyone again.  Here is a picture from the reunion.

CAECTI 20190621_222031


Posted in | Leave a comment

Preparation for Washington State’s Validation Study Kick Off Meetings Next Week

I am in the midst of preparing to fly to Seattle next week to be part of the Washington State’s Validation Study Kick Off (NARA WA Validation) meetings in Olympia.  This is a really big deal in early care and education licensing because the state is expanding the use of weighted risk assessment in making licensing decisions.  In the past, weighted risk assessment has been used for making determinations about individual rules or regulations and about the frequency of monitoring visits.  Washington state’s licensing office has always been at the forefront of monitoring innovations in being one of the first states to utilize licensing key indicators which has been part of their overall differential/abbreviated monitoring for many years now.   According to my records, they have the longest running use of licensing key indicators than any other state or province.

Washington has been working with the National Association for Regulatory Administration on their weighted risk assessment project for the past couple of years and the next 1-2 years will be devoted to validating their approaches.  The interested reader can find out more details about Washington’s Research Agenda by going to  I will also be providing updates over the next couple of weeks during my time in Seattle and Olympia.  This is another major step in moving the regulatory science field forward when it comes to regulatory compliance, licensing measurement, and differential monitoring systems.

An interesting discussion during my time in Washington (RAM1)(NARA WA Validation PPT).

NARA WA IMG_2019-06-26_06-44-13



Posted in | Leave a comment